Search

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. In this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods. [ABSTRACT FROM AUTHOR]

In this work we propose a novel data-driven, real-time power system voltage control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to mitigate the fault-induced delayed voltage recovery (FIDVR) problem. Reinforcement learning methods have been developed for the same or similar challenging control problems, but they suffer from training inefficiency and lack of robustness for “corner or unseen” scenarios. On the other hand, extensive physical knowledge has been developed in power systems but little has been leveraged in learning-based approaches. To address these challenges, we introduce the trainable action mask technique for flexibly embedding physical knowledge into RL models to rule out unnecessary or unfavorable actions, and achieve notable improvements in sample efficiency, control performance and robustness. Furthermore, our method leverages past learning experience to derive surrogate gradient to guide and accelerate the exploration process in training. Case studies on the IEEE 300-bus system and comparisons with other state-of-the-art benchmark methods demonstrate effectiveness and advantages of our method. [ABSTRACT FROM AUTHOR]

One challenge in power-system control designs is the gap between numerical model-based analysis and complex real-world power systems. With increased data and measurements being collected from power systems, data-driven analysis (e.g., machine learning) may provide an alternative approach to reveal hidden information through learning from the real system data, and provide insights for better control scheme design during the utility planning process. In this study, data-driven feature analysis is performed to evaluate the relationships between series compensation, power generation, and path flows in a real transmission system, as well as temporal patterns. The main data-driven analysis methods, including statistical cross correlation, multinomial logistical regression, and classification and regression trees, are integrated for feature selection and developing predictive models of series compensation. Analysis results demonstrates the effectiveness of the proposed methodology in feature analysis and the potential to help improve power-system control scheme design. [ABSTRACT FROM AUTHOR]