Risk-Based Reserve Scheduling for Active Distribution Networks Based on an Improved Proximal Policy Optimization Algorithm

Achieving the coordinated optimization of tie-line reserve and energy storage on two timescales is a key issue in reserve scheduling for active distribution networks. To effectively manage the uncertainty related to renewable energy, we propose risk-based reserve scheduling for active distribution networks based on an improved proximal policy optimization algorithm. The reserve scheduling for active distribution networks is constructed as a two-scale multistage stochastic programming model, in which intraday real-time operation is constructed as a multi-stage stochastic programming model. With the help of more accurate and realistic intraday operation scenario simulation, the energy storage can be fully utilized to improve the system’s ability to climb and peak, reduce the reserve pressure of the main network, and achieve the purpose of improving the flexibility of system operation. An improved proximal policy optimization algorithm is proposed to solve optimization problems in a model-free manner while effectively handling conditional value-at-risk constraints. The effectiveness of the proposed risk-based reserve scheduling for active distribution networks based on an improved proximal policy optimization algorithm is verified by a modified IEEE33 case.