高级检索

极热无风灾害下主动配电网级联过载的风险约束安全强化学习预防控制

Risk-constrained safe reinforcement learning preventive control for cascading overloads in active distribution networks under extreme heat and calm wind disasters

  • 摘要: 针对极热无风灾害下主动配电网可再生能源出力骤降、负荷激增及多源不确定性耦合引发的快速级联过载问题,提出了一种风险约束安全强化学习预防控制方法。首先,构建融入极端气象特征的级联过载约束马尔可夫决策过程模型,将发电再调度、网络重构与负荷削减联合建模为控制动作,实现风险与经济成本的统一刻画;然后,设计边条件卷积网络与长短期记忆网络融合的时空特征提取模块,增强对拓扑耦合与状态演化的时空关联感知;最后,采用内点策略优化算法构造安全深度强化学习控制器,通过对数障碍函数实现安全约束的隐式满足,避免传统惩罚函数中惩罚因子的人工调参。基于IEEE 33节点与某省级110 kV配电系统的蒙特卡洛仿真结果表明:所提方法下平均负荷损失降低67.3%,线路过载次数减少82.5%,IEEE 33节点系统约束违反率控制在3%以内,110 kV实际系统约束违反率控制在4%以内,均满足工程可接受的5%阈值要求,决策时间保持毫秒级;相较直流潮流优化及标准深度Q网络算法、A3C算法,所提方法在缓解级联过载、保障约束安全与应对不确定性方面优势显著。

     

    Abstract: To address the rapid cascading overload problem in active distribution networks caused by the sharp drop of renewable energy output, sharp surge of load demand, and coupling of multi-source uncertainties under extreme heat and calm wind disasters, this paper proposes a risk-constrained safe reinforcement learning preventive control method. First, a cascading overload-constrained Markov decision process model incorporating extreme meteorological features is constructed, where generation rescheduling, network reconfiguration, and load shedding are jointly modeled as control actions to achieve unified characterization of risk and economic cost. Second, a spatiotemporal feature extraction module integrating edge-condition convolutional neural networks and long short-term memory networks is designed to enhance the perception of spatiotemporal correlations between topological coupling and state evolution. Finally, an interior-point policy optimization algorithm is employed to construct a safe deep reinforcement learning (DRL) controller, where logarithmic barrier functions enable implicit satisfaction of safety constraints, thereby avoiding the manual tuning of penalty factors required in the conventional penalty function methods. Monte Carlo simulation results based on the IEEE 33-bus system and a provincial 110 kV distribution system demonstrate that the proposed method reduces the average load loss by 67.3% and decreases the number of line overload occurrences by 82.5%; the constraint violation rate is maintained below 3% for the IEEE 33-bus system and below 4% for the 110 kV practical system, both satisfying the engineering-acceptable threshold of 5%. Meanwhile, the decision time remains at the millisecond level. Compared with DC power flow optimization and standard DQN and A3C algorithms, the proposed method exhibits significant advantages in mitigating cascading overloads, ensuring constraint safety, and handling uncertainties.

     

/

返回文章
返回