高级检索

基于深度强化学习的孤岛微电网二次频率控制

Secondary Frequency Control of Islanded Microgrid Based on Deep Reinforcement Learning

  • 摘要: 随着分布式电源大量接入微电网,可再生能源发电波动性和系统随机扰动给孤岛微电网频率稳定和运行控制带来了严重威胁。为此,提出了基于深度强化学习的二次频率控制方法,分析孤岛微电网下垂控制特性,提出了基于深度Q网络的二次频率控制器结构。将频率偏差作为状态输入变量,依次完成深度Q网络算法中状态空间、动作空间、奖励函数、神经网络和超参数的设计,其中奖励函数兼顾了频率恢复和各分布式电源功率分配的目标,实现各智能体动作选择一致性;通过离线学习训练生成深度强化学习二次频率控制器。在Matlab/Simulink中搭建孤岛微电网仿真模型,设置多场景源荷扰动验证控制器性能。结果表明,与传统PID控制和基于Q学习算法控制器相比,该控制方法能够快速实现更稳定的二次频率控制,并能自适应协调各分布式电源按自身容量进行功率分配,确保系统稳定运行。

     

    Abstract: With the large-scale integration of distributed generation into microgrids, the volatility of renewable energy generation and system random disturbances pose significant threats to the frequency stability and operational control of islanded microgrids. To address this, a secondary frequency control method based on deep reinforcement learning is proposed. The droop control characteristics of islanded microgrids are analyzed, and a secondary frequency controller structure based on deep Q-Networks is presented. The frequency deviation is used as the state input variable, and the design of the state space, action space, reward function, neural network, and hyperparameters in the deep Q-Networks algorithm is carried out. The reward function balances the goals of frequency recovery and power allocation among distributed energy resources , ensuring consistency in action selection among the intelligent agents. An offline learning process is used to train the deep reinforcement learning-based secondary frequency controller. A simulation model of the islanded microgrid is developed in Matlab/Simulink, and multiple disturbance scenarios are tested to validate the controller's performance. The results show that, compared to traditional PID control and Q-Learning-based controllers, the proposed method achieves more stable secondary frequency control and adapts to coordinate the power allocation of distributed generation units according to their capacities, ensuring the stable operation of the system.

     

/

返回文章
返回