Electric Power ›› 2025, Vol. 58 ›› Issue (4): 44-55.DOI: 10.11930/j.issn.1004-9649.202410025

• Key Technologies of Local Energy System Operation Under Electric-Carbon Coordination • Previous Articles     Next Articles

Multi-entity Behaviors in Electricity-Carbon-Green Certificate Coupled Markets Based on Multi-agent Reinforcement Learning

ZHOU Feihang1(), WANG Hao1(), WANG Haili1, WANG Meng1, JIN Yaojie1, LI Zhongchun1, ZHANG Zhongde2, WANG Peng3   

  1. 1. Inner Mongolia Power Exchange Center Co., Ltd., Hohhot 010020, China
    2. College of Electrical and Electronic Engineering, North China Electric Power University, Beijing 102206, China
    3. National Institute of Energy Development Strategy, North China Electric Power University, Beijing 102206, China
  • Received:2024-10-09 Accepted:2025-01-07 Online:2025-04-23 Published:2025-04-28
  • Supported by:
    This work is supported by Science & Technology Project of Inner Mongolia Power Exchange Center Co., Ltd. (Research on the Coupling Mechanism of Electricity Carbon Market and the Deepening of Inner Mongolia Electricity Trading Mechanism, No.DLJY-GKCG-2024-SCJYYB-0401-0013).

Abstract:

Establishing a national carbon emission trading market and green certificate market is one of the key strategies for China to achieve its "dual carbon" goals. However, existing research predominantly analyzes the market coupling relationships from an economic perspective, overlooking the impact of power network physical constraints and the uncertainty of renewable energy output on the coordinated optimization of markets. Additionally, the scenario of power consumers participating in the carbon market has not been considered. To address this limitation, a bi-level optimization model for the coupled electricity-carbon-green certificate market based on physical network nodes is proposed to analyzes the behaviors of market entities and the changes in coupling mechanisms under the context of carbon market expansion. In the model, a decision-making mechanism is introduced for power consumers participating in the carbon market based on the physical topology of the power grid, and by incorporating the offset rules between green certificates and carbon allowances, the impact of transmission line congestion on the decision-making of market entities is explored. The actual output data of new energy units in the Mongolia region is used to verify the rationality and effectiveness of the proposed model. The results show that the participation of electricity users in the carbon market can significantly increase the overall returns of the coupled market, and line congestion has a significant impact on the behaviors of market entities and market revenues; in the context of abundant carbon quotas, introducing the carbon credit offset mechanism can further optimize the coupled market efficiency.

Key words: carbon emission trading market, green certificate market, coupled market bi-level optimization model, multi-agent reinforcement learning, line congestion, carbon credit offset mechanism