Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system

Abstract To balance the stochastic power disturbance in integrated energy system (IES), a novel automatic generation control (AGC) dispatch is proposed by taking account of the regulation rule that applies to a performance-based frequency regulation market, with the aim to reduce area control deviation and regulation mileage payment while complying with constraints of various regulation units. Thus, a multiple experience pool replay twin delayed deep deterministic policy gradient (MEPR-TD3) is put forward to improve the training efficiency and the action quality via four improvements including the multiple experience pool probability replay strategy. Finally, the performance of the proposed algorithm is verified on an extended two-area load frequency control (LFC) model and Hainan province IES with different demand of multiple energy.