Journal
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY
Volume 12, Issue 2, Pages 1406-1415Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSTE.2020.3047137
Keywords
Power grids; Automatic generation control; Frequency control; Reinforcement learning; Load modeling; Optimization; Heuristic algorithms; Multi-area Interconnected Power Grid; AGC; reinforcement learning; Battery Energy Storage System
Categories
Funding
- National Natural Science Foundation of China [51707102]
- Research Fund for Excellent Dissertation of China Three Gorges University [2021SSPY063]
Ask authors/readers for more resources
The increase in new energies and electric vehicles poses new challenges to the power grid, and an algorithm based on DQ(sigma, lambda) is proposed to improve the stability and performance of multi-area interconnected power systems.
As the penetration rate of new energies, energy storage devices and electric vehicles increases continuously in power grid, power grid faces strong random disturbances, as well as the issues of downfall in frequency control ability induced by the factors such as system inertia reduction and frequency control under-capacity in traditional power units. Therefore, an algorithm of automatic generation control with DQ(sigma, lambda) is proposed for the multi-area interconnected power grid. By integrating the eligibility trace, DQ(sigma, lambda) adopts the principle of double Q-learning to unify double Q(lambda) and double Expected-Sarsa(lambda), thereby the over-estimation of Q in the algorithm and the phenomenon of over-fitting can be avoided. The simulations are provided to demonstrate the effectiveness of the proposed algorithm, where the improved IEEE standard two-area load-frequency control model and the model of the multi-area interconnected power grid based on Central China Power Grid are adopted. The results show that the phenomena of random disturbances and frequency instability can be eliminated in multi-area interconnected power grid. The convergence is faster and the dynamic performance is better in the proposed algorithm compared with the traditional algorithms.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available