Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Ma, Ming and Du, Wanlin and Wang, Ling and Ding, Cangbi and Liu, Siqi (2023) Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm. Frontiers in Energy Research, 10. ISSN 2296-598X

[thumbnail of pubmed-zip/versions/1/package-entries/fenrg-10-1097319/fenrg-10-1097319.pdf] Text
pubmed-zip/versions/1/package-entries/fenrg-10-1097319/fenrg-10-1097319.pdf - Published Version

Download (2MB)

Abstract

A large number of distributed generators (GDs) such as photovoltaic panels (PVs) and energy storage (ES) systems are connected to distribution networks (DNs), and these high permeability GDs can cause voltage over-limit problems. Utilizing new developments in deep reinforcement learning, this paper proposes a multi-timescale control method for maintaining optimal voltage of a DN based on a DQN-DDPG algorithm. Here, we first analyzed the output characteristics of the devices with voltage regulation function in the DN and then used the deep Q network (DQN) algorithm to optimize the voltage regulation over longer times and the deep deterministic policy gradient (DDPG) algorithm to optimize the voltage regulation mode over short time periods. Second, the design strategy of the DQN-DDPG algorithm as based on the Markov decision process transformation was presented for the stated objectives and constraints considering the state of ES charge for prolonging the energy storage capacity. Lastly, the proposed strategy was verified on a simulation platform, and the results obtained were compared to those from a particle swarm optimization algorithm, demonstrating the method’s effectiveness.

Item Type: Article
Subjects: STM Digital > Energy
Depositing User: Unnamed user with email support@stmdigital.org
Date Deposited: 29 Apr 2023 07:09
Last Modified: 14 Sep 2024 04:42
URI: http://research.asianarticleeprint.com/id/eprint/714

Actions (login required)

View Item
View Item