4.8 Article

Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach

Journal

APPLIED ENERGY
Volume 333, Issue -, Pages -

Publisher

ELSEVIER SCI LTD
DOI: 10.1016/j.apenergy.2022.120540

Keywords

Island integrated energy system; Deep reinforcement learning; Multi -uncertainties; Desalination; Hydrothermal simultaneous transmission; Optimal scheduling

Ask authors/readers for more resources

A comprehensive scheduling framework is proposed to address the challenges brought by multiple uncertainties from power sources and loads at islands. It introduces a model-free deep reinforcement learning (DRL) approach based on modeling an island integrated energy system (IES). The framework also includes a transmission structure of hydrothermal simultaneous transmission (HST) to tackle the shortage of freshwater on islands.
Multi-uncertainties from power sources and loads have brought significant challenges to the stable demand supply of various resources at islands. To address these challenges, a comprehensive scheduling framework is proposed by introducing a model-free deep reinforcement learning (DRL) approach based on modeling an island integrated energy system (IES). In response to the shortage of freshwater on islands, in addition to the intro-duction of seawater desalination systems, a transmission structure of hydrothermal simultaneous transmission (HST) is proposed. The essence of the IES scheduling problem is the optimal combination of each unit's output, which is a typical timing control problem and conforms to the Markov decision-making solution framework of deep reinforcement learning. Deep reinforcement learning adapts to various changes and timely adjusts strate-gies through the interaction of agents and the environment, avoiding complicated modeling and prediction of multi-uncertainties. The simulation results show that the proposed scheduling framework properly handles multi-uncertainties from power sources and loads, achieves a stable demand supply for various resources, and has better performance than other real-time scheduling methods, especially in terms of computational efficiency. In addition, the HST model constitutes an active exploration to improve the utilization efficiency of island freshwater.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Physics, Multidisciplinary

Data encryption based on a 9D complex chaotic system with quaternion for smart grid

Fangfang Zhang, Zhe Huang, Lei Kou, Yang Li, Maoyong Cao, Fengying Ma

Summary: In this paper, a new 9-dimensional complex chaotic system with quaternion is proposed for the encryption of smart grid data. Pseudo-random sequences generated by the new chaotic system are used to encrypt power data. The verification results show that the proposed encryption scheme is technically feasible and available for power data encryption in smart grid.

CHINESE PHYSICS B (2023)

Article Energy & Fuels

Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach

Yang Li, Ruinong Wang, Yuanzheng Li, Meng Zhang, Chao Long

Summary: In a modern power system with a growing proportion of renewable energy, accurate wind power prediction is important for power grid dispatching plans. Traditional methods have concerns regarding data privacy and data islands. To address these issues, a scheme called federated deep reinforcement learning (FedDRL) is proposed, which combines federated learning and deep reinforcement learning (DRL). By sharing model parameters instead of private data, FedDRL can obtain an accurate prediction model while protecting data privacy and relieving communication pressure. Simulation results demonstrate the superiority of FedDRL in terms of forecasting accuracy compared to traditional methods.

APPLIED ENERGY (2023)

Article Computer Science, Artificial Intelligence

Federated Multiagent Deep Reinforcement Learning Approach via Physics-Informed Reward for Multimicrogrid Energy Management

Yuanzheng Li, Shangyang He, Yang Li, Yang Shi, Zhigang Zeng

Summary: This article proposes a federated multiagent deep reinforcement learning algorithm for energy management in multimicrogrids. The federated learning mechanism is introduced to ensure data privacy and security. Experimental results demonstrate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Energy & Fuels

Data-driven distributionally robust scheduling of community integrated energy systems with uncertain renewable generations considering integrated demand response

Yang Li, Meng Han, Mohammad Shahidehpour, Jiazheng Li, Chao Long

Summary: A community integrated energy system (CIES) is a significant component of the energy internet and smart city, providing a new solution to energy utilization and environmental pollution. To address uncertainties in renewable energy generation (RGs), a data-driven two-stage distributionally robust optimization (DRO) model is constructed. A generative adversarial network based on the Wasserstein distance is proposed to generate scenarios for RGs, and an integrated demand response mechanism is developed to promote renewable energy consumption.

APPLIED ENERGY (2023)

Article Energy & Fuels

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

Jiankai Gao, Yang Li, Bin Wang, Haibo Wu

Summary: This paper proposes an MMG collaborative optimization scheduling model based on a multi-agent centralized training distributed execution framework for the energy management problem of an MMG system. An improved MASAC algorithm is also introduced to deal with uncertainties and enhance the generalization ability of DRL. Experimental results demonstrate the effectiveness and superiority of the proposed method in power complementarity and operating cost reduction of the MMG system.

ENERGIES (2023)

Article Automation & Control Systems

Demand response method considering multiple types of flexible loads in industrial parks

Jia Cui, Mingze Gao, Xiaoming Zhou, Yang Li, Wei Liu, Jiazheng Tian, Ximing Zhang

Summary: This paper proposes a demand response method considering multiple flexible loads to characterize the integrated demand response resources. A physical process analytical deduction model is proposed to improve the classification of flexible loads. An improved WGAN-gradient penalty model is developed to enhance the modeling effect and convergence speed. The joint implementation of the PPAD and IWGAN-GP models reveals the correlation between flexible loads and an intelligent offline database is built to handle nonlinear factors in different response scenarios.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2023)

Article Engineering, Electrical & Electronic

A novel method of restoration path optimization for the alternating current-direct current bulk power grid after a major blackout

Chao Yang, Gaoshen Liang, Tianle Cheng, Yang Li, Shaoyan Li

Summary: This paper proposes an optimization method of restoration path to reconfigure the skeleton network for the blackout alternating current-direct current hybrid power grid. In this method, the influence of the restoration path on the system strength is derived in detail, the relationship between restoration path and line-commutated converter high-voltage direct current restoration characteristic is quantified, and non-tree paths are considered to establish an optimization model of restoration path.

IET GENERATION TRANSMISSION & DISTRIBUTION (2023)

Editorial Material Energy & Fuels

Special issue on innovative methods and techniques for power and energy systems with high penetration of distributed energy resources

Yang Li, Shunbo Lei, Xia Chen, Chao Long, Yifan Zhou, Young-Jin Kim

ENERGY REPORTS (2023)

Article Green & Sustainable Science & Technology

Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance

Yang Li, Jiting Cao, Yan Xu, Lipeng Zhu, Zhao Yang Dong

Summary: This study proposes a Transformer-based method for short-term voltage stability assessment in power systems, which addresses the issue of data imbalance by utilizing a conditional Wasserstein generative adversarial network with gradient penalty. Extensive numerical tests on the IEEE 39-bus test system demonstrate the robust performance of the proposed method under class imbalances and noisy environments.

RENEWABLE & SUSTAINABLE ENERGY REVIEWS (2024)

Article Engineering, Electrical & Electronic

PMU Measurements-Based Short-Term Voltage Stability Assessment of Power Systems via Deep Transfer Learning

Yang Li, Shitu Zhang, Yuanzheng Li, Jiting Cao, Shuyue Jia

Summary: This article proposes a new method for short-term voltage stability assessment using phasor measurement unit measurements, which overcomes limitations of existing methods in adapting to topological changes, sample labeling, and handling small datasets by employing deep transfer learning. Experimental results demonstrate the method's strong adaptability to topological changes and significant improvement in model evaluation accuracy on small-scale datasets.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Computer Science, Artificial Intelligence

Image encryption for offshore wind power based on 2D-LCLM and Zhou Yi eight trigrams

Lei Kou, Jinbo Wu, Fangfang Zhang, Peng Ji, Wende Ke, Junhe Wan, Hailin Liu, Yang Li, Quande Yuan

Summary: An encryption algorithm for offshore wind power based on two-dimensional lagged complex logistic mapping (2D-LCLM) and Zhou Yi eight trigrams is proposed. The algorithm demonstrates resistance to common attacks and has excellent encryption performance.

INTERNATIONAL JOURNAL OF BIO-INSPIRED COMPUTATION (2023)

Article Energy & Fuels

Theoretical and experimental investigation on the advantages of auxetic nonlinear vortex-induced vibration energy harvesting

Shitong Fang, Houfan Du, Tao Yan, Keyu Chen, Zhiyuan Li, Xiaoqing Ma, Zhihui Lai, Shengxi Zhou

Summary: This paper proposes a new type of nonlinear VIV energy harvester (ANVEH) that compensates for the decrease in peak energy output at low wind speeds by introducing an auxiliary structure. Theoretical and experimental results show that ANVEH performs better than traditional nonlinear VIV energy harvesters under various system parameter variations.

APPLIED ENERGY (2024)

Article Energy & Fuels

Evaluation method for the availability of solar energy resources in road areas before route corridor planning

Wei Jiang, Shuo Zhang, Teng Wang, Yufei Zhang, Aimin Sha, Jingjing Xiao, Dongdong Yuan

Summary: A standardized method was developed to evaluate the availability of solar energy resources in road areas, which combined the Analytic Hierarchy Process (AHP) and the Geographic Information System (GIS). By analyzing critical factors and using a multi-indicator evaluation method, the method accurately evaluated the utilization of solar energy resources and guided the optimal location selection for road photovoltaic (PV) projects. The results provided guidance for the application of road PV projects and site selection for route corridors worldwide, promoting the integration of transportation and energy.

APPLIED ENERGY (2024)

Article Energy & Fuels

Impacts of PTL coating gaps on cell performance for PEM water electrolyzer

Chang Liu, Jacob A. Wrubel, Elliot Padgett, Guido Bender

Summary: The study investigates the effects of coating defects on the performance of the anode porous transport layer (PTL) in water electrolyzers. The results show that an increasing fraction of uncoated regions on the PTL leads to decreased cell performance, with continuous uncoated regions having a more severe impact compared to multiple thin uncoated strips.

APPLIED ENERGY (2024)

Article Energy & Fuels

Coordinated pricing mechanism for parking clusters considering interval-guided uncertainty-aware strategies

Marcos Tostado-Veliz, Xiaolong Jin, Rohit Bhakar, Francisco Jurado

Summary: In this paper, a coordinated charging price mechanism for clusters of parking lots is proposed. The research shows that enabling vehicle-to-grid characteristics can bring significant economic benefits for users and the cluster coordinator, and vehicle-to-grid impacts noticeably on the risk-averse character of the uncertainty-aware strategies. The developed pricing mechanism can reduce the cost for users, avoiding to directly translate the energy cost to charging points.

APPLIED ENERGY (2024)

Article Energy & Fuels

The establishment of evaluation systems and an index for energy superpower

Duan Kang

Summary: Building an energy superpower is a key strategy for China and a long-term goal for other countries. This study proposes an evaluation system and index for measuring energy superpower, and finds that China has significantly improved its ranking over the past 21 years, surpassing other countries.

APPLIED ENERGY (2024)

Article Energy & Fuels

A model-based study of the evolution of gravel layer permeability under the synergistic blockage effect of sand particle transport and secondary hydrate formation

Fucheng Deng, Yifei Wang, Xiaosen Li, Gang Li, Yi Wang, Bin Huang

Summary: This study investigated the synergistic blockage mechanism of sand and hydrate in gravel filling layer and the evolution of permeability in the layer. Experimental models and modified permeability models were established to analyze the effects of sand particles and hydrate formation on permeability. The study provided valuable insights for the safe and efficient exploitation of hydrate reservoirs.

APPLIED ENERGY (2024)

Article Energy & Fuels

Energy optimization for HVAC systems in multi-VAV open offices: A deep reinforcement learning approach

Hao Wang, Xiwen Chen, Natan Vital, Edward Duffy, Abolfazl Razi

Summary: This study proposes a HVAC energy optimization model based on deep reinforcement learning algorithm. It achieves 37% energy savings and ensures thermal comfort for open office buildings. The model has a low complexity, uses a few controllable factors, and has a short training time with good generalizability.

APPLIED ENERGY (2024)

Article Energy & Fuels

Asymmetry stagger array structure ultra-wideband vibration harvester integrating magnetically coupled nonlinear effects

Moyue Cong, Yongzhuo Gao, Weidong Wang, Long He, Xiwang Mao, Yi Long, Wei Dong

Summary: This study introduces a multi-strategy ultra-wideband energy harvesting device that achieves high power output without the need for external power input. By utilizing asymmetry, stagger array, magnetic coupling, and nonlinearity strategies, the device maintains a stable output voltage and high power density output at non-resonant frequencies. Temperature and humidity monitoring are performed using Bluetooth sensors to adaptively assess the device.

APPLIED ENERGY (2024)

Article Energy & Fuels

Enhancement of hydrogen production via optimizing micro-structures of electrolyzer on a microfluidic platform

Tianshu Dong, Xiudong Duan, Yuanyuan Huang, Danji Huang, Yingdong Luo, Ziyu Liu, Xiaomeng Ai, Jiakun Fang, Chaolong Song

Summary: Electrochemical water splitting is crucial for hydrogen production, and improving the hydrogen separation rate from the electrode is essential for enhancing water electrolyzer performance. However, issues such as air bubble adhesion to the electrode plate hinder the process. Therefore, a methodology to investigate the two-phase flow within the electrolyzer is in high demand. This study proposes using a microfluidic system as a simulator for the electrolyzer and optimizing the two-phase flow by manipulating the micro-structure of the flow.

APPLIED ENERGY (2024)

Article Energy & Fuels

A novel day-ahead scheduling model to unlock hydropower flexibility limited by vibration zones in hydropower-variable renewable energy hybrid system

Shuo Han, Yifan Yuan, Mengjiao He, Ziwen Zhao, Beibei Xu, Diyi Chen, Jakub Jurasz

Summary: Giving full play to the flexibility of hydropower and integrating more variable renewable energy is of great significance for accelerating the transformation of China's power energy system. This study proposes a novel day-ahead scheduling model that considers the flexibility limited by irregular vibration zones (VZs) and the probability of flexibility shortage in a hydropower-variable renewable energy hybrid generation system. The model is applied to a real hydropower station and effectively improves the flexibility supply capacity of hydropower, especially during heavy load demand in flood season.

APPLIED ENERGY (2024)

Article Energy & Fuels

Archery-inspired catapult mechanism with controllable energy release for efficient ultralow-frequency energy harvesting

Zhen Wang, Kangqi Fan, Shizhong Zhao, Shuxin Wu, Xuan Zhang, Kangjia Zhai, Zhiqi Li, Hua He

Summary: This study developed a high-performance rotary energy harvester (AI-REH) inspired by archery, which efficiently accumulates and releases ultralow-frequency vibration energy. By utilizing a magnetic coupling strategy and an accumulator spring, the AI-REH achieves significantly accelerated rotor speeds and enhanced electric outputs.

APPLIED ENERGY (2024)

Article Energy & Fuels

A novel combined probabilistic load forecasting system integrating hybrid quantile regression and knee improved multi-objective optimization strategy

Yi Yang, Qianyi Xing, Kang Wang, Caihong Li, Jianzhou Wang, Xiaojia Huang

Summary: In this study, a novel hybrid Quantile Regression (QR) model is proposed for Probabilistic Load Forecasting (PLF). The model integrates causal dilated convolution, residual connection, and Bidirectional Long Short-Term Memory (BiLSTM) for multi-scale feature extraction. In addition, a Combined Probabilistic Load Forecasting System (CPLFS) is proposed to overcome the inherent flaws of relying on a single model. Simulation results show that the hybrid QR outperforms traditional models and CPLFS exceeds the best benchmarks in terms of prediction accuracy and stability.

APPLIED ENERGY (2024)

Article Energy & Fuels

Capacity fade prediction for vanadium redox flow batteries during long-term operations

Wen-Jiang Zou, Young-Bae Kim, Seunghun Jung

Summary: This paper proposes a dynamic prediction model for capacity fade in vanadium redox flow batteries (VRFBs). The model accurately predicts changes in electrolyte volume and capacity fade, enhancing the competitiveness of VRFBs in energy storage applications.

APPLIED ENERGY (2024)

Article Energy & Fuels

State-of-charge balancing strategy of battery energy storage units with a voltage balance function for a Bipolar DC mircrogrid

Yuechao Ma, Shengtie Wang, Guangchen Liu, Guizhen Tian, Jianwei Zhang, Ruiming Liu

Summary: This paper focuses on the balance of state of charge (SOC) among multiple battery energy storage units (MBESUs) and bus voltage balance in an islanded bipolar DC microgrid. A SOC automatic balancing strategy is proposed considering the energy flow relationship and utilizing the adaptive virtual resistance algorithm. The simulation results demonstrate the effectiveness of the proposed strategy in achieving SOC balancing and decreasing bus voltage unbalance.

APPLIED ENERGY (2024)

Article Energy & Fuels

Deep clustering of reinforcement learning based on the bang-bang principle to optimize the energy in multi-boiler for intelligent buildings

Raad Z. Homod, Basil Sh. Munahi, Hayder Ibrahim Mohammed, Musatafa Abbas Abbood Albadr, Aissa Abderrahmane, Jasim M. Mahdi, Mohamed Bechir Ben Hamida, Bilal Naji Alhasnawi, A. S. Albahri, Hussein Togun, Umar F. Alqsair, Zaher Mundher Yaseen

Summary: In this study, the control problem of the multiple-boiler system (MBS) is formulated as a dynamic Markov decision process and a deep clustering reinforcement learning approach is applied to obtain the optimal control policy. The proposed strategy, based on bang-bang action, shows superior response and achieves more than 32% energy saving compared to conventional fixed parameter controllers under dynamic indoor/outdoor actual conditions.

APPLIED ENERGY (2024)