4.7 Review

Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges

Journal

IEEE TRANSACTIONS ON SMART GRID
Volume 10, Issue 3, Pages 3125-3148

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSG.2018.2818167

Keywords

Smart meter; big data; data analytics; demand response; consumer segmentation; clustering; load forecasting; anomaly detection; deep learning; machine learning

Funding

  1. National Key Research and Development Program of China [2016YFB0900100]
  2. National Natural Science Foundation of China [U1766212]
  3. State Grid [U1766212]

Ask authors/readers for more resources

The widespread popularity of smart meters enables an immense amount of fine-grained electricity consumption data to be collected. Meanwhile, the deregulation of the power industry, particularly on the delivery side, has continuously been moving forward worldwide. How to employ massive smart meter data to promote and enhance the efficiency and sustainability of the power grid is a pressing issue. To date, substantial works have been conducted on smart meter data analytics. To provide a comprehensive overview of the current research and to identify challenges for future research, this paper conducts an application-oriented review of smart meter data analytics. Following the three stages of analytics, namely, descriptive, predictive, and prescriptive analytics, we identify the key application areas as load analysis, load forecasting, and load management. We also review the techniques and methodologies adopted or developed to address each application. In addition, we also discuss some research trends, such as big data issues, novel machine learning technologies, new business models, the transition of energy systems, and data privacy and security.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Energy & Fuels

A mixed-integer programming approach for industrial non-intrusive load monitoring

Chuyi Li, Kedi Zheng, Hongye Guo, Qixin Chen

Summary: With the development of the smart grid, non-intrusive load monitoring (NILM) is a low-cost solution that provides appliance-level load information without installing extra sensors. This paper focuses on industrial NILM and proposes a mixed-integer programming NILM approach for flowline industries. The approach models equipment with different load features separately, exploits temporal dependencies, and introduces a pulse width constraint to improve performance.

APPLIED ENERGY (2023)

Article Thermodynamics

A simplified electro-chemical lithium-ion battery model applicable for in situ monitoring and online control

Yuxuan Gu, Jianxiao Wang, Yuanbo Chen, Wei Xiao, Zhongwei Deng, Qixin Chen

Summary: The rapid increase in the penetration of lithium-ion batteries (LIBs) in transport, energy, and communication systems has prompted the search for a meticulous but simplified LIB model for non-uniform internal state monitoring and online control. A simplified electro-chemical model for LIBs based on the pseudo-two-dimensional (P2D) model is proposed, which includes a rigorous model of non-uniform reaction rates inside the battery and sub-models that capture the non-uniformity of current densities, potentials, and concentrations. The proposed model shows significant improvements in speed, estimation accuracy, and correction speed and accuracy compared to existing models.

ENERGY (2023)

Article Automation & Control Systems

Enhancing Dispatchability of Lithium-Ion Battery Sources in Integrated Energy-Transportation Systems With Feasible Power Characterization

Yuxuan Gu, Yuanbo Chen, Jianxiao Wang, Wei Xiao, Qixin Chen

Summary: By considering internal states and using optimization algorithms and linearization methods, the dispatch of lithium-ion batteries can be optimized to increase energy conversion efficiency and reduce degradation and heat generation.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Engineering, Electrical & Electronic

A Data-Driven Pool Strategy for Price-Makers Under Imperfect Information

Kedi Zheng, Hongye Guo, Qixin Chen

Summary: This paper examines the pool strategy for price-makers when faced with imperfect information. Due to the lack of essential transmission parameters, market participants must estimate market outcomes based on historical information. The linear programming model of economic dispatch is analyzed using the rim multi-parametric linear programming theory. The characteristics of system patterns are revealed, and a support vector machine-based multi-class classification model is trained to map offer curves to system patterns. The proposed method is validated on three different power systems.

IEEE TRANSACTIONS ON POWER SYSTEMS (2023)

Article Engineering, Electrical & Electronic

Privacy-Preserving Probabilistic Voltage Forecasting in Local Energy Communities

Jean-Francois Toubeau, Fei Teng, Thomas Morstyn, Leandro Von Krannichfeldt, Yi Wang

Summary: This paper presents a new privacy-preserving framework for short-term probabilistic forecasting of nodal voltages in local energy communities. The framework utilizes federated learning to keep individuals' data decentralized and incorporates differential privacy to ensure sensitive local information cannot be inferred. The approach also employs cross-series learning to smoothly integrate new clients without data scarcity issues, achieving improved performance compared to non-collaborative models.

IEEE TRANSACTIONS ON SMART GRID (2023)

Article Engineering, Electrical & Electronic

Quantum Annealing With Integer Slack Variables for Grid Partitioning

Dawei Wang, Kedi Zheng, Fei Teng, Qixin Chen

Summary: This study proposes a solution framework based on quantum annealing to solve the grid partitioning problem. By using the integer slack and binary expansion methods, the problem is transformed into a quadratic unconstrained binary optimization problem, avoiding complex iteration processes and obtaining accurate feasible solutions in a short computation time.

IEEE TRANSACTIONS ON POWER SYSTEMS (2023)

Article Engineering, Electrical & Electronic

Detecting Load Transfers

Masoud Sobhani, Pu Wang, Tao Hong

Summary: Power distribution companies often face inaccurately logged load transfers, resulting in anomalies in load data at the distribution level. This paper proposes two methods, a model-free method and a model-based method, to detect load transfers between two meters. The methods aggregate meters with load transfers and use load profiles to screen for abnormal shapes. The evaluation using data from a U.S. utility company shows the effectiveness of both methods, with the model-based method detecting up to 81% of simulated load transfers with low false positives.

IEEE TRANSACTIONS ON SMART GRID (2023)

Article Computer Science, Information Systems

Distributed Optimization for Integrated Energy Systems With Secure Multiparty Computation

Fangyuan Si, Ning Zhang, Yi Wang, Peng-Yong Kong, Wenjie Qiao

Summary: This article introduces a method of using secure multiparty computation (SMPC) to enhance the security of integrated energy systems (IES) in distributed energy resource integration. By utilizing standardized modeling and privacy-preserving distributed optimization algorithm, this method can achieve optimization control of IES without disclosing sensitive information.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Computer Science, Information Systems

Unmanned Aerial Vehicle as Encryption Key Distributor for Secure Communications in Smart Grid

Peng-Yong Kong, Yi Wang

Summary: We use symmetric cryptography to secure communications with smart grid control devices. We propose using unmanned aerial vehicles (UAVs) as couriers to distribute secret keys generated at the control center. An optimization problem is formulated to find the lowest attack risk flight route for key distribution considering key deficiency and battery capacity. We propose an efficient algorithm that can find a low-risk flight route in less than a second, even for large power grid systems.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Energy & Fuels

Federated deep contrastive learning for mid-term natural gas demand forecasting

Dalin Qin, Guobing Liu, Zengxiang Li, Weicheng Guan, Shubao Zhao, Yi Wang

Summary: Accurate mid-term gas demand forecasting is crucial for gas companies and policymakers to meet increasing gas demand. However, data paucity and heterogeneous consumption patterns pose challenges. This paper proposes a novel method, FedCon-LCF, that integrates federated learning, deep contrastive learning, and clustering approaches to address these challenges. The method achieves high-performance forecasting by utilizing data from multiple gas companies and considering heterogeneous patterns. Evaluation on a dataset from 11 Chinese cities shows significant improvements over the benchmark LSTM model.

APPLIED ENERGY (2023)

Article Engineering, Electrical & Electronic

Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading

Dawei Qiu, Jianhong Wang, Zihang Dong, Yi Wang, Goran Strbac

Summary: With the increasing importance of advanced energy management schemes in multi-energy systems, incorporating these systems into the existing energy market is promising for future power systems. The continuous double auction (CDA) market is ideal for enabling peer-to-peer (P2P) energy trading due to its transparency and efficiency. However, modeling the CDA market is challenging due to stochastic and dynamic behaviors of participants. This study proposes a novel multi-agent reinforcement learning method to address these challenges and outperforms existing methods in terms of policy performance, scalability, and computational performance in P2P energy trading.

IEEE TRANSACTIONS ON POWER SYSTEMS (2023)

Article Engineering, Electrical & Electronic

Optimal Dispatch of Battery Energy Storage in Distribution Network Considering Electrothermal-Aging Coupling

Yinxiao Li, Yuxuan Gu, Guannan He, Qixin Chen

Summary: With the rapid development of distributed generation, battery energy storage systems (BESSs) are crucial in supporting the integration of renewable energy into distribution networks. This paper proposes an optimal dispatch model that considers the electrothermal-aging coupling relationship of BESSs. The proposed method effectively captures operational characteristics and optimizes the operational cost and aging cost, leading to an extension of lifetime and increase in profitability of BESSs.

IEEE TRANSACTIONS ON SMART GRID (2023)

Article Engineering, Electrical & Electronic

Provision of Contingency Frequency Services for Virtual Power Plants With Aggregated Models

Cheng Feng, Qixin Chen, Yi Wang, Peng-Yong Kong, Hongchao Gao, Songsong Chen

Summary: The growth of variable renewable generations will impact synchronous inertia and increase the need for contingency frequency support. Distributed energy resources (DERs) are able to provide this support through a virtual power plant (VPP). This study proposes the use of equivalent aggregation models for the VPP to participate in contingency reserve services. The models accurately restore the DER aggregation's ability to prevent system frequency from falling and are used to construct a performance-to-cost map for the VPP.

IEEE TRANSACTIONS ON SMART GRID (2023)

Article Engineering, Electrical & Electronic

Update Scheduling for ADMM-Based Energy Sharing in Virtual Power Plants Considering Massive Prosumer Access

Cheng Feng, Kedi Zheng, Yangze Zhou, Peter Palensky, Qixin Chen

Summary: This paper proposes an online partial-update algorithm based on the alternating direction method of multipliers (ADMM) to solve the communication congestion issue in energy sharing in the electricity market. By restricting update connections and designing a fair and efficient prosumer update scheduling policy, the algorithm can reduce negotiation waiting time and improve energy sharing effectiveness.

IEEE TRANSACTIONS ON SMART GRID (2023)

Article Computer Science, Information Systems

Personalized Ambient Pollution Estimation Based on Stationary-Camera-Taken Images Under Cross-Camera Information Sharing in Smart City

Shiguang Song, Victor O. K. Li, Jacqueline C. K. Lam, Yi Wang

Summary: Timely and high-density air quality monitoring is crucial for the development of smart cities. Image-based air pollution estimation using widely deployed stationary cameras and the Internet of Things (IoT) can provide real-time estimation of pollution levels. To overcome limitations of limited samples and scenes from individual cameras, a global and personalized method is proposed to improve the estimation model's generalization and preserve local characteristics. Evaluation results show that the personalized model outperforms the local model in reducing error and improving accuracy.

IEEE INTERNET OF THINGS JOURNAL (2023)

No Data Available