4.6 Article

Probabilistic solar forecasting: Benchmarks, post-processing, verification

Journal

SOLAR ENERGY
Volume 252, Issue -, Pages 72-80

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.solener.2022.12.054

Keywords

Clear-sky index; Empirical copula; Isotonic distributional regression; Neural network; Reliability diagram; Post-processing

Categories

Ask authors/readers for more resources

Probabilistic solar forecasts can take the form of predictive probability distributions, ensembles, quantiles, or interval forecasts. The state-of-the-art approaches utilize input from numerical weather prediction models and apply statistical and machine learning methods for post-processing. This study proposes a probabilistic benchmark based on deterministic forecast and introduces new methods that merge statistical techniques with modern neural networks for post-processing.
Probabilistic solar forecasts may take the form of predictive probability distributions, ensembles, quantiles, or interval forecasts. State-of-the-art approaches build on input from numerical weather prediction (NWP) models and post-processing with statistical and machine learning methods. We propose a probabilistic benchmark based on a deterministic forecast of clear-sky irradiance, introduce new methods for post-processing that merge statistical techniques with modern neural networks, discuss methods for spatio-temporal scenario forecasts, and illustrate the assessment of predictive ability via proper scoring rules and calibration checks. We expect future solar forecasting efforts to be increasingly probabilistic, and encourage continuing close interaction with operational weather prediction, where innovations based on sophisticated neural networks supplement and challenge traditional approaches.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Receiver operating characteristic (ROC) movies, universal ROC (UROC) curves, and coefficient of predictive ability (CPA)

Tilmann Gneiting, Eva-Maria Walz

Summary: ROC curves are powerful tools for assessing predictive abilities, but are limited to binary outcomes. The introduction of ROC movies and universal ROC curves extends this to linearly ordered outcomes, with an associated coefficient of predictive ability (CPA) that has appealing interpretations.

MACHINE LEARNING (2022)

Article Computer Science, Artificial Intelligence

Receiver operating characteristic (ROC) curves: equivalences, beta model, and minimum distance estimation

Tilmann Gneiting, Peter Vogel

Summary: ROC curves are commonly used to evaluate predictors in binary problems, and can be characterized from a probabilistic perspective with an equivalence to CDFs. The flexible beta family fits empirical ROC curves better than the classical binormal model, especially when the fitted curve is concave. This suggests a paradigm shift in modeling ROC curves towards curve fitting.

MACHINE LEARNING (2022)

Article Meteorology & Atmospheric Sciences

Machine Learning Methods for Postprocessing Ensemble Forecasts of Wind Gusts: A Systematic Comparison

Benedikt Schulz, Sebastian Lerch

Summary: This study provides a comprehensive review and systematic comparison of eight statistical and machine learning methods for ensemble postprocessing of wind gust forecasts. The results show that incorporating additional meteorological predictor variables beyond wind gusts leads to significant improvements in forecast skill. A flexible framework of locally adaptive neural networks is proposed, which outperforms all benchmark postprocessing methods and learns physically consistent relations associated with the diurnal cycle and the evening transition of the planetary boundary layer.

MONTHLY WEATHER REVIEW (2022)

Article Multidisciplinary Sciences

Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the United States

Estee Y. Cramer, Evan L. Ray, Velma K. Lopez, Johannes Bracher, Andrea Brennen, Alvaro J. Castro Rivadeneira, Aaron Gerding, Tilmann Gneiting, Katie H. House, Yuxin Huang, Dasuni Jayawardena, Abdul H. Kanji, Ayush Khandelwal, Khoa Le, Anja Muhlemann, Jarad Niemi, Apurv Shah, Ariane Stark, Yijin Wang, Nutcha Wattanachit, Martha W. Zorn, Youyang Gu, Sansiddh Jain, Nayana Bannur, Ayush Deva, Mihir Kulkarni, Srujana Merugu, Alpan Raval, Siddhant Shingi, Avtansh Tiwari, Jerome White, Neil F. Abernethy, Spencer Woody, Maytal Dahan, Spencer Fox, Kelly Gaither, Michael Lachmann, Lauren Ancel Meyers, James G. Scott, Mauricio Tec, Ajitesh Srivastava, Glover E. George, Jeffrey C. Cegan, Ian D. Dettwiller, William P. England, Matthew W. Farthing, Robert H. Hunter, Brandon Lafferty, Igor Linkov, Michael L. Mayo, Matthew D. Parno, Michael A. Rowland, Benjamin D. Trump, Yanli Zhang-James, Samuel Chen, Stephen Faraone, Jonathan Hess, Christopher P. Morley, Asif Salekin, Dongliang Wang, Sabrina M. Corsetti, Thomas M. Baer, Marisa C. Eisenberg, Karl Falb, Yitao Huang, Emily T. Martin, Ella McCauley, Robert L. Myers, Tom Schwarz, Daniel Sheldon, Graham Casey Gibson, Rose Yu, Liyao Gao, Yian Ma, Dongxia Wu, Xifeng Yan, Xiaoyong Jin, Yu-Xiang Wang, YangQuan Chen, Lihong Guo, Yanting Zhao, Quanquan Gu, Jinghui Chen, Lingxiao Wang, Pan Xu, Weitong Zhang, Difan Zou, Hannah Biegel, Joceline Lega, Steve McConnell, V. P. Nagraj, Stephanie L. Guertin, Christopher Hulme-Lowe, Stephen D. Turner, Yunfeng Shi, Xuegang Ban, Robert Walraven, Qi-Jun Hong, Stanley Kong, Axel van de Walle, James A. Turtle, Michal Ben-Nun, Steven Riley, Pete Riley, Ugur Koyluoglu, David DesRoches, Pedro Forli, Bruce Hamory, Christina Kyriakides, Helen Leis, John Milliken, Michael Moloney, James Morgan, Ninad Nirgudkar, Gokce Ozcan, Noah Piwonka, Matt Ravi, Chris Schrader, Elizabeth Shakhnovich, Daniel Siegel, Ryan Spatz, Chris Stiefeling, Barrie Wilkinson, Alexander Wong, Sean Cavany, Guido Espana, Sean Moore, Rachel Oidtman, Alex Perkins, David Kraus, Andrea Kraus, Zhifeng Gao, Jiang Bian, Wei Cao, Juan Lavista Ferres, Chaozhuo Li, Tie-Yan Liu, Xing Xie, Shun Zhang, Shun Zheng, Alessandro Vespignani, Matteo Chinazzi, Jessica T. Davis, Kunpeng Mu, Ana Pastore Y. Piontti, Xinyue Xiong, Andrew Zheng, Jackie Baek, Vivek Farias, Andreea Georgescu, Retsef Levi, Deeksha Sinha, Joshua Wilde, Georgia Perakis, Mohammed Amine Bennouna, David Nze-Ndong, Divya Singhvi, Ioannis Spantidakis, Leann Thayaparan, Asterios Tsiourvas, Arnab Sarker, Ali Jadbabaie, Devavrat Shah, Nicolas Della Penna, Leo A. Celi, Saketh Sundar, Russ Wolfinger, Dave Osthus, Lauren Castro, Geoffrey Fairchild, Isaac Michaud, Dean Karlen, Matt Kinsey, Luke C. Mullany, Kaitlin Rainwater-Lovett, Lauren Shin, Katharine Tallaksen, Shelby Wilson, Elizabeth C. Lee, Juan Dent, Kyra H. Grantz, Alison L. Hill, Joshua Kaminsky, Kathryn Kaminsky, Lindsay T. Keegan, Stephen A. Lauer, Joseph C. Lemaitre, Justin Lessler, Hannah R. Meredith, Javier Perez-Saez, Sam Shah, Claire P. Smith, Shaun A. Truelove, Josh Wills, Maximilian Marshall, Lauren Gardner, Kristen Nixon, John C. Burant, Lily Wang, Lei Gao, Zhiling Gu, Myungjin Kim, Xinyi Li, Guannan Wang, Yueying Wang, Shan Yu, Robert C. Reiner, Ryan Barber, Emmanuela Gakidou, Simon Hay, Steve Lim, Chris Murray, David Pigott, Heidi L. Gurung, Prasith Baccam, Steven A. Stage, Bradley T. Suchoski, B. Aditya Prakash, Bijaya Adhikari, Jiaming Cui, Alexander Rodriguez, Anika Tabassum, Jiajia Xie, Pinar Keskinocak, John Asplund, Arden Baxter, Buse Eylul Oruc, Nicoleta Serban, Sercan O. Arik, Mike Dusenberry, Arkady Epshteyn, Elli Kanal, Long T. Le, Chun-Liang Li, Tomas Pfister, Dario Sava, Rajarishi Sinha, Thomas Tsai, Nate Yoder, Jinsung Yoon, Leyou Zhang, Sam Abbott, Nikos Bosse, Sebastian Funk, Joel Hellewell, Sophie R. Meakin, Katharine Sherratt, Mingyuan Zhou, Rahi Kalantari, Teresa K. Yamana, Sen Pei, Jeffrey Shaman, Michael L. Li, Dimitris Bertsimas, Omar Skali Lami, Saksham Soni, Hamza Tazi Bouardi, Turgay Ayer, Madeline Adee, Jagpreet Chhatwal, Ozden O. Dalgic, Mary A. Ladd, Benjamin P. Linas, Peter Mueller, Jade Xiao, Yuanjia Wang, Qinxia Wang, Shanghong Xie, Donglin Zeng, Alden Green, Jacob Bien, Logan Brooks, Addison J. Hu, Maria Jahja, Daniel McDonald, Balasubramanian Narasimhan, Collin Politsch, Samyak Rajanala, Aaron Rumack, Noah Simon, Ryan J. Tibshirani, Rob Tibshirani, Valerie Ventura, Larry Wasserman, Eamon B. O'Dea, John M. Drake, Robert Pagano, Quoc T. Tran, Lam Si Tung Ho, Huong Huynh, Jo W. Walker, Rachel B. Slayton, Michael A. Johansson, Matthew Biggerstaff, Nicholas G. Reich

Summary: Short-term probabilistic forecasts of the COVID-19 pandemic in the United States have been crucial in communication between scientists and the public and decision-makers. The US COVID-19 Forecast Hub collected millions of predictions from various academic, industry, and independent research groups, providing accurate forecasts for short-term decision-making. Collaboration between government agencies, academic modeling teams, and industry partners plays a significant role in developing modeling capabilities to support outbreak response at different levels.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2022)

Article Energy & Fuels

Evaluating ensemble post-processing for wind power forecasts

Kaleb Phipps, Sebastian Lerch, Maria Andersson, Ralf Mikut, Veit Hagenmeyer, Nicole Ludwig

Summary: This paper examines multiple strategies for applying ensemble post-processing to probabilistic wind power forecasts and finds that post-processing the final wind power ensemble improves forecast performance, while only post-processing the weather ensembles does not necessarily lead to increased forecast performance.

WIND ENERGY (2022)

Correction Biochemical Research Methods

Evaluating epidemic forecasts in an interval format (vol 17, e1008618, 2021)

Johannes Bracher, Evan L. Ray, Tilmann Gneiting, Nicholas G. Reich

PLOS COMPUTATIONAL BIOLOGY (2022)

Article Mathematics, Interdisciplinary Applications

Model Diagnostics and Forecast Evaluation for Quantiles

Tilmann Gneiting, Daniel Wolffram, Johannes Resin, Kristof Kraus, Johannes Bracher, Timo Dimitriadis, Veit Hagenmeyer, Alexander Jordan, Sebastian Lerch, Kaleb Phipps, Melanie Schienle

Summary: Model diagnostics and forecast evaluation are closely related tasks. This study reviews the use of quantiles or quantile-bounded prediction intervals for forecasts. The distinction between unconditional and conditional calibration is explained, along with the use of consistent scoring functions for assessment and ranking. Various examples are provided to illustrate the application of these tools.

ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION (2023)

Article Meteorology & Atmospheric Sciences

Comparison of multivariate post-processing methods using global ECMWF ensemble forecasts

Maria Lakatos, Sebastian Lerch, Stephan Hemri, Sandor Baran

Summary: Ensemble forecasts are an important step in weather forecasting as they account for uncertainties in future atmospheric conditions. However, they often lack accuracy and require post-processing. Multivariate post-processing aims to capture spatial and temporal correlations among different dimensions to improve forecast accuracy. In this study, different non-parametric multivariate approaches are compared, and results show that multivariate post-processing significantly enhances forecast skill compared to raw and independently calibrated forecasts.

QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY (2023)

Article Statistics & Probability

Comparative evaluation of point process forecasts

Jonas R. Brehmer, Tilmann Gneiting, Marcus Herrmann, Warner Marzocchi, Martin Schlather, Kirstin Strokorb

Summary: Stochastic models of point patterns in space and time are widely used for forecasts and risk assessment, often impacting important societal decisions. This study introduces consistent scoring functions and proper scoring rules to evaluate the predictive performance of point process models, demonstrating their broader applicability than previously thought. The Poisson log-likelihood is found to be a theoretically principled method for comparative forecast evaluation in terms of cell expectations, as shown in earthquake likelihood model testing.

ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS (2023)

Article Meteorology & Atmospheric Sciences

Sources of predictability of synoptic-scale rainfall during the West African summer monsoon

Athul Rasheeda Satheesh, Peter Knippertz, Andreas H. Fink, Eva-Maria Walz, Tilmann Gneiting

Summary: Numerical-model-based precipitation forecasts have low accuracy in northern tropical Africa compared to climatology-based forecasts and other tropical regions. However, purely data-driven forecasts based on satellite rainfall estimates show promise for predicting precipitation occurrence in this region.

QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY (2023)

Article Medicine, Research & Experimental

National and subnational short-term forecasting of COVID-19 in Germany and Poland during early 2021

Johannes Bracher, Daniel Wolffram, Jannik Deuschel, Konstantin Goergen, Jakob L. Ketterer, Alexander Ullrich, Sam Abbott, Maria V. Barbarossa, Dimitris Bertsimas, Sangeeta Bhatia, Marcin Bodych, Nikos I. Bosse, Jan Pablo Burgard, Lauren Castro, Geoffrey Fairchild, Jochen Fiedler, Jan Fuhrmann, Sebastian Funk, Anna Gambin, Krzysztof Gogolewski, Stefan Heyder, Thomas Hotz, Yuri Kheifetz, Holger Kirsten, Tyll Krueger, Ekaterina Krymova, Neele Leithaeser, Michael L. Li, Jan H. Meinke, Blazej Miasojedow, Isaac J. Michaud, Jan Mohring, Pierre Nouvellet, Jedrzej M. Nowosielski, Tomasz Ozanski, Maciej Radwan, Franciszek Rakowski, Markus Scholz, Saksham Soni, Ajitesh Srivastava, Tilmann Gneiting, Melanie Schienle

Summary: This study evaluates the real-time probabilistic predictions of COVID-19 confirmed cases and deaths in Germany and Poland from January to April 2021. The results show that many models outperform a simple baseline model for the considered targets, and ensemble methods demonstrate good relative performance. However, predicting major trend changes, such as the rebound in cases due to the B.1.1.7 (Alpha) variant, remains challenging. Multi-model approaches and additional data sources, such as sequencing and mobility data, may help improve the performance of epidemiological forecasts.

COMMUNICATIONS MEDICINE (2022)

Article Geosciences, Multidisciplinary

Improving the prediction of the Madden-Julian Oscillation of the ECMWF model by post-processing

Riccardo Silini, Sebastian Lerch, Nikolaos Mastrantonas, Holger Kantz, Marcelo Barreiro, Cristina Masoller

Summary: This study uses multiple linear regression and a machine learning algorithm to improve the forecast of the European Centre for Medium-Range Weather Forecasts model for the Madden-Julian Oscillation (MJO). The results show that both methods improve the MJO prediction, with machine learning outperforming linear regression. The biggest improvement is seen in the prediction of the MJO geographical location and intensity.

EARTH SYSTEM DYNAMICS (2022)

Article Energy & Fuels

Machine learning-aided discovery of bismuth-based transition metal oxide double perovskites for solar cell applications

Siddharth Sradhasagar, Omkar Subhasish Khuntia, Srikanta Biswal, Sougat Purohit, Amritendu Roy

Summary: In this study, machine learning models were developed to predict the bandgap and its character of double perovskite materials, with LGBMRegressor and XGBClassifier models identified as the best predictors. These models were further employed to predict the bandgap of novel bismuth-based transition metal oxide double perovskites, showing high accuracy, especially in the range of 1.2-1.8 eV.

SOLAR ENERGY (2024)

Article Energy & Fuels

Multi-objective optimizations of solar receiver based on deep learning strategy in different application scenarios

Wei Shuai, Haoran Xu, Baoyang Luo, Yihui Huang, Dong Chen, Peiwang Zhu, Gang Xiao

Summary: In this study, a hybrid model based on numerical simulation and deep learning is proposed for the optimization and operation of solar receivers. By applying the model to different application scenarios and considering multiple performance objectives, small errors are achieved and optimal structure parameters and heliostat scales are identified. This approach is not only applicable to gas turbines but also heating systems.

SOLAR ENERGY (2024)

Article Energy & Fuels

An accurate prediction of electronic structure, mechanical stability and optical response of BaCuF3 fluoroperovskite for solar cell application

Mubashar Ali, Zunaira Bibi, M. W. Younis, Muhammad Mubashir, Muqaddas Iqbal, Muhammad Usman Ali, Muhammad Asif Iqbal

Summary: This study investigates the structural, mechanical, and optoelectronic properties of the BaCuF3 fluoroperovskite using the first-principles modelling approach. The stability and characteristics of different cubic structures of BaCuF3 are evaluated, and the alpha-BaCuF3 and beta-BaCuF3 compounds are found to be mechanically stable with favorable optical properties for solar cells and high-frequency UV applications.

SOLAR ENERGY (2024)

Article Energy & Fuels

Efficient laboratory perovskite solar cell recycling with a one-step chemical treatment and recovery of ITO-coated glass substrates

Dong Le Khac, Shahariar Chowdhury, Asmaa Soheil Najm, Montri Luengchavanon, Araa mebdir Holi, Mohammad Shah Jamal, Chin Hua Chia, Kuaanan Techato, Vidhya Selvanathan

Summary: A novel recycling system is proposed in this study to decompose and reclaim the constituent materials of organic-inorganic perovskite solar cells (PSCs). By utilizing a one-step solution process extraction approach, the chemical composition of each layer is successfully preserved, enabling their potential reuse. The proposed recycling technique helps mitigate pollution risks, minimize waste generation, and reduce recycling costs.

SOLAR ENERGY (2024)

Article Energy & Fuels

A compound fault diagnosis model for photovoltaic array based on 1D VoVNet-SVDD by considering unknown faults

Peijie Lin, Feng Guo, Xiaoyang Lu, Qianying Zheng, Shuying Cheng, Yaohai Lin, Zhicong Chen, Lijun Wu, Zhuang Qian

Summary: This paper proposes an open-set fault diagnosis model for PV arrays based on 1D VoVNet-SVDD. The model accurately diagnoses various types of faults and is capable of identifying unknown fault types.

SOLAR ENERGY (2024)