4.1 Article

A weak-constraint 4DEnsembleVar. Part II: experiments with larger models

Journal

Publisher

TAYLOR & FRANCIS LTD
DOI: 10.1080/16000870.2016.1271565

Keywords

data assimilation; hybrid methods; convective data assimilation

Funding

  1. Natural Environment Research Council [NE/I0051G6/1]
  2. NERC [NE/I0125484/1]
  3. NCEO
  4. European Research Council (ERC)
  5. NERC [nceo020004] Funding Source: UKRI
  6. Natural Environment Research Council [nceo020004, 1138322] Funding Source: researchfish

Ask authors/readers for more resources

In recent years, hybrid data-assimilation methods which avoid computation of tangent linear and adjoint models by using ensemble 4-dimensional cross-time covariances have become a popular topic in Numerical Weather Prediction. 4DEnsembleVar is one such method. In spite of its capabilities, its application can sometimes become problematic due to the not-trivial task of localising cross-time covariances. In this work we propose a formulation that helps to alleviate such issues by exploiting the presence of model error, i. e. a weak-constraint 4DEnsembleVar. We compare the weak-constraint 4DEnsembleVar to that of other data- assimilation methods. This is part II of a twopart paper. In part I, we describe the 4DEnsembleVar framework and problems with localised temporal crosscovariances associated with this method are discussed and illustrated on the Korteweg de Vries model. We also introduce our weak-constraint 4DEnsemble-Var formulation and show how it can alleviate-at least partially-the problem of having low-quality time cross-covariances. The second part of this paper deals with experiments on larger and more complicated models, namely the Lorenz 1996 model and a modified shallow-water model with simulated convection, both of them under the presence of model error. We investigate the performance of weak-constraint 4DEnsembleVar against strong-constraint 4DEnsembleVar (both with and without localisation) and other traditional methods (4DVar and the Local Ensemble Transform Kalman Smoother). Using the analysis root mean square error (RMSE) as a metric, these methods have been compared considering observation density (in time and space), observation period, ensemble sizes and assimilation window length. In this part we also explain how to perform outer loops in the EnVar methods. We show that their use can be counter-productive if the presence of model error is ignored by the assimilation method. We show that the addition of a weak-constraint generally improves the RMSE of 4DEnVar in cases where model error has time to develop, especially in cases with long assimilation windows and infrequent observations. We have assumed good knowledge of the statistics of this model error.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.1
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Meteorology & Atmospheric Sciences

On time-parallel preconditioning for the state formulation of incremental weak constraint 4D-Var

Ieva Dauzickaite, Amos S. Lawless, Jennifer A. Scott, Peter Jan van Leeuwen

Summary: This paper discusses the importance of parallel computing in data assimilation and proposes a new strategy using randomized singular value decomposition to accelerate calculations and maintain parallelism in the time domain.

QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY (2021)

Article Meteorology & Atmospheric Sciences

Multiplicative Non-Gaussian Model Error Estimation in Data Assimilation

S. Pathiraja, P. J. van Leeuwen

Summary: Model uncertainty quantification is crucial for effective data assimilation. This study presents a methodology for estimating the statistics of sub-grid scale processes using partial observations of the coarse scale process. The method involves minimizing the conditional sum of squared deviations to estimate model error realizations and obtaining a conditional probability distribution of additive model errors for non-Gaussian error structures.

JOURNAL OF ADVANCES IN MODELING EARTH SYSTEMS (2022)

Article Meteorology & Atmospheric Sciences

Dynamics and Predictability of Tropical Cyclone Rapid Intensification in Ensemble Simulations of Hurricane Patricia (2015)

Dandan Tao, Peter Jan van Leeuwen, Michael Bell, Yue Ying

Summary: Through the study of Hurricane Patricia, it was found that assimilating observational data significantly improves the prediction of rapid intensification. Analysis of observation impacts showed that deep-layer dropsonde observations have the greatest effect on the circulation of the entire troposphere. Verification of ensemble forecasts revealed that errors in the early vortex structure can lead to inaccuracies in later stage predictions.

JOURNAL OF GEOPHYSICAL RESEARCH-ATMOSPHERES (2022)

Article Oceanography

Rain-Induced Stratification of the Equatorial Indian Ocean and Its Potential Feedback to the Atmosphere

Kyle Shackelford, Charlotte A. DeMott, Peter Jan van Leeuwen, Elizabeth Thompson, Samson Hagos

Summary: The study explores the impact of precipitation on the ocean by investigating the formation and characteristics of rain layers (RLs) in the equatorial Indian Ocean. The findings suggest that RLs cool the ocean surface and enhance sea surface temperature (SST) gradients, which can promote atmospheric convection. This highlights the importance of further research on RL feedbacks to the atmosphere.

JOURNAL OF GEOPHYSICAL RESEARCH-OCEANS (2022)

Article Environmental Sciences

A Tempered Particle Filter to Enhance the Assimilation of SAR-Derived Flood Extent Maps Into Flood Forecasting Models

Concetta Di Mauro, Renaud Hostache, Patrick Matgen, Ramona Pelich, Marco Chini, Peter Jan van Leeuwen, Nancy Nichols, Gunter Bloeschl

Summary: The study proposes an innovative approach based on a tempered particle filter (TPF) to assimilate probabilistic flood maps derived from synthetic aperture radar data into a flood forecasting model, showing significant improvement in model forecasting accuracy with longer-lasting benefits.

WATER RESOURCES RESEARCH (2022)

Article Geosciences, Multidisciplinary

Near-Cloud Aerosol Retrieval Using Machine Learning Techniques, and Implied Direct Radiative Effects

C. Kevin Yang, J. Christine Chiu, Alexander Marshak, Graham Feingold, Tamas Varnai, Guoyong Wen, Takanobu Yamaguchi, Peter Jan van Leeuwen

Summary: A lack of satellite-based aerosol retrievals near low-topped clouds is addressed by developing a Convolutional Neural Network to retrieve aerosol optical depth (AOD) in cloud-free regions. The method takes into account cloud radiative effects on reflectance observations and achieves a horizontal resolution of 100-500 m. The retrieval uncertainty is 0.01 + 5%AOD, with a mean bias of approximately -2%. In satellite observations, aerosol hygroscopic growth near cloud edges leads to a 100% increase in AOD, resulting in a 55% overall increase in clear-sky aerosol direct radiative effect.

GEOPHYSICAL RESEARCH LETTERS (2022)

Article Mathematics, Interdisciplinary Applications

Bayesian inference for fluid dynamics: A case study for the stochastic rotating shallow water model

Oana Lang, Peter Jan van Leeuwen, Dan Crisan, Roland Potthast

Summary: In this work, a tempering-based adaptive particle filter is used to infer from a partially observed stochastic rotating shallow water (SRSW) model. The methodology validates the applicability of tempering and sample regeneration to high-dimensional models in geophysical fluid dynamics problems. The efficiency of the particle filter is studied in the SRSW model configuration simulating the atmospheric Jetstream.

FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS (2022)

Article Meteorology & Atmospheric Sciences

Supervised machine learning to estimate instabilities in chaotic systems: Estimation of local Lyapunov exponents

Daniel Ayers, Jack Lau, Javier Amezcua, Alberto Carrassi, Varun Ojha

Summary: Prediction errors grow faster in some situations than in others in chaotic dynamical systems. Real-time knowledge about error growth can enable strategies to adjust modelling and forecasting infrastructure to increase accuracy and reduce computation time. In this feasibility study, supervised machine learning is used to estimate local Lyapunov exponents in place of the classical method. The machine learning algorithms accurately predict stable and unstable local Lyapunov exponents, but only somewhat accurately predict neutral exponents.

QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY (2023)

Article Geography, Physical

The effects of assimilating a sub-grid-scale sea ice thickness distribution in a new Arctic sea ice data assimilation system

Nicholas Williams, Nicholas Byrne, Daniel Feltham, Peter Jan Van Leeuwen, Ross Bannister, David Schroeder, Andrew Ridout, Lars Nerger

Summary: In the past decade, groundbreaking satellite observations have provided a better understanding of the Arctic sea ice system. This study presents the first results of a new sea ice data assimilation system that combines various observations to estimate sea ice thickness and improve modeled ice distribution. Assimilating sub-grid-scale thickness distribution has a significant impact on the performance of the sea ice model.

CRYOSPHERE (2023)

Article Meteorology & Atmospheric Sciences

Using the (Iterative) Ensemble Kalman Smoother to Estimate the Time Correlation in Model Error

Javier Amezcua, Haonan Ren, Peter Jan Van Leeuwen

Summary: Numerical weather prediction systems have model errors due to missing and simplified physical processes, as well as limited model resolution. Estimating model error parameters is a challenging problem, even in low-dimensional systems. By focusing on linear and nonlinear low-dimensional systems and using state augmentation in ensemble Kalman smoothers, we can find practical solutions to this problem.

TELLUS SERIES A-DYNAMIC METEOROLOGY AND OCEANOGRAPHY (2023)

Article Geosciences, Multidisciplinary

Hybrid ensemble-variational data assimilation in ABC-DA within a tropical framework

Joshua Chun Kwang Lee, Javier Amezcua, Ross Noel Bannister

Summary: Hybrid ensemble-variational data assimilation methods are widely used in the mid-latitudinal context, but their benefits in the tropical context have been less explored. This study introduces and improves the hybrid ensemble-variational DA method in a tropical configuration of a simplified fluid dynamics model. The algorithm includes localization and weighting parameters, and an ensemble system is designed to generate ensemble perturbations. Sensitivity tests using observing system simulation experiments show that the hybrid method performs well with certain weighting configurations.

GEOSCIENTIFIC MODEL DEVELOPMENT (2022)

Article Geosciences, Multidisciplinary

Ensemble Riemannian data assimilation: towards large-scale dynamical systems

Sagar K. Tamang, Ardeshir Ebtehaj, Peter Jan van Leeuwen, Gilad Lerman, Efi Foufoula-Georgiou

Summary: This paper presents the results of ensemble Riemannian data assimilation for relatively high-dimensional nonlinear dynamical systems, focusing on the Lorenz-96 model and the quasi-geostrophic model. The method infers the analysis state from a joint distribution, which effectively handles systematic biases. Comparisons with classic implementations of particle filter and stochastic ensemble Kalman filter show that this method can improve the predictability of dynamical systems with the same ensemble size.

NONLINEAR PROCESSES IN GEOPHYSICS (2022)

Article Physics, Multidisciplinary

Using mutual information to measure time lags from nonlinear processes in astronomy

Nachiketa Chakraborty, Peter Jan van Leeuwen

Summary: Measuring time lags between light curves at different wavelengths is crucial for studying multiwavelength variability in astronomy. Using a discrete mutual information function (DMIF) can accurately identify lag components and reveal lag features in nonlinear relationships.

PHYSICAL REVIEW RESEARCH (2022)

Article Geosciences, Multidisciplinary

Ensemble Riemannian data assimilation over the Wasserstein space

Sagar K. Tamang, Ardeshir Ebtehaj, Peter J. van Leeuwen, Dongmian Zou, Gilad Lerman

Summary: In this paper, a novel ensemble data assimilation paradigm is introduced on a Riemannian manifold equipped with the Wasserstein metric, which can capture differences in probability distribution shapes and penalize non-Gaussian geophysical biases in state space. The new approach is applied to dissipative and chaotic evolutionary dynamics, highlighting potential advantages and limitations compared to classic ensemble data assimilation methods under systematic errors.

NONLINEAR PROCESSES IN GEOPHYSICS (2021)

No Data Available