4.7 Article

On the difficulty to optimally implement the Ensemble Kalman filter: An experiment based on many hydrological models and catchments

Journal

JOURNAL OF HYDROLOGY
Volume 529, Issue -, Pages 1147-1160

Publisher

ELSEVIER
DOI: 10.1016/j.jhydrol.2015.09.036

Keywords

Data assimilation; Uncertainty estimation; Ensemble Kalman filter

Funding

  1. Chaire de recherche EDS en previsions et actions hydrologiques
  2. Natural Sciences and Engineering Research Council of Canada

Ask authors/readers for more resources

Forecast reliability and accuracy is a prerequisite for successful hydrological applications. This aim may be attained by using data assimilation techniques such as the popular Ensemble Kalman filter (EnKF). Despite its recognized capacity to enhance forecasting by creating a new set of initial conditions, implementation tests have been mostly carried out with a single model and few catchments leading to case specific conclusions. This paper performs an extensive testing to assess ensemble bias and reliability on 20 conceptual lumped models and 38 catchments in the Province of Quebec with perfect meteorological forecast forcing. The study confirms that EnKF is a powerful tool for short range forecasting but also that it requires a more subtle setting than it is frequently recommended. The success of the updating procedure depends to a great extent on the specification of the hyper-parameters. In the implementation of the EnKF, the identification of the hyper-parameters is very unintuitive if the model error is not explicitly accounted for and best estimates of forcing and observation error lead to overconfident forecasts. It is shown that performance are also related to the choice of updated state variables and that all states variables should not systematically be updated. Additionally, the improvement over the open loop scheme depends on the watershed and hydrological model structure, as some models exhibit a poor compatibility with EnKF updating. Thus, it is not possible to conclude in detail on a single ideal manner to identify an optimal implementation; conclusions drawn from a unique event, catchment, or model are likely to be misleading since transferring hyper-parameters from a case to another may be hazardous. Finally, achieving reliability and bias jointly is a daunting challenge as the optimization of one score is done at the cost of the other. (C) 2015 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Water Resources

Evaporation from boreal reservoirs: A comparison between eddy covariance observations and estimates relying on limited data

Judith Fournier, Antoine Thiboult, Daniel F. Nadeau, Nikki Vercauteren, Francois Anctil, Annie-Claude Parent, Ian B. Strachan, Alain Tremblay

Summary: This study utilized long-term eddy covariance observations to estimate evaporation in two northern hydropower reservoirs using different methods, with the bulk transfer equation showing the highest accuracy. Accuracy in estimating open water evaporation requires representative measurements of wind speed and water surface temperature.

HYDROLOGICAL PROCESSES (2021)

Article Soil Science

Using bias correction and ensemble modelling for predictive mapping and related uncertainty: A case study in digital soil mapping

Jean-Daniel Sylvain, Francois Anctil, Evelyne Thiffault

Summary: The study combines bias correction and ensemble modeling to improve the accuracy of digital soil mapping, reduce conditional bias, and provide uncertainty assessment. The performance of ensemble modeling surpasses individual models and underdispersion in uncertainty analysis is identified. Global mapping products show low performance and important conditional bias compared to the proposed approach.

GEODERMA (2021)

Article Engineering, Civil

Uncertainty propagation within a water level ensemble prediction system

Mohammed Amine Bessar, Francois Anctil, Pascal Matte

Summary: The reliability and accuracy of the hydrometeorological ensemble prediction system coupled with a hydraulic module were evaluated in this study, showing that the proposed system provides reliable ensemble flow and water level forecasts across different forecast horizons.

JOURNAL OF HYDROLOGY (2021)

Article Engineering, Civil

Evolution of Arctic rivers recession flow: Global assessment and data-based attribution analysis

Flore Sergeant, Rene Therrien, Ludovic Oudin, Anne Jost, Francois Anctil

Summary: The study found that during the period from 1970 to 2000, there was a significant decrease in recession slope and initial recession outflow in most Arctic catchments, contrary to previous research. High topography and low permafrost extent were identified as controlling factors that complicated the relationship between recession parameters and active layer thickness evolution.

JOURNAL OF HYDROLOGY (2021)

Article Meteorology & Atmospheric Sciences

The Effect of Soil on the Summertime Surface Energy Budget of a Humid Subarctic Tundra in Northern Quebec, Canada

Georg Lackner, Daniel F. Nadeau, Florent Domine, Annie-Claude Parent, Gonzalo Leonardini, Aaron Boone, Francois Anctil, Vincent Fortin

Summary: This study examines the surface energy budget of a subarctic shrub tundra site in eastern Canada, finding that turbulent heat fluxes in this region are more complex compared to other Arctic sites, mainly influenced by the soil moisture properties.

JOURNAL OF HYDROMETEOROLOGY (2021)

Article Environmental Sciences

Assessment of the Potential Hydrological Impacts of Climate Change in Quebec-Canada, a Refined Neutral Approach

Marinela del Carmen Valencia Giraldo, Simon Ricard, Francois Anctil

Summary: There is ongoing debate about whether probabilistic (top-down) or possibilistic (bottom-up) approaches are more suitable for estimating potential future climate impacts. In the context of deep uncertainty, bottom-up approaches that assess the sensitivity and vulnerability of systems to climate changes have become more popular. This study proposes a refined framework that combines the scenario-neutral method of the bottom-up approach with elements of the top-down approach. The results reveal regional and differential behaviors of hydroclimatology and low flows under different climate scenarios.

WATER (2023)

Article Water Resources

Characteristic time scales of evaporation from a subarctic reservoir

Adrien Pierre, Daniel F. Nadeau, Antoine Thiboult, Alain N. Rousseau, Alain Tremblay, Pierre-Erik Isabelle, Francois Anctil

Summary: Water bodies such as lakes and reservoirs influence the regional climate through the evaporation of water. This study analyzed in-situ observations of a reservoir in a subarctic environment to understand its impact. The results showed that the annual evaporation rate was 590 +/- 66 mm, accounting for approximately 51% of the annual precipitation. The study also revealed the opposite diurnal cycles of sensible and latent heat fluxes during the open water period.

HYDROLOGICAL PROCESSES (2023)

Article Engineering, Civil

Hydropower System Operation and the Quality of Short-Term Hydrologic Ensemble Forecasts

Michael Osina Torres, Amaury Tilmant, Emixi Valdez Medina, Francois Anctil, Maria-Helena Ramos

Summary: Improving the operational effectiveness of hydropower systems is crucial due to the shift to renewable energy sources and increasing costs associated with new hydro facilities. This study focuses on the relationship between short-term streamflow forecasts and hydropower generation, as well as the impact of uncertainties on energy output. A numerical experiment using hydrologic ensemble forecasts and reservoir optimization models was conducted in Canada. The results show that forecast quality affects energy production, but it is not a one-to-one causal relationship. Additionally, the diversity of hydrological models contributes to energy production, suggesting the value of model structure diversity.

JOURNAL OF WATER RESOURCES PLANNING AND MANAGEMENT (2023)

Article Engineering, Civil

Simulating the recession dynamics of Arctic catchments in the context of a thawing permafrost

F. Sergeant, R. Therrien, F. Anctil, Laura Gatel

Summary: In cold regions, climate warming causes permafrost thaw and changes the groundwater flow dynamics from local to regional systems. The recession slope of arctic catchment hydrograph is linearly related to permafrost thawing depth, making recession analysis a valuable method to study permafrost thawing dynamics in areas with limited permafrost observations. However, the linear relationship is influenced by permafrost extent, landscape topography, and aquifer properties.

JOURNAL OF HYDROLOGY (2023)

Article Geosciences, Multidisciplinary

Following up on flood adaptation in Quebec households four years later: A prospective exploratory study

Pierre Valois, Francois Anctil, Genevieve Cloutier, Maxime Tessier, Naomie Herpin-Saunier

Summary: The frequency and severity of flooding events are expected to increase with climate change in Quebec. A longitudinal study conducted in the province examined the adaptive behaviors of residents in high flood risk zones, finding that there has been no significant increase in adaptive behavior between 2015 and 2019. However, households that have experienced a flood or flood alert in the past are more likely to adapt. The study also identified income, flood experience, and perception of living in a flood-prone zone as important predictors of behavior adoption rates.

INTERNATIONAL JOURNAL OF DISASTER RISK REDUCTION (2023)

Article Geosciences, Multidisciplinary

Producing reliable hydrologic scenarios from raw climate model outputswithout resorting to meteorological observations

Simon Ricard, Philippe Lucas-Picher, Antoine Thiboult, Francois Anctil

Summary: A simplified hydroclimatic modelling workflow is proposed to quantify the impact of climate change on water discharge without resorting to meteorological observations. The method combines asynchronous hydroclimatic modelling and quantile perturbation applied to streamflow observations. The results show that the proposed workflow produces useful and reliable hydrologic scenarios, which can predict seasonal mean flows similar to a conventional hydroclimatic modelling approach.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2023)

Article Geosciences, Multidisciplinary

Exploring hydrologic post-processing of ensemble streamflow forecasts based on affine kernel dressing and non-dominated sorting genetic algorithm II

Jing Xu, Francois Anctil, Marie-Amelie Boucher

Summary: Forecast uncertainties are inevitable in deterministic analysis of dynamical systems. Ensemble forecasting is an effective tool to represent error growth and capture uncertainties. This study compares the performance of evolutionary multi-objective optimization with a conventional state-of-the-art post-processor in eliminating forecast biases and maintaining proper dispersion. The evolutionary multi-objective optimization method demonstrated superiority in communicating with end-users for performance improvement.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2022)

Article Geosciences, Multidisciplinary

Choosing between post-processing precipitation forecasts or chaining several uncertainty quantification tools in hydrological forecasting systems

Emixi Sthefany Valdez, Francois Anctil, Maria-Helena Ramos

Summary: This study investigates the interactions between a precipitation post-processor and other uncertainty quantification tools in a hydrometeorological forecasting chain. The results show that the post-processor significantly improves the quality of precipitation forecasts, but its effectiveness in improving hydrological forecasts depends on various factors such as the configuration of the forecasting system, forecast attribute, lead time, and catchment size. Therefore, the combined effect of the precipitation post-processor and other uncertainty quantification methods should be considered when designing or enhancing hydrometeorological ensemble forecasting systems.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2022)

Article Geography, Physical

On the energy budget of a low-Arctic snowpack

Georg Lackner, Florent Domine, Daniel F. Nadeau, Annie-Claude Parent, Francois Anctil, Matthieu Lafaysse, Marie Dumont

Summary: Arctic landscapes are covered in snow for at least 6 months a year, and the energy balance of the snow cover plays a key role in influencing various factors. The study aimed to quantify major heat fluxes above, within, and below a low-Arctic snowpack. Results showed that radiative losses are counterbalanced by sensible heat flux, with minimal latent heat flux. The model reproduced the observed energy balance well, but had deficiencies in simulating turbulent heat fluxes at an hourly timescale due to atmospheric stratification effects.

CRYOSPHERE (2022)

Article Engineering, Civil

Reconstructing high-resolution groundwater level data using a hybrid random forest model to quantify distributed groundwater changes in the Indus Basin

Arfan Arshad, Ali Mirchi, Javier Vilcaez, Muhammad Umar Akbar, Kaveh Madani

Summary: High-resolution, continuous groundwater data is crucial for adaptive aquifer management. This study presents a predictive modeling framework that incorporates covariates and existing observations to estimate groundwater level changes. The framework outperforms other methods and provides reliable estimates for unmonitored sites. The study also examines groundwater level changes in different regions and highlights the importance of effective aquifer management.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Hydrological modelling of large-scale karst-dominated basin using a grid-based distributed karst hydrological model

Lihua Chen, Jie Deng, Wenzhe Yang, Hang Chen

Summary: A new grid-based distributed karst hydrological model (GDKHM) is developed to simulate streamflow in the flood-prone karst area of Southwest China. The results show that the GDKHM performs well in predicting floods and capturing the spatial variability of karst system.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Using a physics-based hydrological model and storm transposition to investigate machine-learning algorithms for streamflow prediction

Faruk Gurbuz, Avinash Mudireddy, Ricardo Mantilla, Shaoping Xiao

Summary: Machine learning algorithms have shown better performance in streamflow prediction compared to traditional hydrological models. In this study, researchers proposed a methodology to test and benchmark ML algorithms using artificial data generated by physically-based hydrological models. They found that deep learning algorithms can correctly identify the relationship between streamflow and rainfall in certain conditions, but fail to outperform traditional prediction methods in other scenarios.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Uncertainty separation of drought projection in the 21st century using SMILEs and CMIP6

Yadong Ji, Jianyu Fu, Bingjun Liu, Zeqin Huang, Xuejin Tan

Summary: This study distinguishes the uncertainty in drought projection into scenario uncertainty, model uncertainty, and internal variability uncertainty. The results show that the estimation of total uncertainty reaches a minimum in the mid-21st century and that model uncertainty is dominant in tropical regions.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Quantifying the natural flood management potential of leaky dams in upland catchments, Part II: Leaky dam impacts on flood peak magnitude

Z. R. van Leeuwen, M. J. Klaar, M. W. Smith, L. E. Brown

Summary: This study quantifies the effectiveness of leaky dams in reducing flood peak magnitude using a transfer function noise modelling approach. The results show that leaky dams have a significant but highly variable impact on flood peak magnitude, and managing expectations should consider event size and type.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Forecasting and optimization for minimizing combined sewer overflows using Machine learning frameworks and its inversion techniques

Zeda Yin, Yasaman Saadati, M. Hadi Amini, Linlong Bian, Beichao Hu

Summary: Combined sewer overflows pose significant threats to public health and the environment, and various strategies have been proposed to mitigate their adverse effects. Smart control strategies have gained traction due to their cost-effectiveness but face challenges in balancing precision and computational efficiency. To address this, we propose exploring machine learning models and the inversion of neural networks for more efficient CSO prediction and optimization.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Characterizing nitrogen dynamics and their response to sediment dredging in a lowland rural river

Qimou Zhang, Jiacong Huang, Jing Zhang, Rui Qian, Zhen Cui, Junfeng Gao

Summary: This study developed a N-cycling model for lowland rural rivers covered by macrophytes and investigated the N imports, exports, and response to sediment dredging. The findings showed a considerable N retention ability in the study river, with significant N imports from connected rivers and surrounding polders. Sediment dredging increased particulate nitrogen resuspension and settling rates, while decreasing ammonia nitrogen release, denitrification, and macrophyte uptake rates.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Using a two-step downscaling method to assess the impact of climate change on total nitrogen load in a small basin

Xue Li, Yingyin Zhou, Jian Sha, Man Zhang, Zhong-Liang Wang

Summary: High-resolution climate data is crucial for predicting regional climate and water environment changes. In this study, a two-step downscaling method was developed to enhance the spatial resolution of GCM data and improve the accuracy for small basins. The method combined medium-resolution climate data with high-resolution topographic data to capture spatial and temporal details. The downscaled climate data were then used to simulate the impacts of climate change on hydrology and water quality in a small basin. The results demonstrated the effectiveness of the downscaling method for spatially differentiated simulations.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Permafrost on the Tibetan Plateau is degrading: Historical and projected trends

Tongqing Shen, Peng Jiang, Jiahui Zhao, Xuegao Chen, Hui Lin, Bin Yang, Changhai Tan, Ying Zhang, Xinting Fu, Zhongbo Yu

Summary: This study evaluates the long-term interannual dynamics of permafrost distribution and active layer thickness on the Tibetan Plateau, and predicts future degradation trends. The results show that permafrost area has been decreasing and active layer thickness has been increasing, with an accelerated degradation observed in recent decades. This has significant implications for local water cycle processes, water ecology, and water security.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Quantifying precipitation moisture contributed by different atmospheric circulations across the Tibetan Plateau

Chi Zhang, Xu Zhang, Qiuhong Tang, Deliang Chen, Jinchuan Huang, Shaohong Wu, Yubo Liu

Summary: Precipitation over the Tibetan Plateau is influenced by systems such as the Asian monsoons, the westerlies, and local circulations. The Indian monsoon, the westerlies, and local circulations are the main systems affecting precipitation over the entire Tibetan Plateau. The East Asian summer monsoon primarily affects the eastern Tibetan Plateau. The Indian monsoon has the greatest influence on precipitation in the southern and central grid cells, while the westerlies have the greatest influence on precipitation in the northern and western grid cells. Local circulations have the strongest influence on the central and eastern grid cells.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

A methodology to improve the accuracy of Total phosphorous diffuse load estimates from agroforestry watersheds

Manuel Almeida, Antonio Rodrigues, Pedro Coelho

Summary: This study aimed to improve the accuracy of Total Phosphorus export coefficient models, which are essential for water management. Four different models were applied to 27 agroforestry watersheds in the Mediterranean region. The modeling approach showed significant improvements in predicting the Total Phosphorus diffuse loads.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Prediction of dissolved organic nitrogen via spectroscopic fingerprint in the shallow riverbed sediments of effluent-dominated rivers: A case study in Xi'an, northwest China

Yutao Wang, Haojie Yin, Ziyi Wang, Yi Li, Pingping Wang, Longfei Wang

Summary: This study investigated the distribution and transformation of dissolved organic nitrogen (DON) in riverbed sediments impacted by effluent discharge. The authors found that the spectral characteristics of dissolved organic matter (DOM) in surface water and sediment porewater could be used to predict DON variations in riverbed sediments. Random forest and extreme gradient boosting machine learning methods were employed to provide accurate predictions of DON content and properties at different depths. These findings have important implications for wastewater discharge management and river health.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Uncertainty analysis of 100-year flood maps under climate change scenarios

Saba Mirza Alipour, Kolbjorn Engeland, Joao Leal

Summary: This study assesses the uncertainty associated with 100-year flood maps under different scenarios using Monte Carlo simulations. The findings highlight the importance of employing probabilistic approaches for accurate and secure flood maps, with the selection of probability distribution being the primary source of uncertainty in precipitation.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Hydrological consequences of controlled drainage with subirrigation

Janine A. de Wit, Marjolein H. J. van Huijgevoort, Jos C. van Dam, Ge A. P. H. van den Eertwegh, Dion van Deijl, Coen J. Ritsema, Ruud P. Bartholomeus

Summary: The study focuses on the hydrological consequences of controlled drainage with subirrigation (CD-SI) on groundwater level, soil moisture content, and soil water potential. The simulations show that CD-SI can improve hydrological conditions for crop growth, but the success depends on subtle differences in geohydrologic characteristics.

JOURNAL OF HYDROLOGY (2024)

Article Engineering, Civil

Understanding the global success criteria for managed aquifer recharge schemes

Constantin Seidl, Sarah Ann Wheeler, Declan Page

Summary: Water availability and quality issues will become increasingly important in the future due to climate change impacts. Managed Aquifer Recharge (MAR) is an effective water management tool, but often overlooked. This study analyzes global MAR applications and identifies the key factors for success, providing valuable insights for future design and application.

JOURNAL OF HYDROLOGY (2024)