4.7 Article

Efficient prediction uncertainty approximation in the calibration of environmental simulation models

期刊

WATER RESOURCES RESEARCH
卷 44, 期 4, 页码 -

出版社

AMER GEOPHYSICAL UNION
DOI: 10.1029/2007WR005869

关键词

-

资金

  1. Div Of Chem, Bioeng, Env, & Transp Sys
  2. Directorate For Engineering [0756575] Funding Source: National Science Foundation

向作者/读者索取更多资源

[ 1] This paper is aimed at improving the efficiency of model uncertainty analyses that are conditioned on measured calibration data. Specifically, the focus is on developing an alternative methodology to the generalized likelihood uncertainty estimation ( GLUE) technique when pseudolikelihood functions are utilized instead of a traditional statistical likelihood function. We demonstrate for multiple calibration case studies that the most common sampling approach utilized in GLUE applications, uniform random sampling, is much too inefficient and can generate misleading estimates of prediction uncertainty. We present how the new dynamically dimensioned search ( DDS) optimization algorithm can be used to independently identify multiple acceptable or behavioral model parameter sets in two ways. DDS could replace random sampling in typical applications of GLUE. More importantly, we present a new, practical, and efficient uncertainty analysis methodology called DDS-approximation of uncertainty ( DDS-AU) that quantifies prediction uncertainty using prediction bounds rather than prediction limits. Results for 13, 14, 26, and 30 parameter calibration problems show that DDS-AU can be hundreds or thousands of times more efficient at finding behavioral parameter sets than GLUE with random sampling. Results for one example show that for the same limited computational effort, DDS-AU prediction bounds can simultaneously be smaller and contain more of the measured data in comparison to GLUE prediction bounds. We also argue and then demonstrate that within the GLUE framework, when behavioral parameter sets are not sampled frequently enough, Latin hypercube sampling does not offer any improvements over simple random sampling.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Operations Research & Management Science

Integrating ε-dominance and RBF surrogate optimization for solving computationally expensive many-objective optimization problems

Wenyu Wang, Taimoor Akhtar, Christine A. Shoemaker

Summary: The paper introduces a novel and effective optimization algorithm, epsilon-MaSO, which combines epsilon-dominance with iterative Radial Basis Function surrogate-assisted framework for solving problems with many expensive objectives. It also incorporates a new strategy for selecting points for expensive evaluations and introduces a bi-level restart mechanism to prevent the algorithm from remaining in a local optimum.

JOURNAL OF GLOBAL OPTIMIZATION (2022)

Article Environmental Sciences

Simultaneous Calibration of Hydrologic Model Structure and Parameters Using a Blended Model

Robert Chlumsky, Juliane Mai, James R. Craig, Bryan A. Tolson

Summary: The improvement of hydrological modeling frameworks allows for both model structure and parameters to be automatically calibrated and evaluated. The blended model structure calibration method can identify near-optimal model structures at significantly lower computational cost, as well as help identify dominant processes and model structures in catchments.

WATER RESOURCES RESEARCH (2021)

Article Computer Science, Interdisciplinary Applications

Improving the speed of global parallel optimization on PDE models with processor affinity scheduling

Wei Xia, Christine A. Shoemaker

Summary: This paper explores the impact of cache memory limitations on the efficiency of using parallel global optimization methods, and proposes a novel mixed affinity scheduling strategy to improve computational efficiency, reducing the optimization time for expensive PDE models.

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING (2022)

Article Computer Science, Interdisciplinary Applications

Early termination strategies with asynchronous parallel optimization in application to automatic calibration of groundwater PDE models

Min Pang, Christine Ann Shoemaker, David Bindel

Summary: Automatic calibration is widely used in hydrological models to estimate parameters by minimizing the discrepancy between field data and simulation. This study introduces a new asynchronous parallel surrogate-assisted optimization algorithm, showing significantly better performance in efficiency and robustness compared to other algorithms. This asynchronous algorithm achieves the same results with 40%-70% less computation time than its synchronous counterpart.

ENVIRONMENTAL MODELLING & SOFTWARE (2022)

Article Computer Science, Interdisciplinary Applications

The pie sharing problem: Unbiased sampling of N+1 summative weights

Juliane Mai, James R. Craig, Bryan A. Tolson

Summary: This article provides a simple algorithm for randomly sampling a set of weights with their sum constrained to be equal to one. The algorithm has potential applications in calibration, uncertainty analysis, and sensitivity analysis of environmental models. The author demonstrates the efficiency and superiority of the proposed method compared to alternative sampling methods through three example applications.

ENVIRONMENTAL MODELLING & SOFTWARE (2022)

Article Environmental Sciences

Time to Update the Split-Sample Approach in Hydrological Model Calibration

Hongren Shen, Bryan A. Tolson, Juliane Mai

Summary: This study empirically assesses how different data splitting methods influence post-validation model testing period performance in hydrological modeling. The findings suggest that calibrating to older data and then validating models on newer data produces inferior model testing period performance, while calibrating to the full available data and skipping model validation is the most robust split-sample decision. The experimental findings remain consistent across different factors and strongly support revising the traditional split-sample approach in hydrological modeling.

WATER RESOURCES RESEARCH (2022)

Article Multidisciplinary Sciences

The sensitivity of simulated streamflow to individual hydrologic processes across North America

Juliane Mai, James R. Craig, Bryan A. Tolson, Richard Arsenault

Summary: The sensitivity of streamflow simulations to different hydrologic processes is analyzed in this study, using a novel analysis method that considers both parametric and structural uncertainties. The results show that quickflow is the most sensitive process for streamflow simulations across North America. Approximations of model process and parameter sensitivities are derived based on physiographic and climatologic data, and detailed spatio-temporal inputs and results are shared through an interactive website.

NATURE COMMUNICATIONS (2022)

Review Computer Science, Interdisciplinary Applications

A review of parallel computing applications in calibrating watershed hydrologic models

Marjan Asgari, Wanhong Yang, John Lindsay, Bryan Tolson, Maryam Mehri Dehnavi

Summary: This paper reviews the application of parallel computing in calibrating watershed hydrologic models and summarizes their contributions, knowledge gaps, and future research directions. The studies parallelized models using random-sampling-based algorithms or optimization algorithms and achieved significant speedup gain and efficiency. However, the speedup gain and efficiency decrease as the number of parallel processing units increases, especially after a certain threshold. Various combinations of hydrologic models, optimization algorithms, parallelization strategies, architectures, and communication modes need to be explored to improve speedup gain, efficiency, and solution quality. A standardized set of performance evaluation metrics should be developed to assess parallelization approaches. Interactive multiobjective optimization algorithms and integrated sensitivity analysis and calibration algorithms can also be potential future research areas.

ENVIRONMENTAL MODELLING & SOFTWARE (2022)

Article Environmental Sciences

Efficient, parallelized global optimization of groundwater pumping in a regional aquifer with land subsidence constraints

Min Pang, Erhu Du, Christine A. Shoemaker, Chunmiao Zheng

Summary: This paper introduces a method for designing groundwater exploitation schedules with constraints on land subsidence. It is the first application of a parallelized surrogate-based global optimization algorithm to this problem. The study demonstrates significant computational cost and time advantages of this method in a large region in China.

JOURNAL OF ENVIRONMENTAL MANAGEMENT (2022)

Article Environmental Sciences

Surrogate Global Optimization for Identifying Cost-Effective Green Infrastructure for Urban Flood Control With a Computationally Expensive Inundation Model

Wei Lu, Wei Xia, Christine A. Shoemaker

Summary: This study investigates the application of optimization methods in low-impact development (LID) design and proposes a framework that searches for the optimal LID configurations based on flood damage cost and LID life cycle cost. A case study is conducted to demonstrate the effectiveness of the framework. The results show that the proposed surrogate optimization method, DYCORS, is a promising approach for minimizing flood damage cost and LID life cycle cost.

WATER RESOURCES RESEARCH (2022)

Article Environmental Sciences

A Repetitive Parameterization and Optimization Strategy for the Calibration of Complex and Computationally Expensive Process-Based Models With Application to a 3D Water Quality Model of a Tropical Reservoir

Wei Xia, Christine Ann Shoemaker

Summary: This article introduces a new parameter calibration strategy called Rep-OPT, which uses multiple optimization steps and postanalysis techniques to help modelers select appropriate calibration parameters. Its effectiveness is demonstrated through its application on a complex water quality model.

WATER RESOURCES RESEARCH (2022)

Article Environmental Sciences

Comparison of parallel optimization algorithms on computationally expensive groundwater remediation designs

Min Pang, Christine A. Shoemaker

Summary: Contamination of groundwater resources poses a threat to human health and ecosystems globally. Groundwater remediation is crucial but costly and time-consuming. This study introduces a parallel optimization algorithm, p-SRBF, which shows promising performance in achieving cost-effective groundwater remediation designs. Compared to other algorithms, p-SRBF outperforms in objective quality, computational reduction, and robustness across multiple trials.

SCIENCE OF THE TOTAL ENVIRONMENT (2023)

Article Environmental Sciences

In Defense of Metrics: Metrics Sufficiently Encode Typical Human Preferences Regarding Hydrological Model Performance

Martin Gauch, Frederik Kratzert, Oren Gilon, Hoshin Gupta, Juliane Mai, Grey Nearing, Bryan Tolson, Sepp Hochreiter, Daniel Klotz

Summary: Building accurate rainfall-runoff models is crucial in hydrological science and practice. In this study, expert opinions were compared with quantitative metrics, and it was found that experts generally agreed with the metrics and showed a preference for Machine Learning models over traditional hydrological models. Although there were inconsistencies in expert opinions, where there was agreement, the opinions could be predicted from the quantitative metrics.

WATER RESOURCES RESEARCH (2023)

Article Geosciences, Multidisciplinary

A novel objective function DYNO for automatic multivariable calibration of 3D lake models

Wei Xia, Taimoor Akhtar, Christine A. Shoemaker

Summary: This study introduces a novel Dynamically Normalized Objective Function (DYNO) for multivariable model calibration problems. DYNO combines the error metrics of multiple variables into a single objective function by dynamically normalizing each variable's error terms. It adjusts the weight of each variable's error dynamically to balance the calibration. The results indicate that DYNO can balance the calibration of water temperature and velocity and that calibrating to only one variable cannot guarantee the goodness-of-fit of another variable. Our study suggests that including direct velocity measurements is likely to be more effective than using only temperature measurements for calibrating a 3D hydrodynamic model.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2022)

Article Geosciences, Multidisciplinary

The Great Lakes Runoff Intercomparison Project Phase 4: the Great Lakes (GRIP-GL)

Juliane Mai, Hongren Shen, Bryan A. Tolson, Etienne Gaborit, Richard Arsenault, James R. Craig, Vincent Fortin, Lauren M. Fry, Martin Gauch, Daniel Klotz, Frederik Kratzert, Nicole O'Brien, Daniel G. Princz, Sinan Rasiya Koya, Tirthankar Roy, Frank Seglenieks, Narayan K. Shrestha, Andre G. T. Temgoua, Vincent Vionnet, Jonathan W. Waddell

Summary: This study conducted a model intercomparison to compare different model setups in simulating outputs in the Great Lakes region. The results showed that the machine-learning-based model performed the best in simulating streamflow, while the locally calibrated models and regionally calibrated models showed varying performances in different areas. The study also compared additional model outputs, such as evapotranspiration, soil moisture, and snow water equivalent, against gridded reference datasets.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2022)

暂无数据