4.7 Article

Weak SINDy for partial differential equations

Journal

JOURNAL OF COMPUTATIONAL PHYSICS
Volume 443, Issue -, Pages -

Publisher

ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.jcp.2021.110525

Keywords

Data-driven model selection; Partial differential equations; Weak solutions; Sparse recovery; Galerkin method; Convolution

Funding

  1. NSF/NIH Joint DMS/NIGMS Mathematical Biology Initiative grant [R01GM126559]
  2. NSF Computing and Communications Foundations [CCF-1815983]
  3. National Science Foundation [ACI-1532235, ACI-1532236]
  4. University of Colorado Boulder
  5. Colorado State University

Ask authors/readers for more resources

Sparse Identification of Nonlinear Dynamics (SINDy) has been extended to the weak formulation for partial differential equations (PDEs) to improve accuracy in model coefficient recovery and robustness in identifying PDEs in large noise regime. The implementation utilizes Fast Fourier Transform for efficient model identification and reveals a connection between noise robustness and spectra of test functions. Additionally, a learning algorithm for threshold in sequential thresholding least-squares (STLS) is introduced for model identification from large libraries.
Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data [6,39]. Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy) framework introduced in [28] to the setting of partial differential equations (PDEs). The elimination of pointwise derivative approximations via the weak form enables effective machine-precision recovery of model coefficients from noise-free data (i.e. below the tolerance of the simulation scheme) as well as robust identification of PDEs in the large noise regime (with signal-to-noise ratio approaching one in many well-known cases). This is accomplished by discretizing a convolutional weak form of the PDE and exploiting separability of test functions for efficient model identification using the Fast Fourier Transform. The resulting WSINDy algorithm for PDEs has a worst-case computational complexity of O(ND+1 log(N)) for datasets with N points in each of D + 1 dimensions. Furthermore, our Fourier-based implementation reveals a connection between robustness to noise and the spectra of test functions, which we utilize in an a priori selection algorithm for test functions. Finally, we introduce a learning algorithm for the threshold in sequentialthresholding least-squares (STLS) that enables model identification from large libraries, and we utilize scale invariance at the continuum level to identify PDEs from poorly-scaled datasets. We demonstrate WSINDy's robustness, speed and accuracy on several challenging PDEs. Code is publicly available on GitHub at https://github.com/MathBioCU/WSINDy_PDE. (C) 2021 Elsevier Inc. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Microbiology

Mechanical regulation of photosynthesis in cyanobacteria

Kristin A. Moore, Sabina Altus, Jian W. Tay, Janet B. Meehl, Evan B. Johnson, David M. Bortz, Jeffrey C. Cameron

NATURE MICROBIOLOGY (2020)

Article Multidisciplinary Sciences

Life cycle of a cyanobacterial carboxysome

Nicholas C. Hill, Jian Wei Tay, Sabina Altus, David M. Bortz, Jeffrey C. Cameron

SCIENCE ADVANCES (2020)

Article Multidisciplinary Sciences

Protocol for Analysis and Consolidation of TrackMate Outputs for Measuring Two-Dimensional Cell Motility using Nuclear Tracking

Graycen E. Wheeler, Amrita Purkayastha, Eric N. Bunker, David M. Bortz, Xuedong Liu

Summary: This study describes a method for measuring and quantifying single-cell and bulk motility of HaCaT keratinocytes using a nuclear stain. The method includes a MATLAB script for analyzing TrackMate output files to calculate displacements, motility rates, and trajectory angles, allowing for quick, straightforward, and scalable analysis of cell motility rates.

JOVE-JOURNAL OF VISUALIZED EXPERIMENTS (2021)

Article Mathematics, Applied

ANALYTICAL SINGULAR VALUE DECOMPOSITION FOR A CLASS OF STOICHIOMETRY MATRICES

Jacqueline Wentz, Jeffrey C. Cameron, David M. Bortz

Summary: This research presents an analytical singular value decomposition method for the stoichiometry matrix of a reaction-diffusion system to reveal spatial flux patterns. Approaches for approximate and exact singular value decompositions are studied for different reaction and diffusion scenarios. The study shows that the singular value decomposition depends on smaller matrix decompositions, providing efficient analysis of the stoichiometry matrix of reaction-diffusion systems.

SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS (2022)

Article Mathematics, Applied

Learning mean-field equations from particle data using WSINDy

Daniel A. Messenger, David M. Bortz

Summary: We have developed a weak-form sparse identification method for interacting particle systems (IPS), aiming to reduce computational complexity for large number of particles and offer robustness to noise. By combining mean-field theory of IPS with the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy), we provide a fast and reliable system identification scheme for recovering the governing stochastic differential equations for an IPS.

PHYSICA D-NONLINEAR PHENOMENA (2022)

Article Multidisciplinary Sciences

Learning anisotropic interaction rules from individual trajectories in a heterogeneous cellular population

Daniel A. Messenger, Graycen E. Wheeler, Xuedong Liu, David M. Bortz

Summary: Researchers have developed the WSINDy method to learn equations for communities of cells and classify them using a novel scheme. The method demonstrates efficiency and proficiency through various test scenarios.

JOURNAL OF THE ROYAL SOCIETY INTERFACE (2022)

Article Mathematics, Applied

ZERO-DIFFUSION LIMIT FOR AGGREGATION EQUATIONS OVER BOUNDED DOMAINS

Razvan C. Fetecau, Hui Huang, Daniel Messenger, Weiran Sun

Summary: We investigate the zero-diffusion limit for both continuous and discrete aggregation-diffusion models over convex and bounded domains. Our result relaxes the regularity assumptions on the interaction and external potentials and improves the convergence rate.

DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS (2022)

Article Mathematics, Interdisciplinary Applications

WEAK SINDy: GALERKIN-BASED DATA-DRIVEN MODEL SELECTION

Daniel A. Messenger, David M. Bortz

Summary: A novel weak formulation and discretization method, called WSINDy, is proposed to discover governing equations from noisy measurement data. Compared to the standard SINDy algorithm, WSINDy allows for reliable model identification and reduces errors in data with large noise levels.

MULTISCALE MODELING & SIMULATION (2021)

Article Immunology

Estimating the Impact of Statewide Policies to Reduce Spread of Severe Acute Respiratory Syndrome Coronavirus 2 in Real Time, Colorado, USA

Andrea G. Buchwald, Jude Bayham, Jimi Adams, David Bortz, Kathryn Colborn, Olivia Zarella, Meghan Buran, Jonathan Samet, Debashis Ghosh, Rachel Herlihy, Elizabeth J. Carlton

Summary: The study conducted in Colorado showed that early policy measures related to COVID-19 significantly decreased mobility and reduced virus transmission, with the effective reproductive number falling below 1. Although mobility increased to near baseline levels after some restrictions were lifted, transmission remained low. As the model parameters were adjusted to better reflect the reality in Colorado over time, there were modest changes in estimates of intervention effects and more conservative long-term projections.

EMERGING INFECTIOUS DISEASES (2021)

Article Mathematics, Applied

BOUNDEDNESS OF A CLASS OF SPATIALLY DISCRETE REACTION-DIFFUSION SYSTEMS

Jacqueline M. Wentz, David M. Bortz

Summary: This study focuses on determining sufficient conditions to guarantee that the discrete reaction-diffusion system is bounded for all time, using a Lyapunov-like function on a 1D domain with homogeneous Neumann boundary conditions and nonnegative initial data and solutions. The existence of this function ensures the boundedness of the system, as illustrated in the context of four example systems.

SIAM JOURNAL ON APPLIED MATHEMATICS (2021)

Article Computer Science, Interdisciplinary Applications

A new type of non-polynomial based TENO scheme for hyperbolic conservation laws

Tian Liang, Lin Fu

Summary: In this work, a new shock-capturing framework is proposed based on a new candidate stencil arrangement and the combination of infinitely differentiable non-polynomial RBF-based reconstruction in smooth regions with jump-like non-polynomial interpolation for genuine discontinuities. The resulting scheme achieves high order accuracy and resolves genuine discontinuities with sub-cell resolution.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

A high-order residual-based viscosity finite element method for incompressible variable density flow

Lukas Lundgren, Murtazo Nazarov

Summary: In this paper, a high-order accurate finite element method for incompressible variable density flow is introduced. The method addresses the issues of saddle point system and stability problem through Schur complement preconditioning and artificial compressibility approaches, and it is validated to have high-order accuracy for smooth problems and accurately resolve discontinuities.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Convergence analysis and optimization of a Robin Schwarz waveform relaxation method for time-periodic parabolic optimal control problems

Gabriele Ciaramella, Laurence Halpern, Luca Mechelli

Summary: This paper presents a novel convergence analysis of the optimized Schwarz waveform relaxation method for solving optimal control problems governed by periodic parabolic PDEs. The analysis is based on a Fourier-type technique applied to a semidiscrete-in-time form of the optimality condition, which enables a precise characterization of the convergence factor at the semidiscrete level. The behavior of the optimal transmission condition parameter is also analyzed in detail as the time discretization approaches zero.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Data-driven Whitney forms for structure-preserving control volume analysis

Jonas A. Actor, Xiaozhe Hu, Andy Huang, Scott A. Roberts, Nathaniel Trask

Summary: This article introduces a scientific machine learning framework that uses a partition of unity architecture to model physics through control volume analysis. The framework can extract reduced models from full field data while preserving the physics. It is applicable to manifolds in arbitrary dimension and has been demonstrated effective in specific problems.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Higher-continuity s-version of finite element method with B-spline functions

Nozomi Magome, Naoki Morita, Shigeki Kaneko, Naoto Mitsume

Summary: This paper proposes a novel strategy called B-spline based SFEM to fundamentally solve the problems of the conventional SFEM. It uses different basis functions and cubic B-spline basis functions with C-2-continuity to improve the accuracy of numerical integration and avoid matrix singularity. Numerical results show that the proposed method is superior to conventional methods in terms of accuracy and convergence.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

A cell-centred Eulerian volume-of-fluid method for compressible multi-material flows

Timothy R. Law, Philip T. Barton

Summary: This paper presents a practical cell-centred volume-of-fluid method for simulating compressible solid-fluid problems within a pure Eulerian setting. The method incorporates a mixed-cell update to maintain sharp interfaces, and can be easily extended to include other coupled physics. Various challenging test problems are used to validate the method, and its robustness and application in a multi-physics context are demonstrated.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Two-step multi-resolution reconstruction-based compact gas-kinetic scheme on tetrahedral mesh

Xing Ji, Fengxiang Zhao, Wei Shyy, Kun Xu

Summary: This paper presents the development of a third-order compact gas-kinetic scheme for compressible Euler and Navier-Stokes solutions, constructed particularly for an unstructured tetrahedral mesh. The scheme demonstrates robustness in high-speed flow computation and exhibits excellent adaptability to meshes with complex geometrical configurations.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Multiscale sampling for the inverse modeling of partial differential equations

Alsadig Ali, Abdullah Al-Mamun, Felipe Pereira, Arunasalam Rahunanthan

Summary: This paper presents a novel Bayesian statistical framework for the characterization of natural subsurface formations, and introduces the concept of multiscale sampling to localize the search in the stochastic space. The results show that the proposed framework performs well in solving inverse problems related to porous media flows.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Constrained optimized dynamic mode decomposition with control for physically stable systems with exogeneous inputs

Jacob Rains, Yi Wang, Alec House, Andrew L. Kaminsky, Nathan A. Tison, Vamshi M. Korivi

Summary: This paper presents a novel method called constrained optimized DMD with Control (cOptDMDc), which extends the optimized DMD method to systems with exogenous inputs and can enforce the stability of the resulting reduced order model (ROM). The proposed method optimally places eigenvalues within the stable region, thus mitigating spurious eigenvalue issues. Comparative studies show that cOptDMDc achieves high accuracy and robustness.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

A hybridizable discontinuous Galerkin formulation for the Euler-Maxwell plasma model

Andrea La Spina, Jacob Fish

Summary: This work introduces a hybridizable discontinuous Galerkin formulation for simulating ideal plasmas. The proposed method couples the fluid and electromagnetic subproblems monolithically based on source and employs a fully implicit time integration scheme. The approach also utilizes a projection-based divergence correction method to enforce the Gauss laws in challenging scenarios. Numerical examples demonstrate the high-order accuracy, efficiency, and robustness of the proposed formulation.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Numerical solution of the cavity scattering problem for flexural waves on thin plates: Linear finite element methods

Junhong Yue, Peijun Li

Summary: This paper proposes two numerical methods (IP-FEM and BP-FEM) to study the flexural wave scattering problem of an arbitrary-shaped cavity on an infinite thin plate. These methods successfully decompose the fourth-order plate wave equation into the Helmholtz and modified Helmholtz equations with coupled conditions on the cavity boundary, providing an effective solution to this challenging problem.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Fast and scalable computation of shape-morphing nonlinear solutions with application to evolutional neural networks

William Anderson, Mohammad Farazmand

Summary: We develop fast and scalable methods, called RONS, for computing reduced-order nonlinear solutions. These methods have been proven to be highly effective in tackling challenging problems, but become computationally prohibitive as the number of parameters grows. To address this issue, three separate methods are proposed and their efficacy is demonstrated through examples. The application of RONS to neural networks is also discussed.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

A second order directional split exponential integrator for systems of advection-diffusion-reaction equations

Marco Caliari, Fabio Cassini

Summary: In this paper, a second order exponential scheme for stiff evolutionary advection-diffusion-reaction equations is proposed. The scheme is based on a directional splitting approach and uses computation of small sized exponential-like functions and tensor-matrix products for efficient implementation. Numerical examples demonstrate the advantage of the proposed approach over state-of-the-art techniques.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

A conservative semi-Lagrangian method for inhomogeneous Boltzmann equation

Sebastiano Boscarino, Seung Yeon Cho, Giovanni Russo

Summary: This work proposes a high order conservative semi-Lagrangian method for the inhomogeneous Boltzmann equation of rarefied gas dynamics. The method combines a semi-Lagrangian scheme for the convection term, a fast spectral method for computation of the collision operator, and a high order conservative reconstruction and a weighted optimization technique to preserve conservative quantities. Numerical tests demonstrate the accuracy and efficiency of the proposed method.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)

Article Computer Science, Interdisciplinary Applications

Uniqueness and numerical scheme for spherical shell-structured sources from the far field patterns with at most two frequencies

Jialei Li, Xiaodong Liu, Qingxiang Shi

Summary: This study shows that the number, centers, scattering strengths, inner and outer diameters of spherical shell-structured sources can be uniquely determined from the far field patterns. A numerical scheme is proposed for reconstructing the spherical shell-structured sources, which includes a migration series method for locating the centers and an iterative method for computing the inner and outer diameters without computing derivatives.

JOURNAL OF COMPUTATIONAL PHYSICS (2024)