4.7 Article

Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems

Journal

Publisher

ELSEVIER SCIENCE SA
DOI: 10.1016/j.cma.2021.114502

Keywords

Partial differential equations; Inverse problem; Physics-informed machine learning; Graph convolutional neural networks; Mechanics

Funding

  1. National Science Foundation, United States of America [CMMI-1934300, OAC-2047127]
  2. Air Force Office of Scientific Research (AFOSR) , United States of America [FA9550-20-1-0236]
  3. College of Engineering at University of Notre Dame, United States of America

Ask authors/readers for more resources

Despite the promise of PINNs in solving forward and inverse problems, there are technical challenges that hinder complex and realistic applications. To address these challenges, a discrete PINN framework based on GCN and PDE is proposed to solve PDEs in both forward and inverse settings, offering improved scalability, boundary enforcement, and handling of irregular geometries.
Despite the great promise of the physics-informed neural networks (PINNs) in solving forward and inverse problems, several technical challenges are present as roadblocks for more complex and realistic applications. First, most existing PINNs are based on point-wise formulation with fully-connected networks to learn continuous functions, which suffer from poor scalability and hard boundary enforcement. Second, the infinite search space over-complicates the non-convex optimization for network training. Third, although the convolutional neural network (CNN)-based discrete learning can significantly improve training efficiency, CNNs struggle to handle irregular geometries with unstructured meshes. To properly address these challenges, we present a novel discrete PINN framework based on graph convolutional network (GCN) and variational structure of PDE to solve forward and inverse partial differential equations (PDEs) in a unified manner. The use of a piecewise polynomial basis can reduce the dimension of search space and facilitate training and convergence. Without the need of tuning penalty parameters in classic PINNs, the proposed method can strictly impose boundary conditions and assimilate sparse data in both forward and inverse settings. The flexibility of GCNs is leveraged for irregular geometries with unstructured meshes. The effectiveness and merit of the proposed method are demonstrated over a variety of forward and inverse computational mechanics problems governed by both linear and nonlinear PDEs.(c) 2021 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Multidisciplinary

A globally convergent method to accelerate topology optimization using on-the-fly model reduction

Masayuki Yano, Tianci Huang, Matthew J. Zahr

Summary: A globally convergent method using projection-based reduced-order models (ROMs) and trust-region methods is proposed to accelerate density-based topology optimization. By replacing large-scale finite element simulations with ROMs, the computational cost of objective function and gradient evaluations is significantly reduced. The trust-region method is introduced to ensure convergence to critical points of the original topology optimization problem, leading to accelerated convergence to optimal designs by up to an order of magnitude.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2021)

Article Engineering, Multidisciplinary

Preserving general physical properties in model reduction of dynamical systems via constrained-optimization projection

Alexander Schein, Kevin T. Carlberg, Matthew J. Zahr

Summary: Model-reduction techniques aim to reduce computational complexity by enforcing dynamics in a low-dimensional subspace, but often result in reduced-order models violating intrinsic physical properties. Ensuring that reduced-order models preserve these properties can improve accuracy and stability in many applications.

INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING (2021)

Article Multidisciplinary Sciences

Physics-informed Dyna-style model-based deep reinforcement learning for dynamic control

Xin-Yang Liu, Jian-Xun Wang

Summary: Model-based reinforcement learning (MBRL) aims to improve sample efficiency by learning a predictive model of the environment, but the quality of the learned model is crucial for its performance. This study proposes a physics-informed MBRL framework that leverages prior knowledge of the environment's underlying physics to enhance the quality of the learned model and reduce interactions with the environment.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2021)

Article Chemistry, Physical

Physics-informed deep learning for solving phonon Boltzmann transport equation with large temperature non-equilibrium

Ruiyang Li, Jian-Xun Wang, Eungkyu Lee, Tengfei Luo

Summary: This study introduces a data-free deep learning scheme, physics-informed neural network (PINN), for solving the phonon Boltzmann transport equation (BTE) with arbitrary temperature gradients. Numerical experiments suggest that the proposed PINN can accurately predict phonon transport under arbitrary temperature gradients and shows great promise for thermal design.

NPJ COMPUTATIONAL MATERIALS (2022)

Article Computer Science, Interdisciplinary Applications

A robust, high-order implicit shock tracking method for simulation of complex, high-speed flows

Tianci Huang, Matthew J. Zahr

Summary: High-order implicit shock tracking is a new numerical method that accurately approximates solutions of conservation laws with non-smooth features. By optimizing the mesh and high-order approximation, this method can reliably simulate complex, high-speed, compressible flows.

JOURNAL OF COMPUTATIONAL PHYSICS (2022)

Article Computer Science, Interdisciplinary Applications

Accurate quantification of blood flow wall shear stress using simulation-based imaging: a synthetic, comparative study

Charles J. Naudet, Johannes Toger, Matthew J. Zahr

Summary: This study investigates the effectiveness of Simulation-based Imaging (SBI) in predicting wall shear stress (WSS) compared to standard Magnetic Resonance Imaging (MRI) postprocessing techniques. The results show that SBI is not sensitive to the Reynolds number, improves with increased MRI data, and provides accurate reconstructions with minimal MRI voxels. However, the reconstruction quality decreases linearly with increased noise in the data. The study also reveals the flexibility of the CFD mesh used in SBI, although the reconstruction quality becomes more dependent on other parameters, particularly the resolution of the MRI data, for coarser meshes.

ENGINEERING WITH COMPUTERS (2022)

Article Mechanics

Deep learning-based surrogate model for three-dimensional patient-specific computational fluid dynamics

Pan Du, Xiaozhi Zhu, Jian-Xun Wang

Summary: Optimization and uncertainty quantification are increasingly important in computational hemodynamics. However, existing methods face challenges when dealing with complex 3D patient-specific shapes. This study proposes a deep learning surrogate modeling solution to enable rapid hemodynamic predictions.

PHYSICS OF FLUIDS (2022)

Article Computer Science, Interdisciplinary Applications

Model reduction of convection-dominated partial differential equations via optimization-based implicit feature tracking

Marzieh Alireza Mirhoseini, Matthew J. Zahr

Summary: This work introduces a new approach called model reduction with implicit feature tracking to reduce the computational cost of solving convection-dominated partial differential equations (PDEs). The approach utilizes a nonlinear approximation manifold composed of a low-dimensional affine space and a space of bijections to overcome the limitations of traditional model reduction techniques. By minimizing the residual of the unreduced PDE discretization over the reduced nonlinear manifold, the proposed method achieves accurate approximations to convection-dominated problems with limited training.

JOURNAL OF COMPUTATIONAL PHYSICS (2023)

Article Engineering, Multidisciplinary

Physics-integrated neural differentiable (PiNDiff) model for composites manufacturing

Deepak Akhare, Tengfei Luo, Jian-Xun Wang

Summary: Various manufacturing technologies are being developed to improve the manufacturing of composites owing to their low weight and high performance. Traditional first-principle modeling approaches are not accessible due to the complex physics involved. A physics-integrated neural differentiable (PiNDiff) model is developed to tackle the challenges of modeling the curing process of thick thermoset composite laminates with partially known physics.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2023)

Article Biology

Predicting 3D soft tissue dynamics from 2D imaging using physics informed neural networks

Mohammadreza Movahhedi, Xin-Yang Liu, Biao Geng, Coen Elemans, Qian Xue, Jian-Xun Wang, Xudong Zheng

Summary: A hybrid physics-informed neural network algorithm is proposed to infer 3D flow-induced tissue dynamics from sparse 2D images. The algorithm combines a differentiable fluid solver with a recurrent neural network model of soft tissue. The effectiveness of the algorithm is demonstrated on synthetic and experimental data, successfully reconstructing 3D vocal dynamics, aerodynamics, and acoustics from sparse 2D vibration profiles.

COMMUNICATIONS BIOLOGY (2023)

Article Computer Science, Interdisciplinary Applications

A globally convergent method to accelerate large-scale optimization using on-the-fly model hyperreduction: Application to shape optimization

Tianshu Wen, Matthew J. Zahr

Summary: We propose a numerical method to efficiently solve large-scale optimization problems governed by nonlinear systems of equations, including discretized partial differential equations, using projection-based reduced-order models. The method constructs a hyperreduced model on-the-fly during the optimization process, avoiding the need for offline training and ensuring all snapshot information is collected. Numerical experiments demonstrate the global convergence and computational efficiency of the method, with significant speedups compared to standard optimization approaches.

JOURNAL OF COMPUTATIONAL PHYSICS (2023)

Article Computer Science, Interdisciplinary Applications

High-order implicit shock tracking boundary conditions for flows with parametrized shocks

Tianci Huang, Charles J. Naudet, Matthew J. Zahr

Summary: High-order implicit shock tracking is a numerical method that approximates solutions of conservation laws by aligning computational mesh elements with non-smooth features. This paper introduces a robust framework for parameter-dependent lead shocks and demonstrates its effectiveness through various benchmark problems.

JOURNAL OF COMPUTATIONAL PHYSICS (2023)

Article Mechanics

Effects of antagonistic muscle actuation on the bilaminar structure of ray-finned fish in propulsion

Dariush Bodaghi, Jian-Xun Wang, Qian Xue, Xudong Zheng

Summary: In this study, the effects of antagonistic muscle actuation on fish fin ray propulsion were investigated using a computational flow-structure interaction (FSI) model. The results show that the phase of muscle actuation is a critical factor affecting its effects, and different phases result in different thrust and efficiency.

JOURNAL OF FLUID MECHANICS (2023)

Article Engineering, Multidisciplinary

Probabilistic physics-guided transfer learning for material property prediction in extrusion deposition additive manufacturing

Akshay J. Thomas, Mateusz Jaszczuk, Eduardo Barocio, Gourab Ghosh, Ilias Bilionis, R. Byron Pipes

Summary: We propose a physics-guided transfer learning approach to predict the thermal conductivity of additively manufactured short-fiber reinforced polymers using micro-structural characteristics obtained from tensile tests. A Bayesian framework is developed to transfer the thermal conductivity properties across different extrusion deposition additive manufacturing systems. The experimental results demonstrate the effectiveness and reliability of our method in accounting for epistemic and aleatory uncertainties.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Discovering a reaction-diffusion model for Alzheimer's disease by combining PINNs with symbolic regression

Zhen Zhang, Zongren Zou, Ellen Kuhl, George Em Karniadakis

Summary: In this study, deep learning and artificial intelligence were used to discover a mathematical model for the progression of Alzheimer's disease. By analyzing longitudinal tau positron emission tomography data, a reaction-diffusion type partial differential equation for tau protein misfolding and spreading was discovered. The results showed different misfolding models for Alzheimer's and healthy control groups, indicating faster misfolding in Alzheimer's group. The study provides a foundation for early diagnosis and treatment of Alzheimer's disease and other misfolding-protein based neurodegenerative disorders using image-based technologies.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

A neural network-based enrichment of reproducing kernel approximation for modeling brittle fracture

Jonghyuk Baek, Jiun-Shyan Chen

Summary: This paper introduces an improved neural network-enhanced reproducing kernel particle method for modeling the localization of brittle fractures. By adding a neural network approximation to the background reproducing kernel approximation, the method allows for the automatic location and insertion of discontinuities in the function space, enhancing the modeling effectiveness. The proposed method uses an energy-based loss function for optimization and regularizes the approximation results through constraints on the spatial gradient of the parametric coordinates, ensuring convergence.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Stabilized mixed material point method for incompressible fluid flow

Bodhinanda Chandra, Ryota Hashimoto, Shinnosuke Matsumi, Ken Kamrin, Kenichi Soga

Summary: This paper proposes new and robust stabilization strategies for accurately modeling incompressible fluid flow problems in the material point method (MPM). The proposed approach adopts a monolithic displacement-pressure formulation and integrates two stabilization strategies to ensure stability. The effectiveness of the proposed method is validated through benchmark cases and real-world scenarios involving violent free-surface fluid motion.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

A unified analytical expression of the tangent stiffness matrix of holonomic constraints

Chao Peng, Alessandro Tasora, Dario Fusai, Dario Mangoni

Summary: This article discusses the importance of the tangent stiffness matrix of constraints in multibody systems and provides a general formulation based on quaternion parametrization. The article also presents the analytical expression of the tangent stiffness matrix derived through linearization. Examples demonstrate the positive effect of this additional stiffness term on static and eigenvalue analyses.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

On the detection of nonlinear normal mode-related isolated branches of periodic solutions for high-dimensional nonlinear mechanical systems with frictionless contact interfaces

Thibaut Vadcard, Fabrice Thouverez, Alain Batailly

Summary: This contribution presents a methodology for detecting isolated branches of periodic solutions to nonlinear mechanical equations. The method combines harmonic balance method-based solving procedure with the Melnikov energy principle. It is able to predict the location of isolated branches of solutions near families of autonomous periodic solutions. The relevance and accuracy of this methodology are demonstrated through academic and industrial applications.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Machine learning powered sketch aided design via topology optimization

Weisheng Zhang, Yue Wang, Sung-Kie Youn, Xu Guo

Summary: This study proposes a sketch-guided topology optimization approach based on machine learning, which incorporates computer sketches as constraint functions to improve the efficiency of computer-aided structural design models and meet the design intention and requirements of designers.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Reduced order isogeometric boundary element methods for CAD-integrated shape optimization in electromagnetic scattering

Leilei Chen, Zhongwang Wang, Haojie Lian, Yujing Ma, Zhuxuan Meng, Pei Li, Chensen Ding, Stephane P. A. Bordas

Summary: This paper presents a model order reduction method for electromagnetic boundary element analysis and extends it to computer-aided design integrated shape optimization of multi-frequency electromagnetic scattering problems. The proposed method utilizes a series expansion technique and the second-order Arnoldi procedure to reduce the order of original systems. It also employs the isogeometric boundary element method to ensure geometric exactness and avoid re-meshing during shape optimization. The Grey Wolf Optimization-Artificial Neural Network is used as a surrogate model for shape optimization, with radar cross section as the objective function.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Volume conservation issue within SPH models for long-time simulations of violent free-surface flows

C. Pilloton, P. N. Sun, X. Zhang, A. Colagrossi

Summary: This paper investigates the smoothed particle hydrodynamics (SPH) simulations of violent sloshing flows and discusses the impact of volume conservation errors on the simulation results. Different techniques are used to directly measure the particles' volumes and stabilization terms are introduced to control the errors. Experimental comparisons demonstrate the effectiveness of the numerical techniques.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Convolution finite element based digital image correlation for and strain measurements

Ye Lu, Weidong Zhu

Summary: This work presents a novel global digital image correlation (DIC) method based on a convolution finite element (C-FE) approximation. The C-FE based DIC provides highly smooth and accurate displacement and strain results with the same element size as the usual finite element (FE) based DIC. The proposed method's formulation and implementation, as well as the controlling parameters, have been discussed in detail. The C-FE method outperformed the FE method in all tested examples, demonstrating its potential for highly smooth, accurate, and robust DIC analysis.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Optimization based on performance of lungs in body: Lungs performance-based optimization (LPO)

Mojtaba Ghasemi, Mohsen Zare, Amir Zahedi, Pavel Trojovsky, Laith Abualigah, Eva Trojovska

Summary: This paper introduces Lung performance-based optimization (LPO), a novel algorithm that draws inspiration from the efficient oxygen exchange in the lungs. Through experiments and comparisons with contemporary algorithms, LPO demonstrates its effectiveness in solving complex optimization problems and shows potential for a wide range of applications.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Integrated optimization of components' layout and structural topology with considering the interface stress constraint

Jingyu Hu, Yang Liu, Huixin Huang, Shutian Liu

Summary: In this study, a new topology optimization method is proposed for structures with embedded components, considering the tension/compression asymmetric interface stress constraint. The method optimizes the topology of the host structure and the layout of embedded components simultaneously, and a new interpolation model is developed to determine interface layers between the host structure and embedded components.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

The anisotropic graph neural network model with multiscale and nonlinear characteristic for turbulence simulation

Qiang Liu, Wei Zhu, Xiyu Jia, Feng Ma, Jun Wen, Yixiong Wu, Kuangqi Chen, Zhenhai Zhang, Shuang Wang

Summary: In this study, a multiscale and nonlinear turbulence characteristic extraction model using a graph neural network was designed. This model can directly compute turbulence data without resorting to simplified formulas. Experimental results demonstrate that the model has high computational performance in turbulence calculation.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Multi-temporal decomposition for elastoplastic ratcheting solids

Jacinto Ulloa, Geert Degrande, Jose E. Andrade, Stijn Francois

Summary: This paper presents a multi-temporal formulation for simulating elastoplastic solids under cyclic loading. The proper generalized decomposition (PGD) is leveraged to decompose the displacements into multiple time scales, separating the spatial and intra-cyclic dependence from the inter-cyclic variation, thereby reducing computational burden.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Automated translation and accelerated solving of differential equations on multiple GPU platforms

Utkarsh Utkarsh, Valentin Churavy, Yingbo Ma, Tim Besard, Prakitr Srisuma, Tim Gymnich, Adam R. Gerlach, Alan Edelman, George Barbastathis, Richard D. Braatz, Christopher Rackauckas

Summary: This article presents a high-performance vendor-agnostic method for massively parallel solving of ordinary and stochastic differential equations on GPUs. The method integrates with a popular differential equation solver library and achieves state-of-the-art performance compared to hand-optimized kernels.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)