4.7 Article

SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks

出版社

ELSEVIER SCIENCE SA
DOI: 10.1016/j.cma.2020.113552

关键词

SciANN; Deep neural networks; Scientific computations; PINN; vPINN

资金

  1. KFUPM-MIT, United States, collaborative agreement 'Multiscale Reservoir Science'

向作者/读者索取更多资源

SciANN is a Python package for scientific computing and physics-informed deep learning. It utilizes TensorFlow and Keras to build deep neural networks and optimization models, allowing for solving partial differential equations with flexibility in setting complex functional forms.
In this paper, we introduce SciANN, a Python package for scientific computing and physics-informed deep learning using artificial neural networks. SciANN uses the widely used deep-learning packages TensorFlow and Keras to build deep neural networks and optimization models, thus inheriting many of Keras's functionalities, such as batch optimization and model reuse for transfer learning. SciANN is designed to abstract neural network construction for scientific computations and solution and discovery of partial differential equations (PDE) using the physics-informed neural networks (PINN) architecture, therefore providing the flexibility to set up complex functional forms. We illustrate, in a series of examples, how the framework can be used for curve fitting on discrete data, and for solution and discovery of PDEs in strong and weak forms. We summarize the features currently available in SciANN, and also outline ongoing and future developments. (C) 2020 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Engineering, Multidisciplinary

A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics

Ehsan Haghighat, Maziar Raissi, Adrian Moure, Hector Gomez, Ruben Juanes

Summary: This study presents the application of Physics Informed Neural Networks (PINN) in solid mechanics, improving accuracy and convergence with a multi-network model and Isogeometric Analysis. The study demonstrates the importance of honoring physics in improving robustness and highlights the potential application of PINN in sensitivity analysis and surrogate modeling.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2021)

Article Engineering, Multidisciplinary

Physics-informed neural network for modelling the thermochemical curing process of composite-tool systems during manufacture

Sina Amini Niaki, Ehsan Haghighat, Trevor Campbell, Anoush Poursartip, Reza Vaziri

Summary: The study introduces a Physics-Informed Neural Network (PINN) to simulate the thermal-chemical evolution of a composite material curing in an autoclave. By optimizing deep neural network (DNN) parameters using a physics-based loss function, the research solves coupled differential equations, designs a PINN with two disconnected subnetworks, and develops a sequential training algorithm. The approach incorporates explicit discontinuities at the composite-tool interface and enforces known physical behavior in the loss function to enhance solution accuracy.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2021)

Article Engineering, Multidisciplinary

A nonlocal physics-informed deep learning framework using the peridynamic differential operator

Ehsan Haghighat, Ali Can Bekar, Erdogan Madenci, Ruben Juanes

Summary: The Physics-Informed Neural Network (PINN) framework combines physics with deep learning to solve PDEs and identify parameters. A nonlocal PINN approach with long-range interactions shows superior performance in solution accuracy and parameter inference compared to local approaches.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2021)

Article Computer Science, Interdisciplinary Applications

PINNeik: Eikonal solution using physics-informed neural networks

Umair bin Waheed, Ehsan Haghighat, Tariq Alkhalifah, Chao Song, Qi Hao

Summary: The proposed algorithm based on physics-informed neural networks offers a high traveltime accuracy for a wide range of applications in seismology. It leverages machine learning techniques like transfer learning and surrogate modeling to speed up computations for updated velocity models and source locations. The method's flexibility in incorporating various physical properties and improving convergence rate makes it an efficient forward modeling engine for seismological applications.

COMPUTERS & GEOSCIENCES (2021)

Article Mechanics

A computational framework for meso and macroscale analysis of structural masonry

K. Koocheki, S. Pietruszczak, E. Haghighat

Summary: In this study, a computational framework is proposed to model the mechanical response of structural masonry at both meso and macroscale. The framework can adequately predict the load-deformation response and fracture pattern of masonry. An anisotropy parameter is introduced in the macroscale approach, and the material parameters are identified using "virtual data" generated from mesoscale analysis.

INTERNATIONAL JOURNAL OF SOLIDS AND STRUCTURES (2022)

Article Engineering, Mechanical

A Physics-Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity

Mohammad Vahab, Ehsan Haghighat, Maryam Khaleghi, Nasser Khalili

Summary: We explore the application of Physics-Informed Neural Networks (PINNs) with Airy stress functions and Fourier series in finding optimal solutions to reference biharmonic problems in elasticity and elastic plate theory. Our work demonstrates a novel application of classical analytical methods in constructing efficient neural networks with minimal parameters, which are accurate and fast in evaluation. We find that enriching the feature space with Airy stress functions can significantly improve the accuracy of PINN solutions for biharmonic PDEs.

JOURNAL OF ENGINEERING MECHANICS (2022)

Article Engineering, Multidisciplinary

On the solution of hyperbolic equations using the peridynamic differential operator

Ali Can Bekar, Erdogan Madenci, Ehsan Haghighat

Summary: This study introduces a generalized upwind scheme called directional nonlocality for the numerical solution of linear and nonlinear hyperbolic PDEs. By introducing an internal length parameter and a weight function, this method achieves stable discretization of hyperbolic PDEs and constructs solutions that compare well with analytical/reference solutions.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2022)

Article Engineering, Multidisciplinary

Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential training

Ehsan Haghighat, Danial Amini, Ruben Juanes

Summary: This paper presents a physics-informed neural network (PINN) approach for solving the equations of coupled flow and deformation in porous media. Incorporating multiple differential relations into the loss function can lead to an unstable optimization problem due to the dynamics of the problem. A dimensionless form of the coupled governing equations is proposed, and a sequential training approach based on stress-split algorithms is introduced.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2022)

Article Engineering, Mechanical

Energy-Based Error Bound of Physics-Informed Neural Network Solutions in Elasticity

Mengwu Guo, Ehsan Haghighat

Summary: An energy-based a posteriori error bound is proposed for the physics-informed neural network solutions of elasticity problems. The error bound is formulated as the constitutive relation error defined by the solution pair. It provides an upper bound of the global error of neural network discretization and studies the bounding property and asymptotic behavior of the physics-informed neural network solutions.

JOURNAL OF ENGINEERING MECHANICS (2022)

Article Engineering, Mechanical

Physics-Informed Neural Network Solution of Thermo-Hydro-Mechanical Processes in Porous Media

Danial Amini, Ehsan Haghighat, Rubn Juanes

Summary: This study investigates the application of physics-informed neural networks (PINNs) to the forward solution of thermo-hydro-mechanical (THM) problems in porous media. To address the challenges of multiphysics problems, the researchers propose dimensionless governing equations, a sequential training strategy, and adaptive weight strategies.

JOURNAL OF ENGINEERING MECHANICS (2022)

Article Mathematics, Interdisciplinary Applications

An efficient phase-field model of shear fractures using deviatoric stress split

Ehsan Haghighat, David Santillan

Summary: We introduce a phase-field model that utilizes the deviatoric stress decomposition to represent shear fractures. This approach allows us to incorporate the general three-dimensional Mohr-Coulomb failure function for establishing relationships and evaluating peak and residual stresses. Our model demonstrates impressive performance in several benchmark problems involving shear fracture and strain localization. It successfully captures the conjugate failure modes during biaxial compression tests and addresses the challenging slope stability problem faced by most geomechanics models.

COMPUTATIONAL MECHANICS (2023)

Article Engineering, Multidisciplinary

An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator

Arda Mavi, Ali Can Bekar, Ehsan Haghighat, Erdogan Madenci

Summary: This study proposes a novel unsupervised convolutional Neural Network (NN) architecture with nonlocal interactions for solving Partial Differential Equations (PDEs). It employs the nonlocal Peridynamic Differential Operator (PDDO) as a convolutional filter to evaluate derivatives of the field variable. The NN captures time dynamics in a smaller latent space through encoder-decoder layers with a modified Convolutional Long-short Term Memory (ConvLSTM) layer.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2023)

Article Automation & Control Systems

Constitutive model characterization and discovery using physics-informed deep learning

Ehsan Haghighat, Sahar Abouali, Reza Vaziri

Summary: Constitutive models are fundamental in modeling physical processes by connecting conservation laws with system kinematics. However, characterizing these models can be challenging, especially in nonlinear regimes. We believe that theory-based parametric elastoplastic models are still the most efficient and predictive.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2023)

Article Mechanics

Application of Physics-Informed Neural Networks for forward and inverse analysis of pile-soil interaction

M. Vahab, B. Shahbodagh, E. Haghighat, N. Khalili

Summary: This paper presents the application of Physics-Informed Neural Networks (PINNs) in the forward and inverse analysis of pile-soil interaction problems. The main challenge in the Artificial Neural Network (ANN) modeling of such interaction is the abrupt changes in material properties that cause discontinuities in displacement solution gradient. To address this, a domain-decomposition multi-network model is proposed to handle the strain field discontinuities at common boundaries of pile-soil regions and soil layers. The model is demonstrated on the analysis and parametric study of single piles embedded in homogeneous and layered formations, under axisymmetric and plane strain conditions. The performance of the model in inverse analysis of pile-soil interaction is particularly investigated, showing successful inversion of soil parameters in layered formations using localized data obtained via fiber optic strain sensing along the pile length.

INTERNATIONAL JOURNAL OF SOLIDS AND STRUCTURES (2023)

Article Engineering, Multidisciplinary

Probabilistic physics-guided transfer learning for material property prediction in extrusion deposition additive manufacturing

Akshay J. Thomas, Mateusz Jaszczuk, Eduardo Barocio, Gourab Ghosh, Ilias Bilionis, R. Byron Pipes

Summary: We propose a physics-guided transfer learning approach to predict the thermal conductivity of additively manufactured short-fiber reinforced polymers using micro-structural characteristics obtained from tensile tests. A Bayesian framework is developed to transfer the thermal conductivity properties across different extrusion deposition additive manufacturing systems. The experimental results demonstrate the effectiveness and reliability of our method in accounting for epistemic and aleatory uncertainties.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Discovering a reaction-diffusion model for Alzheimer's disease by combining PINNs with symbolic regression

Zhen Zhang, Zongren Zou, Ellen Kuhl, George Em Karniadakis

Summary: In this study, deep learning and artificial intelligence were used to discover a mathematical model for the progression of Alzheimer's disease. By analyzing longitudinal tau positron emission tomography data, a reaction-diffusion type partial differential equation for tau protein misfolding and spreading was discovered. The results showed different misfolding models for Alzheimer's and healthy control groups, indicating faster misfolding in Alzheimer's group. The study provides a foundation for early diagnosis and treatment of Alzheimer's disease and other misfolding-protein based neurodegenerative disorders using image-based technologies.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

A neural network-based enrichment of reproducing kernel approximation for modeling brittle fracture

Jonghyuk Baek, Jiun-Shyan Chen

Summary: This paper introduces an improved neural network-enhanced reproducing kernel particle method for modeling the localization of brittle fractures. By adding a neural network approximation to the background reproducing kernel approximation, the method allows for the automatic location and insertion of discontinuities in the function space, enhancing the modeling effectiveness. The proposed method uses an energy-based loss function for optimization and regularizes the approximation results through constraints on the spatial gradient of the parametric coordinates, ensuring convergence.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Stabilized mixed material point method for incompressible fluid flow

Bodhinanda Chandra, Ryota Hashimoto, Shinnosuke Matsumi, Ken Kamrin, Kenichi Soga

Summary: This paper proposes new and robust stabilization strategies for accurately modeling incompressible fluid flow problems in the material point method (MPM). The proposed approach adopts a monolithic displacement-pressure formulation and integrates two stabilization strategies to ensure stability. The effectiveness of the proposed method is validated through benchmark cases and real-world scenarios involving violent free-surface fluid motion.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

A unified analytical expression of the tangent stiffness matrix of holonomic constraints

Chao Peng, Alessandro Tasora, Dario Fusai, Dario Mangoni

Summary: This article discusses the importance of the tangent stiffness matrix of constraints in multibody systems and provides a general formulation based on quaternion parametrization. The article also presents the analytical expression of the tangent stiffness matrix derived through linearization. Examples demonstrate the positive effect of this additional stiffness term on static and eigenvalue analyses.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

On the detection of nonlinear normal mode-related isolated branches of periodic solutions for high-dimensional nonlinear mechanical systems with frictionless contact interfaces

Thibaut Vadcard, Fabrice Thouverez, Alain Batailly

Summary: This contribution presents a methodology for detecting isolated branches of periodic solutions to nonlinear mechanical equations. The method combines harmonic balance method-based solving procedure with the Melnikov energy principle. It is able to predict the location of isolated branches of solutions near families of autonomous periodic solutions. The relevance and accuracy of this methodology are demonstrated through academic and industrial applications.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Machine learning powered sketch aided design via topology optimization

Weisheng Zhang, Yue Wang, Sung-Kie Youn, Xu Guo

Summary: This study proposes a sketch-guided topology optimization approach based on machine learning, which incorporates computer sketches as constraint functions to improve the efficiency of computer-aided structural design models and meet the design intention and requirements of designers.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Reduced order isogeometric boundary element methods for CAD-integrated shape optimization in electromagnetic scattering

Leilei Chen, Zhongwang Wang, Haojie Lian, Yujing Ma, Zhuxuan Meng, Pei Li, Chensen Ding, Stephane P. A. Bordas

Summary: This paper presents a model order reduction method for electromagnetic boundary element analysis and extends it to computer-aided design integrated shape optimization of multi-frequency electromagnetic scattering problems. The proposed method utilizes a series expansion technique and the second-order Arnoldi procedure to reduce the order of original systems. It also employs the isogeometric boundary element method to ensure geometric exactness and avoid re-meshing during shape optimization. The Grey Wolf Optimization-Artificial Neural Network is used as a surrogate model for shape optimization, with radar cross section as the objective function.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Volume conservation issue within SPH models for long-time simulations of violent free-surface flows

C. Pilloton, P. N. Sun, X. Zhang, A. Colagrossi

Summary: This paper investigates the smoothed particle hydrodynamics (SPH) simulations of violent sloshing flows and discusses the impact of volume conservation errors on the simulation results. Different techniques are used to directly measure the particles' volumes and stabilization terms are introduced to control the errors. Experimental comparisons demonstrate the effectiveness of the numerical techniques.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Convolution finite element based digital image correlation for and strain measurements

Ye Lu, Weidong Zhu

Summary: This work presents a novel global digital image correlation (DIC) method based on a convolution finite element (C-FE) approximation. The C-FE based DIC provides highly smooth and accurate displacement and strain results with the same element size as the usual finite element (FE) based DIC. The proposed method's formulation and implementation, as well as the controlling parameters, have been discussed in detail. The C-FE method outperformed the FE method in all tested examples, demonstrating its potential for highly smooth, accurate, and robust DIC analysis.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Optimization based on performance of lungs in body: Lungs performance-based optimization (LPO)

Mojtaba Ghasemi, Mohsen Zare, Amir Zahedi, Pavel Trojovsky, Laith Abualigah, Eva Trojovska

Summary: This paper introduces Lung performance-based optimization (LPO), a novel algorithm that draws inspiration from the efficient oxygen exchange in the lungs. Through experiments and comparisons with contemporary algorithms, LPO demonstrates its effectiveness in solving complex optimization problems and shows potential for a wide range of applications.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Integrated optimization of components' layout and structural topology with considering the interface stress constraint

Jingyu Hu, Yang Liu, Huixin Huang, Shutian Liu

Summary: In this study, a new topology optimization method is proposed for structures with embedded components, considering the tension/compression asymmetric interface stress constraint. The method optimizes the topology of the host structure and the layout of embedded components simultaneously, and a new interpolation model is developed to determine interface layers between the host structure and embedded components.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

The anisotropic graph neural network model with multiscale and nonlinear characteristic for turbulence simulation

Qiang Liu, Wei Zhu, Xiyu Jia, Feng Ma, Jun Wen, Yixiong Wu, Kuangqi Chen, Zhenhai Zhang, Shuang Wang

Summary: In this study, a multiscale and nonlinear turbulence characteristic extraction model using a graph neural network was designed. This model can directly compute turbulence data without resorting to simplified formulas. Experimental results demonstrate that the model has high computational performance in turbulence calculation.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Multi-temporal decomposition for elastoplastic ratcheting solids

Jacinto Ulloa, Geert Degrande, Jose E. Andrade, Stijn Francois

Summary: This paper presents a multi-temporal formulation for simulating elastoplastic solids under cyclic loading. The proper generalized decomposition (PGD) is leveraged to decompose the displacements into multiple time scales, separating the spatial and intra-cyclic dependence from the inter-cyclic variation, thereby reducing computational burden.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)

Article Engineering, Multidisciplinary

Automated translation and accelerated solving of differential equations on multiple GPU platforms

Utkarsh Utkarsh, Valentin Churavy, Yingbo Ma, Tim Besard, Prakitr Srisuma, Tim Gymnich, Adam R. Gerlach, Alan Edelman, George Barbastathis, Richard D. Braatz, Christopher Rackauckas

Summary: This article presents a high-performance vendor-agnostic method for massively parallel solving of ordinary and stochastic differential equations on GPUs. The method integrates with a popular differential equation solver library and achieves state-of-the-art performance compared to hand-optimized kernels.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2024)