-
A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domains
Authors:
Yusuke Yamazaki,
Ali Harandi,
Mayu Muramatsu,
Alexandre Viardin,
Markus Apel,
Tim Brepols,
Stefanie Reese,
Shahed Rezaei
Abstract:
We propose a novel finite element-based physics-informed operator learning framework that allows for predicting spatiotemporal dynamics governed by partial differential equations (PDEs). The proposed framework employs a loss function inspired by the finite element method (FEM) with the implicit Euler time integration scheme. A transient thermal conduction problem is considered to benchmark the per…
▽ More
We propose a novel finite element-based physics-informed operator learning framework that allows for predicting spatiotemporal dynamics governed by partial differential equations (PDEs). The proposed framework employs a loss function inspired by the finite element method (FEM) with the implicit Euler time integration scheme. A transient thermal conduction problem is considered to benchmark the performance. The proposed operator learning framework takes a temperature field at the current time step as input and predicts a temperature field at the next time step. The Galerkin discretized weak formulation of the heat equation is employed to incorporate physics into the loss function, which is coined finite operator learning (FOL). Upon training, the networks successfully predict the temperature evolution over time for any initial temperature field at high accuracy compared to the FEM solution. The framework is also confirmed to be applicable to a heterogeneous thermal conductivity and arbitrary geometry. The advantages of FOL can be summarized as follows: First, the training is performed in an unsupervised manner, avoiding the need for a large data set prepared from costly simulations or experiments. Instead, random temperature patterns generated by the Gaussian random process and the Fourier series, combined with constant temperature fields, are used as training data to cover possible temperature cases. Second, shape functions and backward difference approximation are exploited for the domain discretization, resulting in a purely algebraic equation. This enhances training efficiency, as one avoids time-consuming automatic differentiation when optimizing weights and biases while accepting possible discretization errors. Finally, thanks to the interpolation power of FEM, any arbitrary geometry can be handled with FOL, which is crucial to addressing various engineering application scenarios.
△ Less
Submitted 6 August, 2024; v1 submitted 20 May, 2024;
originally announced May 2024.
-
A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformations
Authors:
Shahed Rezaei,
Reza Najian Asl,
Shirko Faroughi,
Mahdi Asgharzadeh,
Ali Harandi,
Rasoul Najafi Koopas,
Gottfried Laschet,
Stefanie Reese,
Markus Apel
Abstract:
To obtain fast solutions for governing physical equations in solid mechanics, we introduce a method that integrates the core ideas of the finite element method with physics-informed neural networks and concept of neural operators. This approach generalizes and enhances each method, learning the parametric solution for mechanical problems without relying on data from other resources (e.g. other num…
▽ More
To obtain fast solutions for governing physical equations in solid mechanics, we introduce a method that integrates the core ideas of the finite element method with physics-informed neural networks and concept of neural operators. This approach generalizes and enhances each method, learning the parametric solution for mechanical problems without relying on data from other resources (e.g. other numerical solvers). We propose directly utilizing the available discretized weak form in finite element packages to construct the loss functions algebraically, thereby demonstrating the ability to find solutions even in the presence of sharp discontinuities. Our focus is on micromechanics as an example, where knowledge of deformation and stress fields for a given heterogeneous microstructure is crucial for further design applications. The primary parameter under investigation is the Young's modulus distribution within the heterogeneous solid system. Our investigations reveal that physics-based training yields higher accuracy compared to purely data-driven approaches for unseen microstructures. Additionally, we offer two methods to directly improve the process of obtaining high-resolution solutions, avoiding the need to use basic interpolation techniques. First is based on an autoencoder approach to enhance the efficiency for calculation on high resolution grid point. Next, Fourier-based parametrization is utilized to address complex 2D and 3D problems in micromechanics. The latter idea aims to represent complex microstructures efficiently using Fourier coefficients. Comparisons with other well-known operator learning algorithms, further emphasize the advantages of the newly proposed method.
△ Less
Submitted 3 June, 2024; v1 submitted 28 March, 2024;
originally announced April 2024.
-
Learning solution of nonlinear constitutive material models using physics-informed neural networks: COMM-PINN
Authors:
Shahed Rezaei,
Ahmad Moeineddin,
Ali Harandi
Abstract:
We applied physics-informed neural networks to solve the constitutive relations for nonlinear, path-dependent material behavior. As a result, the trained network not only satisfies all thermodynamic constraints but also instantly provides information about the current material state (i.e., free energy, stress, and the evolution of internal variables) under any given loading scenario without requir…
▽ More
We applied physics-informed neural networks to solve the constitutive relations for nonlinear, path-dependent material behavior. As a result, the trained network not only satisfies all thermodynamic constraints but also instantly provides information about the current material state (i.e., free energy, stress, and the evolution of internal variables) under any given loading scenario without requiring initial data. One advantage of this work is that it bypasses the repetitive Newton iterations needed to solve nonlinear equations in complex material models. Additionally, strategies are provided to reduce the required order of derivative for obtaining the tangent operator. The trained model can be directly used in any finite element package (or other numerical methods) as a user-defined material model. However, challenges remain in the proper definition of collocation points and in integrating several non-equality constraints that become active or non-active simultaneously. We tested this methodology on rate-independent processes such as the classical von Mises plasticity model with a nonlinear hardening law, as well as local damage models for interface cracking behavior with a nonlinear softening law. In order to demonstrate the applicability of the methodology in handling complex path dependency in a three-dimensional (3D) scenario, we tested the approach using the equations governing a damage model for a three-dimensional interface model. Such models are frequently employed for intergranular fracture at grain boundaries. We have observed a perfect agreement between the results obtained through the proposed methodology and those obtained using the classical approach. Furthermore, the proposed approach requires significantly less effort in terms of implementation and computing time compared to the traditional methods.
△ Less
Submitted 6 September, 2023; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains
Authors:
Ali Harandi,
Ahmad Moeineddin,
Michael Kaliske,
Stefanie Reese,
Shahed Rezaei
Abstract:
Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have shown that when designing loss functions for many engineering problems, using first-order derivatives and combining equations from both strong and weak forms ca…
▽ More
Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have shown that when designing loss functions for many engineering problems, using first-order derivatives and combining equations from both strong and weak forms can lead to much better accuracy, especially when there are heterogeneity and variable jumps in the domain. This new approach is called the mixed formulation for PINNs, which takes ideas from the mixed finite element method. In this method, the PDE is reformulated as a system of equations where the primary unknowns are the fluxes or gradients of the solution, and the secondary unknowns are the solution itself. In this work, we propose applying the mixed formulation to solve multi-physical problems, specifically a stationary thermo-mechanically coupled system of equations. Additionally, we discuss both sequential and fully coupled unsupervised training and compare their accuracy and computational cost. To improve the accuracy of the network, we incorporate hard boundary constraints to ensure valid predictions. We then investigate how different optimizers and architectures affect accuracy and efficiency. Finally, we introduce a simple approach for parametric learning that is similar to transfer learning. This approach combines data and physics to address the limitations of PINNs regarding computational cost and improves the network's ability to predict the response of the system for unseen cases. The outcomes of this work will be useful for many other engineering applications where deep learning is employed on multiple coupled systems of equations for fast and reliable computations.
△ Less
Submitted 6 September, 2023; v1 submitted 9 February, 2023;
originally announced February 2023.
-
A mixed formulation for physics-informed neural networks as a potential solver for engineering problems in heterogeneous domains: comparison with finite element method
Authors:
Shahed Rezaei,
Ali Harandi,
Ahmad Moeineddin,
Bai-Xiang Xu,
Stefanie Reese
Abstract:
Physics-informed neural networks (PINNs) are capable of finding the solution for a given boundary value problem. We employ several ideas from the finite element method (FEM) to enhance the performance of existing PINNs in engineering problems. The main contribution of the current work is to promote using the spatial gradient of the primary variable as an output from separated neural networks. Late…
▽ More
Physics-informed neural networks (PINNs) are capable of finding the solution for a given boundary value problem. We employ several ideas from the finite element method (FEM) to enhance the performance of existing PINNs in engineering problems. The main contribution of the current work is to promote using the spatial gradient of the primary variable as an output from separated neural networks. Later on, the strong form which has a higher order of derivatives is applied to the spatial gradients of the primary variable as the physical constraint. In addition, the so-called energy form of the problem is applied to the primary variable as an additional constraint for training. The proposed approach only required up to first-order derivatives to construct the physical loss functions. We discuss why this point is beneficial through various comparisons between different models. The mixed formulation-based PINNs and FE methods share some similarities. While the former minimizes the PDE and its energy form at given collocation points utilizing a complex nonlinear interpolation through a neural network, the latter does the same at element nodes with the help of shape functions. We focus on heterogeneous solids to show the capability of deep learning for predicting the solution in a complex environment under different boundary conditions. The performance of the proposed PINN model is checked against the solution from FEM on two prototype problems: elasticity and the Poisson equation (steady-state diffusion problem). We concluded that by properly designing the network architecture in PINN, the deep learning model has the potential to solve the unknowns in a heterogeneous domain without any available initial data from other sources. Finally, discussions are provided on the combination of PINN and FEM for a fast and accurate design of composite materials in future developments.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
Conditional Injective Flows for Bayesian Imaging
Authors:
AmirEhsan Khorashadizadeh,
Konik Kothari,
Leonardo Salsi,
Ali Aghababaei Harandi,
Maarten de Hoop,
Ivan Dokmanić
Abstract:
Most deep learning models for computational imaging regress a single reconstructed image. In practice, however, ill-posedness, nonlinearity, model mismatch, and noise often conspire to make such point estimates misleading or insufficient. The Bayesian approach models images and (noisy) measurements as jointly distributed random vectors and aims to approximate the posterior distribution of unknowns…
▽ More
Most deep learning models for computational imaging regress a single reconstructed image. In practice, however, ill-posedness, nonlinearity, model mismatch, and noise often conspire to make such point estimates misleading or insufficient. The Bayesian approach models images and (noisy) measurements as jointly distributed random vectors and aims to approximate the posterior distribution of unknowns. Recent variational inference methods based on conditional normalizing flows are a promising alternative to traditional MCMC methods, but they come with drawbacks: excessive memory and compute demands for moderate to high resolution images and underwhelming performance on hard nonlinear problems. In this work, we propose C-Trumpets -- conditional injective flows specifically designed for imaging problems, which greatly diminish these challenges. Injectivity reduces memory footprint and training time while low-dimensional latent space together with architectural innovations like fixed-volume-change layers and skip-connection revnet layers, C-Trumpets outperform regular conditional flow models on a variety of imaging and image restoration tasks, including limited-view CT and nonlinear inverse scattering, with a lower compute and memory budget. C-Trumpets enable fast approximation of point estimates like MMSE or MAP as well as physically-meaningful uncertainty quantification.
△ Less
Submitted 3 April, 2023; v1 submitted 15 April, 2022;
originally announced April 2022.
-
An anisotropic cohesive fracture model: advantages and limitations of length-scale insensitive phase-field damage models
Authors:
Shahed Rezaei,
Ali Harandi,
Tim Brepols,
Stefanie Reese
Abstract:
The goal of the current work is to explore direction-dependent damage initiation and propagation within an arbitrary anisotropic solid. In particular, we aim at developing anisotropic cohesive phase-field (PF) damage models by extending the idea introduced in \cite{REZAEI2021a} for direction-dependent fracture energy and also anisotropic PF damage models based on structural tensors. The cohesive P…
▽ More
The goal of the current work is to explore direction-dependent damage initiation and propagation within an arbitrary anisotropic solid. In particular, we aim at developing anisotropic cohesive phase-field (PF) damage models by extending the idea introduced in \cite{REZAEI2021a} for direction-dependent fracture energy and also anisotropic PF damage models based on structural tensors. The cohesive PF damage formulation used in the current contribution is motivated by the works of \cite{LORENTZ201120, wu2018, GEELEN2019}. The results of the latter models are shown to be insensitive with respect to the length scale parameter for the isotropic case. This is because they manage to formulate the fracture energy as a function of diffuse displacement jumps in the localized damaged zone. In the present paper, we discuss numerical examples and details on finite element implementations where the fracture energy, as well as the material strength, are introduced as an arbitrary function of the crack direction. Using the current formulation for anisotropic cohesive fracture, the obtained results are almost insensitive with respect to the length scale parameter. The latter is achieved by including the direction-dependent strength of the material in addition to its fracture energy. Utilizing the current formulation, one can increase the mesh size which reduces the computational time significantly without any severe change in the predicted crack path and overall obtained load-displacement curves. We also argue that these models still lack to capture mode-dependent fracture properties. Open issues and possible remedies for future developments are finally discussed as well.
△ Less
Submitted 28 August, 2021;
originally announced August 2021.
