AI summary · arXiv: 2304.02282v1 · math.NA

About optimal loss function for training physics-informed neural networks under respecting causality

Vasiliy A. Es'kin, Danil V. Davydov, Ekaterina D. Egorova, Alexey O. Malkhanov, Mikhail A. Akhukov, Mikhail E. Smorkalov
Original paper Submitted to arXiv on 05 Apr. 2023 25 pages, 7 figures, 6 tables License: CC BY 4.0

How to read this summary? Illustrated guide

The essentials

  • Machine learning has made significant advancements in the last decade, particularly in deep learning.
  • Applications created using machine learning can be comparable or superior to humans in many fields of activity.
  • Three categories of auxiliary systems are used for solving scientific problems: those trained using previously obtained data, those leveraging previously established physical laws, and those utilizing both approaches.
  • Physics-informed neural networks (PINNs) leverage previously established physical laws to solve problems described by differential equations with initial and boundary conditions.
  • The PINN approach involves training a neural network to approximate the dependences of physical values on spatial and temporal coordinates for a given problem.
  • Hyperparameters and architecture need to be adapted for each new problem.
  • Techniques have been developed to improve the accuracy of neural networks trained using the PINN approach, including reducing a problem described by differential equations with initial and boundary conditions to one described only by differential equations and modifying weighted loss functions respecting causality based on generalized functions derived from these modifications.
  • Numerical experiments were carried out for various problems demonstrating the accuracy of these proposed methods.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: Physics-informed Neural Networks

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
Over the last decade, there have been significant advancements in the field of machine learning, particularly in deep learning. These developments have led to the creation of applications that are comparable or superior to humans in many fields of activity. One such area is the use of machine learning for scientific problem-solving. There are three categories of auxiliary systems for solving scientific problems: those trained using previously obtained data, those leveraging previously established physical laws, and those utilizing both approaches. This paper focuses on physics-informed neural networks (PINNs), which leverage previously established physical laws to solve a wide range of problems described by differential equations with initial and boundary conditions. The PINN approach involves training a neural network to approximate the dependences of physical values on spatial and temporal coordinates for a given problem. However, it is often necessary to adapt hyperparameters and architecture for each new problem. The paper presents several techniques that can improve the accuracy of neural networks trained using the PINN approach. Firstly, a method is presented that allows reducing a problem described by differential equations with initial and boundary conditions to one described only by differential equations. This modification enables representing the loss function in the form of a single term associated with differential equations, eliminating the need to tune scaling coefficients for terms related to boundary and initial conditions. Secondly, weighted loss functions respecting causality were modified based on generalized functions derived from these modifications. Numerical experiments were carried out for various problems demonstrating the accuracy of these proposed methods. Overall, this work contributes significantly towards improving physics-informed neural networks' efficiency by providing clear and transparent methods for weighting coefficients in general loss functions and designing neural network architectures specific to each problem.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Related
    An overview on deep learning-based approximation methods for partial differential equations
    Christian Beck, Martin Hutzenthaler, Arnulf Jentzen et al. · 2020 · Discrete Contin. Dyn. Syst. Ser. B 28 (2023), no. 6, 3697-3746 · AI summary available
    Abstract

    It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem have been proposed and tested numerically on a number of examples of high-dimensional PDEs. This has given rise to a lively field of research in which deep learning-based methods and related Monte Carlo methods are applied to the approximation of high-dimensional PDEs. In this article we offer an introduction to this field of research by revisiting selected mathematical results related to deep learning approximation methods for PDEs and reviewing the main ide…

  2. Related
    A robust solution strategy for the Cahn-Larché equations
    Erlend Storvik, Jakub Wiktor Both, Jan Martin Nordbotten et al. · 2022 · Numerical Analysis · AI summary available
    Abstract

    In this paper we propose a solution strategy for the Cahn-Larch\'e equations, which is a model for linearized elasticity in a medium with two elastic phases that evolve subject to a Ginzburg-Landau type energy functional. The system can be seen as a combination of the Cahn-Hilliard regularized interface equation and linearized elasticity, and is non-linearly coupled, has a fourth order term that comes from the Cahn-Hilliard subsystem, and is non-convex and nonlinear in both the phase-field and displacement variables. We propose a novel semi-implicit discretization in time that uses a standard convex-concave splitting method of the nonlinear double-well potential, as well as special treatment…

  3. Related
    A Computationally Efficient Vectorized Implementation of Localizing Gradient Damage Method in MATLAB
    Subrato Sarkar · 2023 · Numerical Analysis · AI summary available
    Abstract

    In this work, a recently developed fracture modeling method called localizing gradient damage method (LGDM) is implemented in MATLAB. MATLAB is well-known in the computational research community for its simple and easy-to-learn coding interface. As a result, MATLAB is generally preferred for the initial development (prototyping) of computational models by researchers. However, MATLAB-developed codes are seldom used for large-scale simulations (after initial development is complete) due to their computational inefficiency. Hence, a computationally efficient implementation of LGDM using MATLAB vectorization is presented in this work. The choice of LGDM (as the fracture modeling method) is base…

  4. Related
    Solving Backward Doubly Stochastic Differential Equations through Splitting Schemes
    Feng Bao, Yanzhao Cao, He Zhang · 2021 · Numerical Analysis · AI summary available
    Abstract

    A splitting scheme for backward doubly stochastic differential equations is proposed. The main idea is to decompose a backward doubly stochastic differential equation into a backward stochastic differential equation and a stochastic differential equation. The backward stochastic differential equation and the stochastic differential equation are then approximated by first order finite difference schemes, which results in a first order scheme for the backward doubly stochastic differential equation. Numerical experiments are conducted to illustrate the convergence rate of the proposed scheme.

  5. Related
    Provably stable numerical method for the anisotropic diffusion equation in toroidally confined magnetic fields
    Dean Muir, Kenneth Duru, Matthew Hole et al. · 2023 · Numerical Analysis · AI summary available
    Abstract

    We present a novel numerical method for solving the anisotropic diffusion equation in toroidally confined magnetic fields which is efficient, accurate and provably stable. The continuous problem is written in terms of a derivative operator for the perpendicular transport and a linear operator, obtained through field line tracing, for the parallel transport. We derive energy estimates of the solution of the continuous initial boundary value problem. A discrete formulation is presented using operator splitting in time with the summation by parts finite difference approximation of spatial derivatives for the perpendicular diffusion operator. Weak penalty procedures are derived for implementing …

  6. Related
    Smooth multi-patch scaled boundary isogeometric analysis for Kirchhoff-Love shells
    Mathias Reichle, Jeremias Arf, Bernd Simeon et al. · 2023 · Numerical Analysis · AI summary available
    Abstract

    In this work, a linear Kirchhoff-Love shell formulation in the framework of scaled boundary isogeometric analysis is presented that aims to provide a simple approach to trimming for NURBS-based shell analysis. To obtain a global C1-regular test function space for the shell discretization, an inter-patch coupling is applied with adjusted basis functions in the vicinity of the scaling center to ensure the approximation ability. Doing so, the scaled boundary geometries are related to the concept of analysis-suitable G1 parametrizations. This yields a coupling of patch boundaries in a strong sense that is restricted to G1-smooth surfaces. The proposed approach is advantageous to trimmed geometri…

  7. Related
    Convergence of an adaptive $C^0$-interior penalty Galerkin method for the biharmonic problem
    Alexander Dominicus, Fernando Gaspoz, Christian Kreuzer · 2019 · Numerical Analysis · AI summary available
    Abstract

    We develop a basic convergence analysis for an adaptive $\textsf{C}^0\textsf{IPG}$ method for the Biharmonic problem, which provides convergence without rates for all practically relevant marking strategies and all penalty parameters assuring coercivity of the method. The analysis hinges on embedding properties of (broken) Sobolev and BV spaces, and the construction of a suitable limit space. In contrast to the convergence result of adaptive discontinuous Galerkin methods for elliptic PDEs, by Kreuzer and Georgoulis [Math. Comp. 87 (2018), no.~314, 2611--2640], here we have to deal with the fact that the Lagrange finite element spaces may possibly contain no proper $C^1$-conforming subspace.…

  8. Related
    The mpEDMD Algorithm for Data-Driven Computations of Measure-Preserving Dynamical Systems
    Matthew J. Colbrook · 2022 · Numerical Analysis · AI summary available
    Abstract

    Koopman operators globally linearize nonlinear dynamical systems and their spectral information is a powerful tool for the analysis and decomposition of nonlinear dynamical systems. However, Koopman operators are infinite-dimensional, and computing their spectral information is a considerable challenge. We introduce measure-preserving extended dynamic mode decomposition ($\texttt{mpEDMD}$), the first truncation method whose eigendecomposition converges to the spectral quantities of Koopman operators for general measure-preserving dynamical systems. $\texttt{mpEDMD}$ is a data-driven algorithm based on an orthogonal Procrustes problem that enforces measure-preserving truncations of Koopman op…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.