BiLO: Bilevel Local Operator Learning for PDE inverse problems
Authors:
Preprint
Abstract
We propose a new neural network based method for solving inverse problems for partial differential equations (PDEs) by formulating the PDE inverse problem as a bilevel optimization problem. At the upper level, we minimize the data loss with respect to the PDE parameters. At the lower level, we train a neural network to locally approximate the PDE solution operator in the neighborhood of a given set of PDE parameters, which enables an accurate approximation of the descent direction for the upper level optimization problem. The lower level loss function includes the L2 norms of both the residual and its derivative with respect to the PDE parameters. We apply gradient descent simultaneously on both the upper and lower level optimization problems, leading to an effective and fast algorithm. The method, which we refer to as BiLO (Bilevel Local Operator learning), is also able to efficiently infer unknown functions in the PDEs through the introduction of an auxiliary variable. We demonstrate that our method enforces strong PDE constraints, is robust to sparse and noisy data, and eliminates the need to balance the residual and the data loss, which is inherent to soft PDE constraints.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Deep learning in computational mechanics: a reviewComputational Mechanics, 2024
- Discovering a reaction–diffusion model for Alzheimer’s disease by combining PINNs with symbolic regressionComputer Methods in Applied Mechanics and Engineering, 2023
- Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equationsAdvances in Computational Mathematics, 2023
- Semi-supervised invertible neural operators for Bayesian inverse problemsComputational Mechanics, 2023
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networksComputer Methods in Applied Mechanics and Engineering, 2022
- Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemsComputer Methods in Applied Mechanics and Engineering, 2022
- Exact imposition of boundary conditions with distance functions in physics-informed deep neural networksComputer Methods in Applied Mechanics and Engineering, 2022
- A method for representing periodic functions and enforcing exactly periodic boundary conditions with deep neural networksJournal of Computational Physics, 2021
- B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy dataJournal of Computational Physics, 2021
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equationsJournal of Computational Physics, 2019