A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations
Authors:
Preprint
Abstract
Developing efficient numerical algorithms for high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality problem. We present a new framework for solving high-dimensional PDEs characterized by random parameters based on a deep learning approach. The random PDE is approximated by a feed-forward fully-connected deep neural network, with either strong or weak enforcement of initial and boundary constraints. The framework is mesh-free, and can handle irregular computational domains. Parameters of the approximating deep neural network are determined iteratively using variants of the Stochastic Gradient Descent (SGD) algorithm, which removes the memory issues that some existing algorithms for random PDEs are currently experiencing. The performance of the proposed framework in accurate estimation of solution to random PDEs is examined by implementing it for diffusion and heat conduction problems. Results are compared with the sampling-based finite element results, and suggest that the proposed framework achieves satisfactory accuracy and can handle high-dimensional random PDEs. A discussion on the advantages of the proposed method is also provided.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- DGM: A deep learning algorithm for solving partial differential equationsJournal of Computational Physics, 2018
- Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential EquationsCommunications in Mathematics and Statistics, 2017
- Neural network-based discretization of nonlinear differential equationsNeural Computing and Applications, 2017
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- A constrained integration (CINT) approach to solving partial differential equations using artificial neural networksNeurocomputing, 2015
- Numerical solution for high order differential equations using a hybrid neural network—Optimization methodApplied Mathematics and Computation, 2006
- Solution of nonlinear ordinary differential equations by feedforward neural networksMathematical and Computer Modelling, 1994
- The numerical solution of linear ordinary differential equations by feedforward neural networksMathematical and Computer Modelling, 1994
- Neural algorithm for solving differential equationsJournal of Computational Physics, 1990
- Probabilistic finite elements for nonlinear structural dynamicsComputer Methods in Applied Mechanics and Engineering, 1986