Deep Theory of Functional Connections: A New Method for Estimating the Solutions of Partial Differential Equations
Open Access
- 12 March 2020
- journal article
- research article
- Published by MDPI AG in Machine Learning and Knowledge Extraction
- Vol. 2 (1) , 37-55
Abstract
This article presents a new methodology called Deep Theory of Functional Connections (TFC) that estimates the solutions of partial differential equations (PDEs) by combining neural networks with the TFC. The TFC is used to transform PDEs into unconstrained optimization problems by analytically embedding the PDE’s constraints into a “constrained expression” containing a free function. In this research, the free function is chosen to be a neural network, which is used to solve the now unconstrained optimization problem. This optimization problem consists of minimizing a loss function that is chosen to be the square of the residuals of the PDE. The neural network is trained in an unsupervised manner to minimize this loss function. This methodology has two major differences when compared with popular methods used to estimate the solutions of PDEs. First, this methodology does not need to discretize the domain into a grid, rather, this methodology can randomly sample points from the domain during the training phase. Second, after training, this methodology produces an accurate analytical approximation of the solution throughout the entire training domain. Because the methodology produces an analytical solution, it is straightforward to obtain the solution at any point within the domain and to perform further manipulation if needed, such as differentiation. In contrast, other popular methods require extra numerical techniques if the estimated solution is desired at points that do not lie on the discretized grid, or if further manipulation to the estimated solution must be performed.Keywords
All Related Versions
Funding Information
- NSTRF (80NSSC19K1152)
This publication has 13 references indexed in Scilit:
- Analytically Embedding Differential Equation Constraints into Least Squares Support Vector Machines Using the Theory of Functional ConnectionsMachine Learning and Knowledge Extraction, 2019
- The Multivariate Theory of ConnectionsMathematics, 2019
- DGM: A deep learning algorithm for solving partial differential equationsJournal of Computational Physics, 2018
- The Theory of Connections: Connecting PointsMathematics, 2017
- Least-Squares Solution of Linear Differential EquationsMathematics, 2017
- An Introduction to Neural Network Methods for Differential Equations2015
- Extreme learning machine: Theory and applicationsNeurocomputing, 2006
- Artificial neural networks for solving ordinary and partial differential equationsIEEE Transactions on Neural Networks, 1998
- Stiffness and Deflection Analysis of Complex StructuresJournal of the Aeronautical Sciences, 1956
- Energy Theorems and Structural AnalysisAircraft Engineering and Aerospace Technology, 1954