Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
Authors:
Open Access
- 20 September 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-18
Abstract
Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differential equations. A major area of research on PINNs is the application to coupled partial differential equations in particular, and a general breakthrough is still lacking. In coupled equations, the optimization operates in a critical conflict between boundary conditions and the underlying equations, which often requires either many iterations or complex schemes to avoid trivial solutions and to achieve convergence. We provide empirical evidence for the mitigation of bad initial conditioning in PINNs for solving one-dimensional consolidation problems of porous media through the introduction of affine transformations after the classical output layer of artificial neural network architectures, effectively accelerating the training process. These affine physics-informed neural networks (AfPINNs) then produce nontrivial and accurate field solutions even in parameter spaces with diverging orders of magnitude. On average, AfPINNs show the ability to improve the $${\mathscr {L}}_2$$ relative error by $$64.84\%$$ after 25,000 epochs for a one-dimensional consolidation problem based on Biot’s theory, and an average improvement by $$58.80\%$$ with a transfer approach to the theory of porous media.
Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (465194077)
- Bundesministerium für Forschung, Technologie und Raumfahrt (031L0304A)
- Universität Stuttgart
This publication has 64 references indexed in Scilit:
- Concentration driven phase transitions in multiphase porous media with application to methane oxidation in landfill cover layersZAMM - Journal of Applied Mathematics and Mechanics / Zeitschrift für Angewandte Mathematik und Mechanik, 2013
- Analysis of non-linear consolidation of soft clay by differential quadrature methodApplied Clay Science, 2013
- Modeling fluid saturated porous media under frost attackGAMM-Mitteilungen, 2010
- A biphasic model for sinusoidal liver perfusion remodeling after outflow obstructionBiomechanics and Modeling in Mechanobiology, 2010
- A total stress-pore water pressure formulation of coupled consolidation analysis for saturated soilsInternational Journal of Geotechnical Engineering, 2009
- Multiphase flow in a capillary porous mediumComputational Materials Science, 2003
- Lower bounds for approximation by MLP neural networksNeurocomputing, 1999
- Artificial neural networks for solving ordinary and partial differential equationsIEEE Transactions on Neural Networks, 1998
- On stability and convergence of finite element approximations of Biot's consolidation problemInternational Journal for Numerical Methods in Engineering, 1994
- Consolidation Des Sols (Étude Mathématique)Géotechnique, 1953