Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamics
Preprint
Abstract
A data-driven framework is proposed for the predictive modeling of complex spatio-temporal dynamics, leveraging nested non-linear manifolds. Three levels of neural networks are used, with the goal of predicting the future state of a system of interest in a parametric setting. A convolutional autoencoder is used as the top level to encode the high dimensional input data along spatial dimensions into a sequence of latent variables. A temporal convolutional autoencoder serves as the second level, which further encodes the output sequence from the first level along the temporal dimension, and outputs a set of latent variables that encapsulate the spatio-temporal evolution of the dynamics. A fully connected network is used as the third level to learn the mapping between these latent variables and the global parameters from training data, and predict them for new parameters. For future state predictions, the second level uses a temporal convolutional network to predict subsequent steps of the output sequence from the top level. Latent variables at the bottom-most level are decoded to obtain the dynamics in physical space at new global parameters and/or at a future time. The framework is evaluated on a range of problems involving discontinuities, wave propagation, strong transients, and coherent structures. The sensitivity of the results to different modeling choices is assessed. The results suggest that given adequate data and careful training, effective data-driven predictive models can be constructed. Perspectives are provided on the present approach and its place in the landscape of model reduction.Keywords
All Related Versions
This publication has 44 references indexed in Scilit:
- Time-series machine-learning error models for approximate solutions to parameterized dynamical systemsComputer Methods in Applied Mechanics and Engineering, 2020
- The Adjoint Petrov–Galerkin method for non-linear model reductionComputer Methods in Applied Mechanics and Engineering, 2020
- Reduced order modeling for nonlinear structural analysis using Gaussian process regressionComputer Methods in Applied Mechanics and Engineering, 2018
- Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reductionJournal of Computational Physics, 2017
- Proper orthogonal decomposition closure models for turbulent flows: A numerical comparisonComputer Methods in Applied Mechanics and Engineering, 2012
- Two-level discretizations of nonlinear closure models for proper orthogonal decompositionJournal of Computational Physics, 2011
- Efficient non‐linear model reduction via a least‐squares Petrov–Galerkin projection and compressive tensor approximationsInternational Journal for Numerical Methods in Engineering, 2010
- Calibrated reduced-order POD-Galerkin system for fluid flow modellingJournal of Computational Physics, 2005
- An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equationsComptes Rendus Mathématique, 2004
- A survey of several finite difference methods for systems of nonlinear hyperbolic conservation lawsJournal of Computational Physics, 1978