Adaptive parameters identification for nonlinear dynamics using deep permutation invariant networks
Open Access
- 16 January 2025
- journal article
- research article
- Published by Springer Nature in Machine Learning
- Vol. 114 (1) , 1-36
Abstract
The promising outcomes of dynamical system identification techniques, such as SINDy (Brunton et al. in Proc Natl Acad Sci 113(15):3932–3937, 2016), highlight their advantages in providing qualitative interpretability and extrapolation compared to non-interpretable deep neural networks (Rudin in Nat Mach Intell 1(5):206–215, 2019). These techniques suffer from parameter updating in real-time use cases, especially when the system parameters are likely to change during or between processes. Recently, the OASIS (Bhadriraju et al. in AIChE J 66(11):16980, 2020) framework introduced a data-driven technique to address the limitations of real-time dynamical system parameters updating, yielding interesting results. Nevertheless, we show in this work that superior performance can be achieved using more advanced model architectures. We present an innovative encoding approach, based mainly on the use of Set Encoding methods of sequence data, which give accurate adaptive model identification for complex dynamic systems, with variable input time series length. Two Set Encoding methods are used: the first is Deep Set (Zaheer et al. in Adv Neural Inf Process Syst 30, 2017), and the second is Set Transformer (Lee et al. in: International conference on machine learning, PMLR, pp 3744–3753 2019). Comparing Set Transformer to OASIS framework on Lotka–Volterra for real-time local dynamical system identification and time series forecasting, we find that the Set Transformer architecture is well adapted to learning relationships within data sets. We then compare the two Set Encoding methods based on the Lorenz system for online global dynamical system identification. Finally, we trained a Deep Set model to perform identification and characterization of abnormalities for 1D heat-transfer problem.Keywords
All Related Versions
Funding Information
- Centrale Nantes
This publication has 29 references indexed in Scilit:
- Interpretable scientific discovery with symbolic regression: a reviewArtificial Intelligence Review, 2024
- Data driven discovery of systems of ordinary differential equations using nonconvex multitask learningMachine Learning, 2023
- Forecast evaluation for data scientists: common pitfalls and best practicesData Mining and Knowledge Discovery, 2022
- OASIS-P: Operable Adaptive Sparse Identification of Systems for fault Prognosis of chemical processesJournal of Process Control, 2021
- Physics-informed learning of governing equations from scarce dataNature Communications, 2021
- Operable adaptive sparse identification of systems: Application to chemical processesAIChE Journal, 2020
- PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep networkJournal of Computational Physics, 2019
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equationsJournal of Computational Physics, 2019
- Development of local dynamic mode decomposition with control: Application to model predictive control of hydraulic fracturingComputers & Chemical Engineering, 2017
- Sparse Identification of Nonlinear Dynamics with Control (SINDYc)**SLB acknowledges support from the U.S. Air Force Center of Excellence on Nature Inspired Flight Technologies and Ideas (FA9550-14-1-0398). JLP thanks Bill and Melinda Gates for their active support of the Institute of Disease Modeling and their sponsorship through the Global Good Fund. JNK acknowledges support from the U.S. Air Force Office of Scientific Research (FA9550-09-0174).IFAC-PapersOnLine, 2016