Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
Top Cited Papers
Open Access
- 13 April 2022
- journal article
- research article
- Published by The Royal Society in Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Vol. 478 (2260) , 20210904
Abstract
Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of the nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world datasets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900 to 1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control.Keywords
Funding Information
- Army Research Office (ARO W911NF-19-1-0045)
- Air Force Office of Scientific Research (AFOSR FA9550-19-1-0386)
- National Science Foundation AI Institute in Dynamic Systems (Grant No. 112085)
This publication has 75 references indexed in Scilit:
- Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variabilityProceedings of the National Academy of Sciences, 2012
- Automated refinement and inference of analytical models for metabolic networksPhysical Biology, 2011
- Stability SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Dynamic mode decomposition of numerical and experimental dataJournal of Fluid Mechanics, 2010
- Spectral analysis of nonlinear flowsJournal of Fluid Mechanics, 2009
- Distilling Free-Form Natural Laws from Experimental DataScience, 2009
- Normal forms for reduced stochastic climate modelsProceedings of the National Academy of Sciences, 2009
- Nonlinear system modeling and predictive control using the RBF nets-based quasi-linear ARX modelControl Engineering Practice, 2009
- Automated reverse engineering of nonlinear dynamical systemsProceedings of the National Academy of Sciences, 2007
- Model predictive control: Theory and practice—A surveyAutomatica, 1989