Space-Filling Regularization for Robust and Interpretable Nonlinear State Space Models
Preprint
Abstract
The state space dynamics representation is the most general approach for nonlinear systems and often chosen for system identification. During training, the state trajectory can deform significantly leading to poor data coverage of the state space. This can cause significant issues for space-oriented training algorithms which e.g. rely on grid structures, tree partitioning, or similar. Besides hindering training, significant state trajectory deformations also deteriorate interpretability and robustness properties. This paper proposes a new type of space-filling regularization that ensures a favorable data distribution in state space via introducing a data-distribution-based penalty. This method is demonstrated in local model network architectures where good interpretability is a major concern. The proposed approach integrates ideas from modeling and design of experiments for state space structures. This is why we present two regularization techniques for the data point distributions of the state trajectories for local affine state space models. Beyond that, we demonstrate the results on a widely known system identification benchmark.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Physics-Guided State-Space Model Augmentation Using Weighted Regularized Neural NetworksIFAC-PapersOnLine, 2024
- Space-filling optimized excitation signals for nonlinear system identification of dynamic processes of a diesel engineControl Engineering Practice, 2023
- Model Structures and Fitting Criteria for System Identification with Neural Networks2020
- Automatic Modeling with Local Model Networks for Benchmark ProcessesIFAC-PapersOnLine, 2017
- Three Benchmarks Addressing Open Challenges in Nonlinear System IdentificationIFAC-PapersOnLine, 2017
- Automated generation and comparison of Takagi–Sugeno and polytopic quasi-LPV modelsFuzzy Sets and Systems, 2015
- Identification of nonlinear systems using Polynomial Nonlinear State Space modelsAutomatica, 2010
- Subspace-based multivariable system identification from frequency response dataIEEE Transactions on Automatic Control, 1996
- A unifying theorem for three subspace system identification algorithmsAutomatica, 1995
- Nonlinear system identification using neural state space models, applicable to robust control designInternational Journal of Control, 1995