Data-Driven Optimal Control of Bilinear Systems
- 5 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 2479-2484
Abstract
This letter develops a method to learn optimal controls from data for bilinear systems without a priori knowledge of the dynamics. Given an unknown bilinear system, we characterize when the available data is sufficiently informative to solve the optimal control problem. This characterization leads us to propose an online control experiment design procedure that guarantees that any input/state trajectory can be represented as a linear combination of collected input/state data matrices. Leveraging this representation, we transform the original optimal control problem into an equivalent data-based optimization problem with bilinear constraints. We solve the latter by iteratively employing a convex-concave procedure to find a locally optimal control sequence. Simulations show that the performance of the proposed data-based approach is comparable with model-based methods.Keywords
All Related Versions
Funding Information
- Air Force Office of Scientific Research (FA9550-19-1-0235)
- NSF (2044900)
This publication has 28 references indexed in Scilit:
- Free-endpoint optimal control of inhomogeneous bilinear ensemble systemsAutomatica, 2018
- Data-Driven LQR Control DesignIEEE Control Systems Letters, 2018
- Fixed-Endpoint Optimal Control of Bilinear Ensemble SystemsSIAM Journal on Control and Optimization, 2017
- Gramian-Based Reachability Metrics for Bilinear NetworksIEEE Transactions on Control of Network Systems, 2016
- Variations and extension of the convex–concave procedureOptimization and Engineering, 2015
- From model-based control to data-driven control: Survey, classification and perspectiveInformation Sciences, 2013
- A note on persistency of excitationSystems & Control Letters, 2005
- The successive approximation procedure for finite-time optimal control of bilinear systemsIEEE Transactions on Automatic Control, 1994
- A method of Analytic Centers for Quadratically Constrained Convex Quadratic ProgramsSIAM Journal on Numerical Analysis, 1991
- Bilinear systems: An appealing class of "nearly linear" systems in theory and applicationsIEEE Transactions on Automatic Control, 1974