Data-Driven Model Predictive Control for Uncalibrated Visual Servoing
Open Access
Abstract
This paper addresses the image-based visual servoing (IBVS) control problem with an uncalibrated camera, unknown dynamics, and constraints. A novel data-driven uncalibrated IBVS (UIBVS) strategy is proposed, incorporated with the Koopman-based model predictive control (KMPC) algorithm and the adaptive robust Kalman filter (ARKF). First, to alleviate the need for calibration of the camera’s intrinsic and extrinsic parameters, the ARKF with an adaptive factor is utilized to estimate the image Jacobian matrix online, thereby eliminating the laborious camera calibration procedures and improving robustness against camera disturbances. Then, a data-driven MPC strategy is proposed, wherein the unknown nonlinear dynamic model is learned using the Koopman operator theory, resulting in a linear Koopman prediction model. Only input–output data are used to construct the prediction model, and hence, the proposed approach is robust against model uncertainties. Furthermore, with a symmetric quadratic cost function, the proposed approach solves the quadratic programming problem online, and visibility constraints as well as joint torque constraints are taken into account. As a result, the proposed KMPC scheme can be implemented in real time, and the UIBVS performance degradation which arises from the control torque constraints can be avoided. Simulations and comparisons for a 2-DOF robotic manipulator demonstrate the feasibility of the proposed approach. Simulation results further validate that the computation time of the proposed approach is comparable to the one of kinematic-based methods.Keywords
Funding Information
- Nanjing University of Aeronautics and Astronautics (xcxjh20221509)
This publication has 45 references indexed in Scilit:
- Learning dynamic models for open loop predictive control of soft robotic manipulatorsBioinspiration & Biomimetics, 2017
- Model-Based Control Using Koopman Operators2017
- Missile Control Parameters Estimation That Uses Robust Adaptive Kalman Filter Algorithm2016
- Histograms-Based Visual ServoingIEEE Robotics and Automation Letters, 2016
- A unified design method for adaptive visual tracking control of robots with eye-in-hand/fixed camera configurationAutomatica, 2015
- Gaussian Process-Based Predictive Control for Periodic Error CorrectionIEEE Transactions on Control Systems Technology, 2015
- Real-Time Inverse Optimal Neural Control for Image Based Visual Servoing with Nonholonomic Mobile RobotsMathematical Problems in Engineering, 2015
- Robust Kalman Filtering Cooperated Elman Neural Network Learning for Vision-Sensing-Based Robotic Manipulation with Global StabilitySensors, 2013
- Photometric Visual ServoingIEEE Transactions on Robotics, 2011
- Online estimation of image Jacobian matrix by Kalman-Bucy filter for uncalibrated stereo vision feedback2003