Learn-to-Recover: Retrofitting UAVs with Reinforcement Learning-Assisted Flight Control Under Cyber-Physical Attacks
Authors:
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7358-7364
Abstract
In this paper, we present a generic fault-tolerant control (FTC) strategy via reinforcement learning (RL). We demonstrate the effectiveness of this method on quadcopter unmanned aerial vehicles (UAVs). The fault-tolerant control policy is trained to handle actuator and sensor fault/attack. Unlike traditional FTC, this policy does not require fault detection and diagnosis (FDD) nor tailoring the controller for specific attack scenarios. Instead, the policy is running simultaneously alongside the stabilizing controller without the need for on- detection activation. The effectiveness of the policy is compared with traditional active and passive FTC strategies against actuator and sensor faults. We compare their performance in position control tasks via simulation and experiments on quadcopters. The result shows that the strategy can effectively tolerate different types of attacks/faults and maintain the vehicle's position, outperforming the other two methods.Keywords
This publication has 26 references indexed in Scilit:
- Continuous reinforcement learning to robust fault tolerant control for a class of unknown nonlinear systemsApplied Soft Computing, 2015
- Fault diagnosis and fault-tolerant control strategy for rotor failure in an octorotor2015
- Stability and control of a quadrocopter despite the complete loss of one, two, or three propellers2014
- Fault Estimation for a Quad-Rotor MAV Using a Polynomial ObserverJournal of Intelligent & Robotic Systems, 2013
- Cyber Attack Vulnerabilities Analysis for Unmanned Aerial Vehicles2012
- Active Fault Tolerant Control of a quadrotor UAV based on gainscheduled PID control2012
- Gain Scheduling Based PID Controller for Fault Tolerant Control of Quad-Rotor UAV2010
- Bibliographical review on reconfigurable fault-tolerant control systemsAnnual Reviews in Control, 2008
- Sensor and actuator fault detection in small autonomous helicoptersMechatronics, 2008
- On the effectiveness of address-space randomization2004