A Smart Flight Controller based on Reinforcement Learning for Unmanned Aerial Vehicle (UAV)
Authors:
- 13 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 203-208
Abstract
Traditional flight controllers consist of Proportional Integral Derivates (PID), that although have dominant stability control but required high human interventions. In this study, a smart flight controller is developed for controlling UAVs which produces operator less mechanisms for flight controllers. It uses a neural network that has been trained using reinforcement learning techniques. Engineered with a variety of actuators (pitch, yaw, roll, and speed), the next-generation flight controller is directly trained to control its own decisions in flight. It also optimizes learning algorithms different from the traditional Actor and Critic networks. The agent gets state information from the environment and calculates the reward function depending on the sensors data from the environment. The agent then receives the observations to identify the state and reward functions and the agent activates the algorithm to perform actions. It shows the performance of a trained neural network consisting of a reward function in both simulation and real-time UAV control. Experimental results show that it can respond with relative precision. Using the same framework shows that UAVs can reliably hover in the air, even under adverse initialization conditions with obstacles. Reward functions computed during the flight for 2500, 5000, 7500 and 10000 episodes between the normalized values 0 and −4000. The computation time observed during each episode is 15 micro sec.Keywords
Funding Information
- Ministry of Education
- Universiti Tun Hussein Onn Malaysia
This publication has 13 references indexed in Scilit:
- Breast Cancer Histological Images Nuclei Segmentation using Mask Regional Convolutional Neural Network2020
- Deep reinforcement learning for drone navigation using sensor dataNeural Computing and Applications, 2020
- Human-Computer Interaction using hand gestures2020
- Preliminary Design of a Robotic Exoskeleton for Arm RehabilitationJournal of Physics: Conference Series, 2018
- Hand Gesture Controlled Drones: An Open Source Library2018
- Web-based interactive drone control using hand gestureReview of Scientific Instruments, 2018
- Control of a Quadrotor With Reinforcement LearningIEEE Robotics and Automation Letters, 2017
- Gesture control of drone using a motion controller2016
- Autonomous Helicopter Flight Using Reinforcement Learning2011
- Appropriate realisation of MIMO gain-scheduled controllersInternational Journal of Control, 1998