M-BRIC: Design of Mass-driven Bi-Rotor with RL-based Intelligent Controller
Authors:
- 4 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 103-108
Abstract
Unmanned aerial vehicles (UAVs) have been widely used in complex applications, such as military, exploration, and rescue. Although there are many quadcopter applications, the bi-copter like a coaxial helicopter has apparent energy efficiency and scalability advantages. What makes the bi-copter challenging to use is difficulty in control because additional mechanical structures are essential for stable movement. This paper tackles this problem by proposing a novel bi-rotor design called M-BRIC with rotatable weight rods and reinforcement learning-based controller. Two weight rods that affect the model’s center of mass (CoM) allow higher maneuverability in horizontal directions. The controller of the model is trained to reach the random target point reliably using Proximal Policy Optimization (PPO). To train and test M-BRIC, NVIDIA Isaac Gym is adopted, which is a state-of-the-art physics simulation and supports superfast parallel training. Finally, four reward functions with different characteristics are designed, and the tracking performances of the controller trained with each reward function are compared in the simulation.Keywords
This publication has 15 references indexed in Scilit:
- A novel concept of VTOL bi-rotor UAV based on moving mass controlAerospace Science and Technology, 2020
- Bridge Inspection Using Unmanned Aerial Vehicle Based on HG-SLAM: Hierarchical Graph-Based SLAMRemote Sensing, 2020
- Gemini: A Compact yet Efficient Bi-copter UAV for Indoor ApplicationsIEEE Robotics and Automation Letters, 2020
- Intelligent Control of a Quadrotor with Proximal Policy Optimization Reinforcement Learning2018
- Emulating a Fully Actuated Aerial Vehicle Using Two Actuators2018
- Mars Helicopter Technology Demonstrator2018
- Control of a Quadrotor With Reinforcement LearningIEEE Robotics and Automation Letters, 2017
- Dynamic model of a MAV with COG shifting mechanismIFAC Proceedings Volumes, 2014
- An underactuated propeller for attitude control in micro air vehicles2013
- New design of the steering mechanism for a mini coaxial helicopter2008