Lift enhancement of a butterfly-like flapping wing vehicle by reinforcement learning algorithm
- 26 May 2023
- journal article
- research article
- Published by IOP Publishing in Bioinspiration & Biomimetics
- Vol. 18 (4) , 046010
Abstract
In order to enhance the take-off lift of a butterfly-like flapping wing vehicle (FWV), we implemented an integrated experimental platform and applied a reinforcement learning algorithm. The vehicle, which has a wingspan of 81 cm and is mounted on a stand with a force sensor, is driven by two servos that are powered and controlled wirelessly. To achieve the goal of enhancing take-off lift, we used a model-free, on-policy actor-critic proximal policy optimization algorithm. After 300 learning steps, the average aerodynamic lift force increased significantly from 0.044 N to 0.861 N. This enhanced lift force was sufficient to meet the take-off requirements of the vehicle without the need for any additional aids or airflow. Additionally, we observed a strong lift peak in the upstroke after analyzing the learning results. Further experiments showed that this lift peak is directly related to the elastic release of the wing twist and the opening and closing of the gap between the forewing and hindwing in the early stage of the upstroke. These findings were not easily predicted or discovered using traditional aerodynamic methods. This work provides valuable reinforcement learning experience for the future development of FWVs.Keywords
Funding Information
- Special key project of Chongqing technology innovation and application development (cstc2019jscx-zdztzxX0044)
- NOKOV
This publication has 30 references indexed in Scilit:
- Controlled Flight of a Biologically Inspired, Insect-Scale RobotScience, 2013
- The significance of moment-of-inertia variation in flight manoeuvres of butterfliesBioinspiration & Biomimetics, 2012
- Differential pressure distribution measurement with an MEMS sensor on a free-flying butterfly wingBioinspiration & Biomimetics, 2012
- Forward flight of swallowtail butterfly with simple flapping motionBioinspiration & Biomimetics, 2010
- Energy-minimizing kinematics in hovering insect flightJournal of Fluid Mechanics, 2007
- Modelization and Kinematics Optimization for a Flapping-Wing Microair VehicleJournal of Aircraft, 2007
- Aerodynamic modelling of insect-like flapping flight for micro air vehiclesProgress in Aerospace Sciences, 2006
- Unconventional lift-generating mechanisms in free-flying butterfliesNature, 2002
- Does flight morphology relate to flight performance? An experimental test with the butterflyPararge aegeriaFunctional Ecology, 2002
- Aerial Predation and Butterfly Design: How Palatability, Mimicry, and the Need for Evasive Flight Constrain Mass AllocationThe American Naturalist, 1991