Monocular Vision-Based Obstacle Detection and Avoidance for a Multicopter
Open Access
- 18 November 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 167869-167883
Abstract
This article presents a monocular vision-based algorithm for detecting obstacles and identifying obstacle-aware regions, developed to be used for collision avoidance by a multicopter. The first step of our algorithm is to predict a disparity image from a single-view image via implementing a deep encoder-decoder network. All pixels in this disparity prediction are then categorized as one of three classes, obstacle, road, or obstacle-free, by combining V-disparity analysis and a fuzzy inference system. For pixels belonging to obstacle objects, obstacle-aware regions are generated within the field of visual perception. To accommodate the safety margins of a multicopter, intermediate waypoints are then added to obtain a new flyable path that passes through an unknown environment safely. Experimental results verified the effectiveness of the detection of obstacles and the identification of obstacle-aware regions. The accuracy of disparity prediction and monocular depth estimation were quantitatively compared to support the feasibility of monocular vision in obstacle avoidance. Furthermore, the entire algorithm was successfully tested on a robotic platform, autonomously flying a hexacopter in an outdoor space with obstacles. In conclusion, the proposed monocular algorithm performs well for obstacle detection and depth estimation and is potentially an alternative to a binocular solution.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (MOST-107-2221-E-239-034)
This publication has 24 references indexed in Scilit:
- Learning Depth from Single Monocular Images Using Deep Convolutional Neural FieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Collision Avoidance for Quadrotors with a Monocular Camera2015
- PM-Huber: PatchMatch with Huber Regularization for Stereo Matching2013
- SLIC Superpixels Compared to State-of-the-Art Superpixel MethodsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Survey of advances in guidance, navigation, and control of unmanned rotorcraft systemsJournal of Field Robotics, 2012
- DTAM: Dense tracking and mapping in real-time2011
- Optical Flow Based Collision Avoidance of Multi-Rotor UAVs in Urban EnvironmentsInternational Journal of Aeronautical and Space Sciences, 2011
- Two-frame structure from motion using optical flow probability distributions for unmanned air vehicle obstacle avoidanceMachine Vision and Applications, 2008
- Stereo Processing by Semiglobal Matching and Mutual InformationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Obstacle avoidance for unmanned air vehicles using optical flow probability distributions2004