A Robust Learned Feature-Based Visual Odometry System for UAV Pose Estimation in Challenging Indoor Environments
- 24 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-11
Abstract
Unmanned Aerial Vehicles (UAVs) are becoming popular nowadays due to their versatility and flexibility for indoor applications, such as the autonomous visual inspection for the inner surface of a pressure vessel. Nevertheless, robust and reliable position estimation is critical for completing these tasks. Visual Odometry (VO) and Visual Simultaneous Localisation and Mapping (VSLAM) allow the UAV to estimate its position in unknown environments. However, traditional feature-based VO/VSLAM systems struggle to deal with complex scenes such as low illumination and textureless environments. Replacing the traditional features with deep learning-based features provides the advantage of handling the challenging environment, but the efficiency is ignored. In this work, an efficient VO system based on a novel lightweight feature extraction network for UAV onboard platforms has been developed. The Deformable Convolution (DFConv) is utilised to improve the feature extraction capability. Owing to the limited onboard computing capability, the Depth-wise Separable Convolution (DWConv) is adopted to calculate the offsets for the deformable convolution and construct the backbone network to improve the feature extraction efficiency. Experiments on public datasets indicate that the efficiency of the VO system is improved by 30.03% while preserving the accuracy on embedded platforms with the feature points and descriptors detected by the proposed Convolutional Neural Network (CNN). Moreover, the proposed VO system is verified through UAV flying tests in a real-world scenario. The results prove that the proposed VO system is able to handle the challenging environments where both the latest traditional and deep learning feature-based VO/VSLAM systems fail, and it is feasible for UAV self-localisation and autonomous navigation in the confined, low illumination and textureless indoor environment.Keywords
Funding Information
- UK Net Zero Technology Centre (NZTC) through Low-Cost Intelligent UAV Swarming Technology for Visual Inspection of Oil and Gas Vessels (LOCUST) Research Project (AI-P-028)
- Royal Society through Path Planning of Robots in Complex Environments via the Multiobjective Evolutionary Algorithm Based on Decomposition (MOEA/D-PPR) Research Project (IECNSFC211434)
- China Scholarship Council
- International Fees Only Studentship through the University of Strathclyde
This publication has 45 references indexed in Scilit:
- ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D CamerasIEEE Transactions on Robotics, 2017
- Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception AgeIEEE Transactions on Robotics, 2016
- LIFT: Learned Invariant Feature Transform2016
- The EuRoC micro aerial vehicle datasetsThe International Journal of Robotics Research, 2016
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- A benchmark for the evaluation of RGB-D SLAM systems2012
- Parallel Tracking and Mapping for Small AR Workspaces2007
- Machine Learning for High-Speed Corner Detection2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- An optimal algorithm for approximate nearest neighbor searching fixed dimensionsJournal of the ACM, 1998