Loop Detection Method Based on Neural Radiance Field BoW Model for Visual Inertial Navigation of UAVs
Open Access
- 19 August 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (16) , 3038
Abstract
The loop closure detection (LCD) methods in Unmanned Aerial Vehicle (UAV) Visual Inertial Navigation System (VINS) are often affected by issues such as insufficient image texture information and limited observational perspectives, resulting in constrained UAV positioning accuracy and reduced capability to perform complex tasks. This study proposes a Bag-of-Words (BoW) LCD method based on Neural Radiance Field (NeRF), which estimates camera poses from existing images and achieves rapid scene reconstruction through NeRF. A method is designed to select virtual viewpoints and render images along the flight trajectory using a specific sampling approach to expand the limited observational angles, mitigating the impact of image blur and insufficient texture information at specific viewpoints while enlarging the loop closure candidate frames to improve the accuracy and success rate of LCD. Additionally, a BoW vector construction method that incorporates the importance of similar visual words and an adapted virtual image filtering and comprehensive scoring calculation method are designed to determine loop closures. Applied to VINS-Mono and ORB-SLAM3, and compared with the advanced BoW model LCDs of the two systems, results indicate that the NeRF-based BoW LCD method can detect more than 48% additional accurate loop closures, while the system’s navigation positioning error mean is reduced by over 46%, validating the effectiveness and superiority of the proposed method and demonstrating its significant importance for improving the navigation accuracy of VINS.Keywords
This publication has 43 references indexed in Scilit:
- maplab 2.0 – A Modular and Multi-Modal Mapping FrameworkIEEE Robotics and Automation Letters, 2022
- Loop closure detection based on image semantic feature and bag-of-wordsMultimedia Tools and Applications, 2022
- Vision-Only Robot Navigation in a Neural Radiance WorldIEEE Robotics and Automation Letters, 2022
- Modest-vocabulary loop-closure detection with incremental bag of tracked wordsRobotics and Autonomous Systems, 2021
- Loop-Closure Detection Using Local Relative Orientation MatchingIEEE Transactions on Intelligent Transportation Systems, 2021
- 2D object recognition: a comparative analysis of SIFT, SURF and ORB feature descriptorsMultimedia Tools and Applications, 2021
- iBoW-LCD: An Appearance-Based Loop-Closure Detection Approach Using Incremental Bags of Binary WordsIEEE Robotics and Automation Letters, 2018
- Efficient Octree-Based Volumetric SLAM Supporting Signed-Distance and Occupancy MappingIEEE Robotics and Automation Letters, 2018
- EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real TimeIEEE Robotics and Automation Letters, 2016
- Faster and Better: A Machine Learning Approach to Corner DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010