Ct-LVI: A Framework Toward Continuous-Time Laser-Visual-Inertial Odometry and Mapping
- 23 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (6) , 4378-4391
Abstract
Owing to the inherent complementarity among LiDAR, camera, and IMU, a growing effort has been paid to laser-visual-inertial SLAM recently. The existing approaches, however, are limited in two aspects. First, at the front-end, they usually employ a discrete-time representation that requires high-precision hardware/software synchronization and are based on geometric laser features, leading to low robustness and scalability. Second, at the backend, visual loop constraints suffer from scale ambiguity and the sparseness of the point cloud deteriorates the scan-to-scan loop detection. To solve these problems, for the front-end, we propose a continuous-time laser-visual-inertial odometry which formulates the carrier trajectory in continuous time, organizes point clouds in probabilistic submaps, and jointly optimizes the loss terms of laser anchors, visual reprojections, and IMU readings, achieving accurate pose estimation even with fast motion or in unstructured scenes where it is difficult to extract meaningful geometric features. At the backend, we propose building 5-DoF laser constraints by matching projected 2D submaps and 6-DoF visual constraints via laser-aided visual relocalization, ensuring mapping consistency in large-scale scenes. Results show that our framework achieves high-precision estimation and is more robust than its counterparts when the carrier works in large scenes or with fast motion. The relevant codes and data are open-sourced at https://cslinzhang.github.io/Ct-LVI/Ct-LVI.html.Keywords
Funding Information
- National Key Research and Development Project (2020YFB2103900)
- National Natural Science Foundation of China (62272343, 61973235, 61972285)
- Shanghai Science and Technology Innovation Plan (20510760400)
- Shuguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission (21SG23)
- Fundamental Research Funds for the Central Universities
This publication has 59 references indexed in Scilit:
- Point‐LIO: Robust High‐Bandwidth Light Detection and Ranging Inertial OdometryAdvanced Intelligent Systems, 2023
- Laser–visual–inertial odometry and mapping with high robustness and low driftJournal of Field Robotics, 2018
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008
- Machine Learning for High-Speed Corner Detection2006
- SURF: Speeded Up Robust Features2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Bundle Adjustment — A Modern Synthesis2000
- Least-squares estimation of transformation parameters between two point patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- A Practical Guide to Splines1978
- A method for the solution of certain non-linear problems in least squaresQuarterly of Applied Mathematics, 1944