Point-SLAM: Dense Neural Point Cloud-based SLAM
Authors:
Preprint
Abstract
We propose a dense neural simultaneous localization and mapping (SLAM) approach for monocular RGBD input which anchors the features of a neural scene representation in a point cloud that is iteratively generated in an input-dependent data-driven manner. We demonstrate that both tracking and mapping can be performed with the same point-based neural scene representation by minimizing an RGBD-based re-rendering loss. In contrast to recent dense neural SLAM methods which anchor the scene features in a sparse grid, our point-based approach allows dynamically adapting the anchor point density to the information density of the input. This strategy reduces runtime and memory usage in regions with fewer details and dedicates higher point density to resolve fine details. Our approach performs either better or competitive to existing dense neural RGBD SLAM methods in tracking, mapping and rendering accuracy on the Replica, TUM-RGBD and ScanNet datasets. The source code is available at https://github.com/eriksandstroem/Point-SLAM.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- CATNIPS:CollisionAvoidanceThroughNeuralImplicitProbabilisticScenesIEEE Transactions on Robotics, 2024
- NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM2024
- NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction2023
- NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields2023
- NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior2023
- Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping2023
- Billion-Scale Similarity Search with GPUsIEEE Transactions on Big Data, 2019
- Hierarchical Voxel Block Hashing for Efficient Integration of Depth ImagesIEEE Robotics and Automation Letters, 2015
- Dense scene reconstruction with points of interestACM Transactions on Graphics, 2013
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004