S-Graphs+: Real-Time Localization and Mapping Leveraging Hierarchical Representations
Open Access
- 29 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (8) , 4927-4934
Abstract
In this letter, we present an evolved version of Situational Graphs, which jointly models in a single optimizable factor graph (1) a pose graph, as a set of robot keyframes comprising associated measurements and robot poses, and (2) a 3D scene graph, as a high-level representation of the environment that encodes its different geometric elements with semantic attributes and the relational information between them. Specifically, our S-Graphs+ is a novel four-layered factor graph that includes: (1) A keyframes layer with robot pose estimates, (2) a walls layer representing wall surfaces, (3) a rooms layer encompassing sets of wall planes, and (4) a floors layer gathering the rooms within a given floor level. The above graph is optimized in real-time to obtain a robust and accurate estimate of the robot's pose and its map, simultaneously constructing and leveraging high-level information of the environment. To extract this high-level information, we present novel room and floor segmentation algorithms utilizing the mapped wall planes and free-space clusters. We tested S-Graphs+ on multiple datasets, including simulated and real data of indoor environments from varying construction sites, and on a real public dataset of several indoor office areas. On average over our datasets, S-Graphs+ outperforms the accuracy of the second-best method by a margin of 10.67%, while extending the robot situational awareness by a richer scene model. Moreover, we make the software available as a docker file.Keywords
Funding Information
- Fonds National de la Recherche Luxembourg (C19/IS/13713801/5G-Sky)
- Partnership between the Interdisciplinary Center for Security Reliability and Trust
- University of Luxembourg and Stugalux Construction S.A.
- Spanish Government (PID2021-127685NB-I00)
- Aragón government (DGA T45 17R/FSE)
This publication has 27 references indexed in Scilit:
- Automatic reconstruction of fully volumetric 3D building models from oriented point cloudsISPRS Journal of Photogrammetry and Remote Sensing, 2019
- LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain2018
- Sparse 3D Topological Graphs for Micro-Aerial Vehicle Planning2018
- A Method to Segment Maps from Different Modalities Using Free Space Layout MAORIS: Map of Ripples Segmentation2018
- Voxblox: Incremental 3D Euclidean Signed Distance Fields for on-board MAV planning2017
- Automatic Room Segmentation From Unstructured 3-D Data of Indoor EnvironmentsIEEE Robotics and Automation Letters, 2017
- 3D Semantic Parsing of Large-Scale Indoor Spaces2016
- Room segmentation: Survey, implementation, and analysis2016
- LOAM: Lidar Odometry and Mapping in Real-time2014
- A First Look at Graph Theory1991