LTC-Mapping, Enhancing Long-Term Consistency of Object-Oriented Semantic Maps in Robotics
Open Access
Abstract
This paper proposes LTC-Mapping, a method for building object-oriented semantic maps that remain consistent in the long-term operation of mobile robots. Among the different challenges that compromise this aim, LTC-Mapping focuses on two of the more relevant ones: preventing duplicate instances of objects (instance duplication) and handling dynamic scenes. The former refers to creating multiple instances of the same physical object in the map, usually as a consequence of partial views or occlusions. The latter deals with the typical assumption made by object-oriented mapping methods that the world is static, resulting in outdated representations when the objects change their positions. To face these issues, we model the detected objects with 3D bounding boxes, and analyze the visibility of their vertices to detect occlusions and partial views. Besides this geometric modeling, the boxes are augmented with semantic information regarding the categories of the objects they represent. Both the geometric entities (bounding boxes) and their semantic content are propagated over time through data association and a fusion technique. In addition, in order to keep the map curated, the non-detection of objects in the areas where they should appear is also considered, proposing a mechanism that removes them from the map once there is evidence that they have been moved (i.e., multiple non-detections occur). To validate our proposal, a number of experiments have been carried out using the Robot@VirtualHome ecosystem, comparing its performance with a state-of-the-art alternative. The results report a superior performance of LTC-Mapping when modeling both geometric and semantic information of objects, and also support its online execution.Keywords
Funding Information
- ARPEGGIO (PID2020-117057, P20_01302, FPU19/00704)
- HOUNDBOT (PID2020-117057, P20_01302, FPU19/00704)
- Spanish Grant program (PID2020-117057, P20_01302, FPU19/00704)
This publication has 49 references indexed in Scilit:
- Scene object recognition for mobile robots through Semantic Knowledge and Probabilistic Graphical ModelsExpert Systems with Applications, 2015
- Exploiting semantic knowledge for robot object recognitionKnowledge-Based Systems, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Semantic mapping for mobile robotics tasks: A surveyRobotics and Autonomous Systems, 2015
- Robot task planning using semantic mapsRobotics and Autonomous Systems, 2008
- Towards semantic maps for mobile robotsRobotics and Autonomous Systems, 2008
- Morphological Operations on 3D and 4D Images: From Shape Primitive Detection to SkeletonizationLecture Notes in Computer Science, 2000
- Support vector machines for 3D object recognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Ontologies: principles, methods and applicationsThe Knowledge Engineering Review, 1996
- Thinning methodologies-a comprehensive surveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992