Benchmarking Classic and Learned Navigation in Complex 3D Environments
Authors:
Preprint
Abstract
Navigation research is attracting renewed interest with the advent of learning-based methods. However, this new line of work is largely disconnected from well-established classic navigation approaches. In this paper, we take a step towards coordinating these two directions of research. We set up classic and learning-based navigation systems in common simulated environments and thoroughly evaluate them in indoor spaces of varying complexity, with access to different sensory modalities. Additionally, we measure human performance in the same environments. We find that a classic pipeline, when properly tuned, can perform very well in complex cluttered environments. On the other hand, learned systems can operate more robustly with a limited sensor suite. Overall, both approaches are still far from human-level performance.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Matterport3D: Learning from RGB-D Data in Indoor Environments2017
- Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception AgeIEEE Transactions on Robotics, 2016
- Deep Residual Learning for Image Recognition2016
- Vision-based topological mapping and localization methods: A surveyRobotics and Autonomous Systems, 2015
- Visual Navigation for Mobile Robots: A SurveyJournal of Intelligent & Robotic Systems, 2008
- Stanley: The Robot That Won the DARPA Grand Challenge2007
- Improving Generalization for Temporal Difference Learning: The Successor RepresentationNeural Computation, 1993