PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition
Authors:
- Mikaela Angelina UyMUMikaela Angelina Uy
- Gim Hee LeeGLGim Hee Lee
Top Cited Papers
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4470-4479
Abstract
Unlike its image based counterpart, point cloud based retrieval for place recognition has remained as an unexplored and unsolved problem. This is largely due to the difficulty in extracting local feature descriptors from a point cloud that can subsequently be encoded into a global descriptor for the retrieval task. In this paper, we propose the PointNetVLAD where we leverage on the recent success of deep networks to solve point cloud based retrieval for place recognition. Specifically, our PointNetVLAD is a combination/modification of the existing PointNet and NetVLAD, which allows end-to-end training and inference to extract the global descriptor from a given 3D point cloud. Furthermore, we propose the "lazy triplet and quadruplet" loss functions that can achieve more discriminative and generalizable global descriptors to tackle the retrieval task. We create benchmark datasets for point cloud based retrieval for place recognition, and the experimental results on these datasets show the feasibility of our PointNetVLAD. Our code and datasets are publicly available on the project website.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- FaceNet: A unified embedding for face recognition and clustering2015
- 24/7 place recognition by view synthesis2015
- Unsupervised learning of threshold for geometric verification in visual-based loop-closure2014
- FAB-MAP: Probabilistic Localization and Mapping in the Space of AppearanceThe International Journal of Robotics Research, 2008
- Scalable Recognition with a Vocabulary Tree2006
- Learning a Similarity Metric Discriminatively, with Application to Face Verification2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Introduction – a Tour of Multiple View Geometry2004
- Video Google: a text retrieval approach to object matching in videos2003
- Analysis and solutions of the three point perspective pose estimation problem2002