Skeleton Merger: an Unsupervised Aligned Keypoint Detector
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 43-52
Abstract
Detecting aligned 3D keypoints is essential under many scenarios such as object tracking, shape retrieval and robotics. However, it is generally hard to prepare a high-quality dataset for all types of objects due to the ambiguity of keypoint itself. Meanwhile, current unsupervised detectors are unable to generate aligned keypoints with good coverage. In this paper, we propose an unsupervised aligned keypoint detector, Skeleton Merger, which utilizes skeletons to reconstruct objects. It is based on an Autoencoder architecture. The encoder proposes keypoints and predicts activation strengths of edges between keypoints. The decoder performs uniform sampling on the skeleton and refines it into small point clouds with pointwise offsets. Then the activation strengths are applied and the sub-clouds are merged. Composite Chamfer Distance (CCD) is proposed as a distance between the input point cloud and the reconstruction composed of sub-clouds masked by activation strengths. We demonstrate that Skeleton Merger is capable of detecting semantically-rich salient keypoints with good alignment, and shows comparable performance to supervised methods on the KeypointNet dataset. It is also shown that the detector is robust to noise and subsampling. Our code is available at https://github.com/eliphatfs/SkeletonMerger.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China
This publication has 25 references indexed in Scilit:
- A scalable active framework for region annotation in 3D shape collectionsACM Transactions on Graphics, 2016
- Object Skeleton Extraction in Natural Images by Fusing Scale-Associated Deep Side Outputs2016
- Reconstruction and Analysis of 3D Scenes2016
- 3D semantic interpretation for robot perception inside office environmentsEngineering Applications of Artificial Intelligence, 2014
- Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshesThe Visual Computer, 2011
- A Concise and Provably Informative Multi‐Scale Signature Based on Heat DiffusionComputer Graphics Forum, 2009
- Skeleton extraction by mesh contractionACM Transactions on Graphics, 2008
- Curve-Skeleton Properties, Applications, and AlgorithmsIEEE Transactions on Visualization and Computer Graphics, 2007
- Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered ScenesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Method for registration of 3-D shapes1992