Fast, accurate and robust registration of multiple depth sensors without need for RGB and IR images
Open Access
- 17 May 2022
- journal article
- research article
- Published by Springer Nature in The Visual Computer
- Vol. 38 (12) , 3995-4008
Abstract
Registration is an essential prerequisite for many applications when a multiple-camera setup is used. Due to the noise in depth images, registration procedures for depth sensors frequently rely on the detection of a target object in color or infrared images. However, this prohibits use cases where color and infrared images are not available or where there is no mapping between the pixels of different image types, e.g., due to separate sensors or different projections. We present our novel registration method that requires only the point cloud resulting from the depth image of each camera. For feature detection, we propose a combination of a custom-designed 3D registration target and an algorithm that is able to reliably detect that target and its features in noisy point clouds. Our evaluation indicates that our lattice detection is very robust (with a precision of more than 0.99) and very fast (on average about 20 ms with a single core). We have also compared our registration method with known methods: Our registration method achieves an accuracy of 1.6 mm at a distance of 2 m using only the noisy depth image, while the most accurate registration method achieves an accuracy of 0.7 mm requiring both the infrared and depth image.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (13GW0264D)
This publication has 26 references indexed in Scilit:
- Multiple consumer-grade depth camera registration using everyday objectsImage and Vision Computing, 2017
- Point registration via efficient convex relaxationACM Transactions on Graphics, 2016
- Enhanced ICP for the Registration of Large-Scale 3D Environment Models: An Experimental StudySensors, 2016
- Practical and accurate calibration of RGB-D cameras using spheresComputer Vision and Image Understanding, 2015
- A Comparative Study of Registration Methods for RGB-D Video of Static ScenesSensors, 2014
- Calibration of a network of Kinect sensors for robotic inspection over a large workspace2013
- Joint Depth and Color Camera Calibration with Distortion CorrectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- 3D is here: Point Cloud Library (PCL)2011
- A Combined Corner and Edge Detector1988
- Random sample consensusCommunications of the ACM, 1981