Sensor Fusion for Depth Estimation, including TOF and Thermal Sensors
Open Access
- 1 October 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 33 (15506185) , 472-478
Abstract
This paper describes the computation of depth maps for a high-quality reference camera augmented by a set of satellite sensors. The satellite sensors include support cameras, a TOF (time-of-flight) sensor, and a thermal camera, all rigidly attached to the reference camera. There is extensive previous work on computing depth maps with stereo alone, and high-quality results have been achieved. However it has proved difficult to achieve good results for cases such as texture less areas, or similar fore- and background colors. We show that with our proposed sensor fusion we can achieve high quality results. The paper makes two contributions. The first is a method for combining TOF data with multi-camera data that includes reasoning about occlusions, to produce an improved depth estimate near depth discontinuities. The second contribution is to show the benefit of thermal sensing as a segmentation prior. Thermal cameras were formerly high-cost devices but are now available at the same cost as machine vision cameras. This work demonstrates their advantages, particularly for scenes including humans.Keywords
This publication has 15 references indexed in Scilit:
- Stereo matching with nonparametric smoothness priors in feature space2009
- Spatial-Depth Super Resolution for Range Images2007
- Thermo-visual feature fusion for object tracking using multiple spatiogram trackersMachine Vision and Applications, 2007
- Stereo for Image-Based Rendering using Image Over-SegmentationInternational Journal of Computer Vision, 2007
- A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms2006
- Simplified Belief Propagation for Multiple View Reconstruction2006
- Efficient Belief Propagation for Early VisionInternational Journal of Computer Vision, 2006
- Ensuring color consistency across multiple cameras2005
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Random sample consensusCommunications of the ACM, 1981