Open Challenges in Deep Stereo: the Booster Dataset
Authors:
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 21136-21146
Abstract
We present a novel high-resolution and challenging stereo dataset framing indoor scenes annotated with dense and accurate ground-truth disparities. Peculiar to our dataset is the presence of several specular and transparent surfaces, i.e. the main causes of failures for state-of-the-art stereo networks. Our acquisition pipeline leverages a novel deep space-time stereo framework which allows for easy and accurate labeling with sub-pixel precision. We re-lease a total of 419 samples collected in 64 different scenes and annotated with dense ground-truth disparities. Each sample include a high-resolution pair (12 Mpx) as well as an unbalanced pair (Left: 12 Mpx, Right: 1.1 Mpx). Additionally, we provide manually annotated material segmentation masks and 15K unlabeled samples. We evaluate state-of-the-art deep networks based on our dataset, highlighting their limitations in addressing the open challenges in stereo and drawing hints for future research.Keywords
All Related Versions
Funding Information
- Huawei Technologies
This publication has 41 references indexed in Scilit:
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- A Deep Visual Correspondence Embedding Model for Stereo Matching Costs2015
- Object scene flow for autonomous vehicles2015
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth2014
- Fast Cost-Volume Filtering for Visual Correspondence and BeyondIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Stereo Processing by Semiglobal Matching and Mutual InformationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Adaptive support-weight approach for correspondence searchIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- A fast area-based stereo matching algorithmImage and Vision Computing, 2004
- High-accuracy stereo depth maps using structured light2003
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002