The HCI Benchmark Suite: Stereo and Flow Ground Truth with Uncertainties for Urban Autonomous Driving
Authors:
- Daniel KondermannDKDaniel Kondermann
- Rahul NairRNRahul Nair
- Katrin HonauerKHKatrin Honauer
- Karsten KrispinKKKarsten Krispin
- Jonas AndrulisJAJonas Andrulis
- Alexander BrockABAlexander Brock
- Burkhard GussefeldBGBurkhard Gussefeld
- Mohsen RahimimoghaddamMRMohsen Rahimimoghaddam
- Sabine HofmannSHSabine Hofmann
- Claus BrennerCBClaus Brenner
- Bernd JahneBJBernd Jahne
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 19-28
Abstract
Recent advances in autonomous driving require more and more highly realistic reference data, even for difficult situations such as low light and bad weather. We present a new stereo and optical flow dataset to complement existing benchmarks. It was specifically designed to be representative for urban autonomous driving, including realistic, systematically varied radiometric and geometric challenges which were previously unavailable. The accuracy of the ground truth is evaluated based on Monte Carlo simulations yielding full, per-pixel distributions. Interquartile ranges are used as uncertainty measure to create binary masks for arbitrary accuracy thresholds and show that we achieved uncertainties better than those reported for comparable outdoor benchmarks. Binary masks for all dynamically moving regions are supplied with estimated stereo and flow values. An initial public benchmark dataset of 55 manually selected sequences between 19 and 100 frames long are made available in a dedicated website featuring interactive tools for database search, visualization, comparison and benchmarking.Keywords
This publication has 34 references indexed in Scilit:
- Is Crowdsourcing for Optical Flow Ground Truth Generation Feasible?Lecture Notes in Computer Science, 2013
- Lessons and Insights from Creating a Synthetic Optical Flow Benchmark2012
- On Performance Analysis of Optical Flow Algorithms2012
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- A Third Eye for Performance Evaluation in Stereo Sequence AnalysisLecture Notes in Computer Science, 2009
- Postprocessing of Optical Flows Via Surface Measures and Motion Inpainting2008
- Deterministic edge-preserving regularization in computed imagingIEEE Transactions on Image Processing, 1997
- Performance of optical flow techniquesInternational Journal of Computer Vision, 1994
- Optical flow estimation: Advances and comparisons1994
- Determining optical flowArtificial Intelligence, 1981