A synthetic digital city dataset for robustness and generalisation of depth estimation models
Open Access
- 16 March 2024
- journal article
- research article
- Published by Springer Nature in Scientific Data
- Vol. 11 (1) , 1-13
Abstract
Existing monocular depth estimation driving datasets are limited in the number of images and the diversity of driving conditions. The images of datasets are commonly in a low resolution and the depth maps are sparse. To overcome these limitations, we produce a Synthetic Digital City Dataset (SDCD) which was collected under 6 different weather driving conditions, and 6 common adverse perturbations caused by the data transmission. SDCD provides a total of 930 K high-resolution RGB images and corresponding perfect observed depth maps. The evaluation shows that depth estimation models which are trained on SDCD provide a clearer, smoother, and more precise long-range depth estimation compared to those trained on one of the best-known driving datasets KITTI. Moreover, we provide a benchmark to investigate the performance of depth estimation models in different adverse driving conditions. Instead of collecting data from the real world, we generate the SDCD under severe driving conditions with perfect observed data in the digital world, enhancing depth estimation for autonomous driving.Keywords
This publication has 42 references indexed in Scilit:
- SABV-Depth: A biologically inspired deep learning network for monocular depth estimationKnowledge-Based Systems, 2023
- Perception and sensing for autonomous vehicles under adverse weather conditions: A surveyISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Distance-based confidence generation and aggregation of classifier for unstructured road detectionJournal of King Saud University Computer and Information Sciences, 2022
- Neural Window Fully-connected CRFs for Monocular Depth Estimation2022
- Deep learning-based perception systems for autonomous driving: A comprehensive surveyNeurocomputing, 2022
- C2N: Practical Generative Noise Modeling for Real-World Denoising2021
- Removing Raindrops and Rain Streaks in One Go2021
- Deep learning for monocular depth estimation: A reviewNeurocomputing, 2021
- Control strategy for high-speed autonomous driving in structured road2011
- Vision and the AtmosphereInternational Journal of Computer Vision, 2002