nuScenes: A Multimodal Dataset for Autonomous Driving
Authors:
Top Cited Papers
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 11618-11628
Abstract
Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combination of cameras and range sensors such as lidar and radar. As machine learning based methods for detection and tracking become more prevalent, there is a need to train and evaluate such methods on datasets containing range sensor data along with images. In this work we present nuTonomy scenes (nuScenes), the first dataset to carry the full autonomous vehicle sensor suite: 6 cameras, 5 radars and 1 lidar, all with full 360 degree field of view. nuScenes comprises 1000 scenes, each 20s long and fully annotated with 3D bounding boxes for 23 classes and 8 attributes. It has 7x as many annotations and 100x as many images as the pioneering KITTI dataset. We define novel 3D detection and tracking metrics. We also provide careful dataset analysis as well as baselines for lidar and image based detection and tracking. Data, development kit and more information are available online.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Exploiting 3D semantic scene priors for online traffic light interpretation2015
- Integrating metric and semantic maps for vision-only automated parking2015
- Three Decades of Driver Assistance Systems: Review and Future PerspectivesIEEE Intelligent Transportation Systems Magazine, 2014
- Pedestrian Detection: An Evaluation of the State of the ArtIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Monocular Pedestrian Detection: Survey and ExperimentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Histograms of Oriented Gradients for Human Detection2005
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960