Trust, but Verify: Cross-Modality Fusion for HD Map Change Detection
Authors:
Preprint
Abstract
High-definition (HD) map change detection is the task of determining when sensor data and map data are no longer in agreement with one another due to real-world changes. We collect the first dataset for the task, which we entitle the Trust, but Verify (TbV) dataset, by mining thousands of hours of data from over 9 months of autonomous vehicle fleet operations. We present learning-based formulations for solving the problem in the bird's eye view and ego-view. Because real map changes are infrequent and vector maps are easy to synthetically manipulate, we lean on simulated data to train our model. Perhaps surprisingly, we show that such models can generalize to real world distributions. The dataset, consisting of maps and logs collected in six North American cities, is one of the largest AV datasets to date with more than 7.8 million images. We make the data available to the public at https://www.argoverse.org/av2.html#mapchange-link, along with code and models at https://github.com/johnwlambert/tbv under the the CC BY-NC-SA 4.0 license.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D2020
- Learning Lane Graph Representations for Motion Forecasting2020
- WildDash - Creating Hazard-Aware Benchmarks2018
- Pyramid Scene Parsing Network2017
- Deep Residual Learning for Image Recognition2016
- MatchNet: Unifying feature and metric learning for patch-based matching2015
- Computing the stereo matching cost with a convolutional neural network2015
- Junior: The Stanford entry in the Urban ChallengeJournal of Field Robotics, 2008
- Odin: Team VictorTango's entry in the DARPA Urban ChallengeJournal of Field Robotics, 2008
- Fast, Minimum Storage Ray-Triangle IntersectionJournal of Graphics Tools, 1997