MA-VIED: A Multisensor Automotive Visual Inertial Event Dataset
- 18 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (1) , 214-224
Abstract
Visual Inertial Odometry (VIO) and Simultaneous Localization and Mapping (SLAM) have experienced increasing interest in both the consumer and racing automotive sectors in recent decades. With the introduction of novel neuromorphic vision sensors, it is now possible to accurately localize a vehicle even under complex environmental conditions, leading to an improved and safer driving experience. In this paper, we propose MA-VIED, a large-scale driving dataset that collects race track-like loops, maneuvers, and standard driving scenarios, all bundled in a rich sensory dataset. MA-VIED provides highly accurate IMU data, standard and event camera streams, and RTK position data from a dual GPS antenna, both of which are hardware-synchronized with all cameras and IMU data. In addition, we collect accurate wheel odometry data and other data from the vehicle’s CAN bus. The dataset contains 13 sequences collected in urban, suburban, and racetrack-like environments with varying lighting conditions and driving dynamics. We provide ground-truth RTK data for algorithms evaluation and the calibration sequences for both IMU and cameras. We then present three tests to demonstrate how MA-VIED can be suitable for monocular VIO applications, using state-of-the-art VIO algorithms and an EKF-based sensor fusion solution. The experimental results show that MA-VIED can support the development and prototyping of novel automotive-oriented frame and event-based monocular VIO algorithms.Keywords
This publication has 23 references indexed in Scilit:
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State EstimatorIEEE Transactions on Robotics, 2018
- The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D PerceptionIEEE Robotics and Automation Letters, 2018
- Event-Based Visual Inertial Odometry2017
- Direct Sparse OdometryIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAMThe International Journal of Robotics Research, 2017
- Simultaneous Optical Flow and Intensity Estimation from an Event Camera2016
- Evaluation of Event-Based Algorithms for Optical Flow with Ground-Truth from Inertial Measurement SensorFrontiers in Neuroscience, 2016
- A Dataset for Visual Navigation with Neuromorphic MethodsFrontiers in Neuroscience, 2016
- Robust visual inertial odometry using a direct EKF-based approach2015
- Event-based 3D SLAM with a depth-augmented dynamic vision sensor2014