X-MAS: Extremely Large-Scale Multi-Modal Sensor Dataset for Outdoor Surveillance in Real Environments
Authors:
- DongKi NohDNDongKi Noh
- Changki SungCSChangki Sung
- Teayoung UhmTUTeayoung Uhm
- WooJu LeeWLWooJu Lee
- Hyungtae LimHLHyungtae Lim
- Jaeseok ChoiJCJaeseok Choi
- Kyuewang LeeKLKyuewang Lee
- Dasol HongDHDasol Hong
- Daeho UmDUDaeho Um
- Inseop ChungICInseop Chung
- Hochul ShinHSHochul Shin
- MinJung KimMKMinJung Kim
Preprint
Abstract
In robotics and computer vision communities, extensive studies have been widely conducted regarding surveillance tasks, including human detection, tracking, and motion recognition with a camera. Additionally, deep learning algorithms are widely utilized in the aforementioned tasks as in other computer vision tasks. Existing public datasets are insufficient to develop learning-based methods that handle various surveillance for outdoor and extreme situations such as harsh weather and low illuminance conditions. Therefore, we introduce a new large-scale outdoor surveillance dataset named eXtremely large-scale Multi-modAl Sensor dataset (X-MAS) containing more than 500,000 image pairs and the first-person view data annotated by well-trained annotators. Moreover, a single pair contains multi-modal data (e.g. an IR image, an RGB image, a thermal image, a depth image, and a LiDAR scan). This is the first large-scale first-person view outdoor multi-modal dataset focusing on surveillance tasks to the best of our knowledge. We present an overview of the proposed dataset with statistics and present methods of exploiting our dataset with deep learning-based algorithms. The latest information on the dataset and our study are available at https://github.com/lge-robot-navi, and the dataset will be available for download through a server.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- A semi-supervised deep learning based video anomaly detection framework using RGB-D for surveillance of real-world critical environmentsForensic Science International: Digital Investigation, 2022
- Patchwork: Concentric Zone-Based Region-Wise Ground Segmentation With Ground Likelihood Estimation Using a 3D LiDAR SensorIEEE Robotics and Automation Letters, 2021
- CHORD: Distributed Data-Sharing via Hybrid ROS 1 and 2 for Multi-Robot Exploration of Large-Scale Complex EnvironmentsIEEE Robotics and Automation Letters, 2021
- Learning Occupancy Priors of Human Motion From Semantic Maps of Urban EnvironmentsIEEE Robotics and Automation Letters, 2021
- GridNet: Image-Agnostic Conditional Anomaly Detection for Indoor SurveillanceIEEE Robotics and Automation Letters, 2021
- Human segmentation in surveillance video with deep learningMultimedia Tools and Applications, 2020
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle cameraAutonomous Robots, 2010
- Real-time outdoor video surveillance with robust foreground extraction and object tracking via multi-state transition managementPattern Recognition Letters, 2006
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955