PedX: Benchmark Dataset for Metric 3-D Pose Estimation of Pedestrians in Complex Urban Intersections
- 31 January 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (2) , 1940-1947
Abstract
This letter presents a novel dataset titled PedX, a large-scale multimodal collection of pedestrians at complex urban intersections. PedX consists of more than 5 000 pairs of high-resolution (12MP) stereo images and LiDAR data along with providing two-dimensional (2-D) image labels and 3-D labels of pedestrians in a global coordinate frame. Data were captured at three four-way stop intersections with heavy pedestrian-vehicle interaction. We also present a 3-D model fitting algorithm for automatic labeling harnessing constraints across different modalities and novel shape and temporal priors. All annotated 3-D pedestrians are localized into the real-world metric space, and the generated 3-D models are validated using a motion capture system configured in a controlled outdoor environment to simulate pedestrians in urban intersections. We also show that the manual 2-D image labels can be replaced by state-of-the-art automated labeling approaches, thereby facilitating automatic generation of large scale datasets.Keywords
All Related Versions
Funding Information
- Ford Motor Company via the Ford-UM Alliance (N022884)
This publication has 22 references indexed in Scilit:
- Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUsComputer Graphics Forum, 2017
- Synthesizing Training Images for Boosting Human 3D Pose Estimation2016
- Learning Camera Viewpoint Using CNN to Improve 3D Body Pose Estimation2016
- Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video2016
- SMPLACM Transactions on Graphics, 2015
- Pose-conditioned joint angle limits for 3D human pose reconstruction2015
- Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Berkeley MHAD: A comprehensive Multimodal Human Action Database2013
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human MotionInternational Journal of Computer Vision, 2009