Improving Passenger Detection With Overhead Fisheye Imaging
Open Access
- 1 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 66237-66247
Abstract
Detecting passengers within overhead, fisheye images presents a unique set of challenges. Traditional approaches rely on radially-aligned bounding boxes based on the assumption that people are consistently oriented along the image radius. This assumption simplifies the detection process but introduces limitations in terms of flexibility and detection accuracy. Additionally, these methods often require extensive pre and post-processing, significantly increasing the computational complexity. We propose an innovative, end-to-end, rotation-aware detection framework specifically designed for the accurate detection of passengers using angle-oriented bounding boxes. This study investigates a fully convolutional neural network (CNN) that performs direct orientation regression of each bounding box, enhanced by a scale and angle loss function that effectively accounts for the periodicity of angles, ensuring accurate and robust bounding box orientation predictions. Moreover, we present a new dataset tailored to in-cabin passenger detection and counting. Our experimental results show an improvement of 5.3% in average precision, compared to state-of-the-art methods in overhead people detection. Finally, we demonstrate results from real vehicle experiments in Copenhagen and Geneva, highlighting the importance of this work for public transport operators.Keywords
Funding Information
- European Union’s Horizon Europe Research and Innovation Program “Advancing Sustainable User-Centric Mobility with Automated Vehicles ” (101077587)
This publication has 40 references indexed in Scilit:
- A Survey of Deep Learning-Based Object Detection Methods and Datasets for Overhead ImageryIEEE Access, 2022
- HCI Based In-Cabin Monitoring System for Irregular Situations with Occupants Facial Anonymization2021
- Supervised People Counting Using An Overhead Fisheye Camera2019
- Orientation-Aware Regression for Oriented Bounding Box Estimation2018
- Computer vision and deep learning techniques for pedestrian detection and tracking: A surveyNeurocomputing, 2018
- People detection in top-view fisheye imaging2017
- SSD: Single Shot MultiBox Detector2016
- Human detection from images and videos: A surveyPattern Recognition, 2016
- Microsoft COCO: Common Objects in Context2014
- Histograms of Oriented Gradients for Human Detection2005