Automatic detection of urban infrastructure elements from terrestrial images using deep learning
Authors:
- Jaime Carlos MacuácuaJMJaime Carlos Macuácua
- Jorge António Silva CentenoJCJorge António Silva Centeno
- Fernando Alves Barros FirminoFFFernando Alves Barros Firmino
- Jorgiana Kamila Teixeira Do CratoJCJorgiana Kamila Teixeira Do Crato
- Kauê de Moraes VestenaKVKauê de Moraes Vestena
- Caisse AmisseCACaisse Amisse
Open Access
- 1 January 2024
- journal article
- research article
- Published by FapUNIFESP (SciELO) in Boletim de Ciências Geodésicas
- Vol. 30, e2024011
Abstract
Urban infrastructure element detection is important for the domain of public management in large urban centres. The diversity of objects in the urban environment makes object detection and classification a challenging task, requiring fast and accurate methods. Advances in deep learning methods have driven improvement in detection techniques (processing, speed, accuracy) that do not rely on manually crafted models, but, instead, use learning approaches with corresponding large training sets to detect and classify objects in images. We applied an object detection model to identify and classify four urban infrastructure elements in the Mappilary dataset. We use YOLOv5, one of the top-performing object detection models, a recent release of the YOLO family, pre-trained on the COCO dataset but fine-tuned on Mappilary dataset. Experimental results from the dataset show that YOLOv5 can make qualitative predictions, for example, the power grid pole class presented the mean Average Precision (mAP) of 78% and the crosswalk class showed mAP around 79%. A lower degree of certainty was verified in the detection of public lighting (mAP=64%) and accessibility (mAP=61%) classes due to the low resolution of certain objects. However, the proposed method showed the capability of automatically detection and location of urban infrastructure elements in real-time, which could contribute to improve decision-making.Keywords
This publication has 22 references indexed in Scilit:
- A Comprehensive Survey on the Application of Deep and Reinforcement Learning Approaches in Autonomous DrivingJournal of King Saud University Computer and Information Sciences, 2022
- YOLOv5-Tassel: Detecting Tassels in RGB UAV Imagery With Improved YOLOv5 Based on Transfer LearningIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- YOLO-FIRI: Improved YOLOv5 for Infrared Image Object DetectionIEEE Access, 2021
- Robotics and artificial intelligence in healthcare during COVID-19 pandemic: A systematic reviewRobotics and Autonomous Systems, 2021
- Obstacle detection in dangerous railway track areas by a convolutional neural networkMeasurement Science and Technology, 2021
- Object Detection Recognition and Robot Grasping Based on Machine Learning: A SurveyIEEE Access, 2020
- Thermal Object Detection in Difficult Weather Conditions Using YOLOIEEE Access, 2020
- Solder Joint Recognition Using Mask R-CNN MethodIEEE Transactions on Components, Packaging and Manufacturing Technology, 2019
- Deep Learning for Generic Object Detection: A SurveyInternational Journal of Computer Vision, 2019
- Comparison of Grayscale Image Colorization Methods in Different Color Spaces2019