Automated Road Damage Detection Using UAV Images and Deep Learning Techniques
Open Access
- 19 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 62918-62931
Abstract
This paper presents a novel automated road damage detection approach using Unmanned Aerial Vehicle (UAV) images and deep learning techniques. Maintaining road infrastructure is critical for ensuring a safe and sustainable transportation system. However, the manual collection of road damage data can be labor-intensive and unsafe for humans. Therefore, we propose using UAVs and Artificial Intelligence (AI) technologies to improve road damage detection’s efficiency and accuracy significantly. Our proposed approach utilizes three algorithms, YOLOv4, YOLOv5, and YOLOv7, for object detection and localization in UAV images. We trained and tested these algorithms using a combination of the RDD2022 dataset from China and a Spanish road dataset. The experimental results demonstrate that our approach is efficient and achieves 59.9% mean average precision mAP@.5 for the YOLOv5 version, 73.20% mAP@.5 for the YOLOv7 version, and 65.70% mAP@.5 for a YOLOv5 model with a Transformer Prediction Head. These results demonstrate the potential of using UAVs and deep learning for automated road damage detection and pave the way for future research in this field.Keywords
Funding Information
- Project Monitoring and Tracking Systems for the Improvement of Intelligent Mobility and Behavior Analysis (PID2019-108883RBC21/AEI/10.13039/501100011033)
- predoctoral contracts USAL 2021, cofinanced by Banco Santander
This publication has 35 references indexed in Scilit:
- Vehicle Detection Under UAV Based on Optimal Dense YOLO Method2018
- Autonomous UAVs for Structural Health Monitoring Using Deep Learning and an Ultrasonic Beacon System with Geo‐TaggingComputer-Aided Civil and Infrastructure Engineering, 2018
- Automated method for measuring the extent of selective logging damage with airborne LiDAR dataISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage TypesComputer-Aided Civil and Infrastructure Engineering, 2017
- Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c -means clustering and morphological reconstructionAutomation in Construction, 2017
- YOLO9000: Better, Faster, Stronger2017
- Deep Learning‐Based Crack Damage Detection Using Convolutional Neural NetworksComputer-Aided Civil and Infrastructure Engineering, 2017
- Automatic Detection of Wind Turbine Blade Surface Cracks Based on UAV-Taken ImagesIEEE Transactions on Industrial Electronics, 2017
- A New Neuro-Fuzzy Approach for Post-earthquake Road Damage Assessment Using GA and SVM Classification from QuickBird Satellite ImagesJournal of the Indian Society of Remote Sensing, 2017
- Drones to manage the urban environment: Risks, rewards, alternativesJournal of Unmanned Vehicle Systems, 2016