Image-Based Pothole Detection Using Multi-Scale Feature Network and Risk Assessment
Open Access
- 6 February 2023
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 12 (4) , 826
Abstract
Potholes on road surfaces pose a serious hazard to vehicles and passengers due to the difficulty detecting them and the short response time. Therefore, many government agencies are applying various pothole-detection algorithms for road maintenance. However, current methods based on object detection are unclear in terms of real-time detection when using low-spec hardware systems. In this study, the SPFPN-YOLOv4 tiny was developed by combining spatial pyramid pooling and feature pyramid network with CSPDarknet53-tiny. A total of 2665 datasets were obtained via data augmentation, such as gamma regulation, horizontal flip, and scaling to compensate for the lack of data, and were divided into training, validation, and test of 70%, 20%, and 10% ratios, respectively. As a result of the comparison of YOLOv2, YOLOv3, YOLOv4 tiny, and SPFPN-YOLOv4 tiny, the SPFPN-YOLOv4 tiny showed approximately 2–5% performance improvement in the mean average precision (intersection over union = 0.5). In addition, the risk assessment based on the proposed SPFPN-YOLOv4 tiny was calculated by comparing the tire contact patch size with pothole size by applying the pinhole camera and distance estimation equation. In conclusion, we developed an end-to-end algorithm that can detect potholes and classify the risks in real-time using 2D pothole images.Keywords
Funding Information
- Ministry of Trade, Industry and Energy (20011729)
This publication has 33 references indexed in Scilit:
- Climate change impacts on asphalt road pavement construction and maintenance: An economic life cycle assessment of adaptation measures in the State of Virginia, United StatesJournal of Industrial Ecology, 2019
- Scale-aware Fast R-CNN for Pedestrian DetectionIEEE Transactions on Multimedia, 2017
- Feature Pyramid Networks for Object Detection2017
- Automated road distress detection2016
- SSD: Single Shot MultiBox Detector2016
- Robust Vehicle Detection and Distance Estimation Under Challenging Lighting ConditionsIEEE Transactions on Intelligent Transportation Systems, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- A Real-Time Pothole Detection Approach for Intelligent Transportation SystemMathematical Problems in Engineering, 2015
- Microsoft COCO: Common Objects in Context2014
- Pothole detection in asphalt pavement imagesAdvanced Engineering Informatics, 2011