Intelligent Image-Based Railway Inspection System Using Deep Learning-Based Object Detection and Weber Contrast-Based Image Comparison
Open Access
Abstract
For sustainable operation and maintenance of urban railway infrastructure, intelligent visual inspection of the railway infrastructure attracts increasing attention to avoid unreliable, manual observation by humans at night, while trains do not operate. Although various automatic approaches were proposed using image processing and computer vision techniques, most of them are focused only on railway tracks. In this paper, we present a novel railway inspection system using facility detection based on deep convolutional neural network and computer vision-based image comparison approach. The proposed system aims to automatically detect wears and cracks by comparing a pair of corresponding image sets acquired at different times. We installed line scan camera on the roof of the train. Unlike an area-based camera, the line scan camera quickly acquires images with a wide field of view. The proposed system consists of three main modules: (i) image reconstruction for registration of facility positions, (ii) facility detection using an improved single shot detector, and (iii) deformed region detection using image processing and computer vision techniques. In experiments, we demonstrate that the proposed system accurately finds facilities and detects their potential defects. For that reason, the proposed system can provide various advantages such as cost reduction for maintenance and accident prevention.Keywords
Funding Information
- Korea Agency for Infrastructure Technology Advancement (19RTRP-C136506-03)
- Institute for Information and Communications Technology Promotion (2014-0-00077)
This publication has 21 references indexed in Scilit:
- Crack detection using image processing: A critical review and analysisAlexandria Engineering Journal, 2018
- A 3D Laser Profiling System for Rail Surface Defect DetectionSensors, 2017
- Inspection equipment study for subway tunnel defects by grey-scale image processingAdvanced Engineering Informatics, 2017
- A New Computer Vision Based Method for Rail Track Detection and Fault Diagnosis in RailwaysInternational Journal of Mechanical Engineering and Robotics Research, 2017
- Deep Multitask Learning for Railway Track InspectionIEEE Transactions on Intelligent Transportation Systems, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Automatic Crack Detection and Classification Method for Subway Tunnel Safety MonitoringSensors, 2014
- Tunnel maintenance in JapanTunnelling and Underground Space Technology, 2003
- Random sample consensusCommunications of the ACM, 1981
- THE VISUAL DISCRIMINATION OF INTENSITY AND THE WEBER-FECHNER LAWJournal of General Physiology, 1924