A Unified Light Framework for Real-Time Fault Detection of Freight Train Images
- 3 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 17 (11) , 7423-7432
Abstract
Real-time fault detection for freight trains plays a vital role in guaranteeing the security and optimal operation of railway transportation under stringent resource requirements. Despite the promising results for deep-learning-based approaches, the performance of these fault detectors on freight train images is far from satisfactory in both accuracy and efficiency. This article proposes a unified light framework to improve detection accuracy while supporting a real-time operation with a low-resource requirement. We first design a novel lightweight backbone (real-time fault detection network-RFDNet) to improve the accuracy and reduce computational cost. Then, we propose a multiregion proposal network using multiscale feature maps generated from the RFDNet to improve the detection performance. Finally, we present multilevel position-sensitive score maps and region of interest pooling to further improve accuracy with few redundant computations. Extensive experimental results on public benchmark datasets suggest that our RFDNet can significantly improve the performance of the baseline network with higher accuracy and efficiency. Experiments on six fault datasets show that our method is capable of real-time detection at over 38 frames/s and achieves competitive accuracy and lower computation than the state-of-the-art detectors.Keywords
Funding Information
- National Natural Science Foundation of China (62032011, 61772257, 51675166, 61672279)
- Nanjing University (202001B054)
This publication has 24 references indexed in Scilit:
- An Estimation Method of Defect Size From MFL Image Using Visual Transformation Convolutional Neural NetworkIEEE Transactions on Industrial Informatics, 2018
- RON: Reverse Connection with Objectness Prior Networks for Object Detection2017
- Automatic multi-fault recognition in TFDS based on convolutional neural networkNeurocomputing, 2017
- Automatic online vision-based inspection system of coupler yoke for freight trainsJournal of Electronic Imaging, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Automated Visual Inspection System for Bogie Block Key Under Complex Freight Train EnvironmentIEEE Transactions on Instrumentation and Measurement, 2015
- Caffe2014
- Fast Feature Pyramids for Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014