Robust Line-Scan Image Registration via Disparity Estimation for Train Fault Diagnosis
Open Access
Abstract
Automatic fault detection based on machine vision technology is crucial for the operational safety of trains. However, when imaging moving trains, system errors may induce localized geometric distortions in the captured images, altering the shapes of critical train components. This, in turn, undermines the precision of subsequent diagnostic algorithms. Therefore, image registration prior to anomaly detection is essential. To address this need, we redefine the horizontal registration of line-scan images as a disparity estimation problem on rectified stereo pairs, which is solved using a proposed dense matching network. The disparity is iteratively refined through a GRU-based update module that constructs a multi-scale cost volume with positional encoding and self-attention. To overcome the absence of real-world disparity ground truth, we generate a physics-based simulation dataset by analytically modeling the nonlinear relationship between train velocity variations and line-scan image distortions. Extensive experiments on diverse real-world train image datasets under varied operational conditions demonstrate that our method consistently outperforms alternatives, achieving 5.8% higher registration accuracy and a fourfold increase in processing speed over state-of-the-art approaches. This advantage is particularly evident in challenging scenarios involving repetitive patterns or texture-less regions.Keywords
Funding Information
- National Key Research and Development Program of China (2023YFB2603700)
This publication has 36 references indexed in Scilit:
- Online nonlinearity elimination for fringe projection profilometry using slope intensity codingJournal of Optics, 2024
- Large depth range binary-focusing projection 3D shape reconstruction via unpaired data learningOptics and Lasers in Engineering, 2024
- Efficient visual fault detection for freight train braking system via heterogeneous self distillation in the wildAdvanced Engineering Informatics, 2023
- Adaptive Cooperative Tracking Control of Multiple Trains With Uncertain Dynamics and External Disturbances Based on Adjacent InformationIEEE Access, 2022
- Deep Residual Neural Network-Based Defect Detection on Complex BackgroundsIEEE Transactions on Instrumentation and Measurement, 2022
- Domain-adaptive modules for stereo matching networkNeurocomputing, 2021
- Automatic Fault Detection of Multiple Targets in Railway Maintenance Based on Time-Scale NormalizationIEEE Transactions on Instrumentation and Measurement, 2018
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Image registration methods: a surveyImage and Vision Computing, 2003
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996