A Domain-adaptive Method of Binocular Disparity Estimation for Bottom Components of the Train
- 13 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 26-30
Abstract
Disparity estimation of binocular images is an important branch of depth reconstruction. The neural network method based on depth learning shows excellent performance in binocular stereo vision, which is far beyond the traditional binocular depth estimation algorithm. Most binocular stereo matching networks rely on training the dataset of the target scene, and can not predict the disparity of bottom components of the train directly. For this problem, we propose a domain-adaptive network, which includes two types of feature extraction encoding layers, a cost volume module that fuses a pair of image features, and a disparity prediction module based on multi-scale convolution layer. Moreover, based on the results of network prediction, we use a consistency checking method to further refine the disparity and enhance the reliability of the estimation results. Through experiments in different scenes, our method shows more accuracy and generalization than ordinary stereo matching networks, and has good effect of stereo visualization with less memory consumption in real train scenes. At the same time, our optimization method of consistency reduces the error of prediction and improves the confidence of disparity estimation for train bottom as a whole.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 12 references indexed in Scilit:
- AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching2021
- Domain-Invariant Stereo Matching Networks2020
- Real-Time Self-Adaptive Deep Stereo2019
- Guided Stereo Matching2019
- Group-Wise Correlation Stereo Network2019
- GA-Net: Guided Aggregation Net for End-To-End Stereo Matching2019
- ActiveStereoNet: End-to-End Self-supervised Learning for Active Stereo Systems2018
- Pyramid Stereo Matching Network2018
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- FlowNet: Learning Optical Flow with Convolutional Networks2015