Multi-Dimensional Cooperative Network for Stereo Matching
- 26 November 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (1) , 581-587
Abstract
The dimensions of cost volumes and corresponding aggregation networks play a critical role in balancing the speed and accuracy for stereo matching. Current most 2D stereo networks based on 3D cost volumes are speedy but poor in precision, while 3D stereo networks with 4D volumes are slow but precise. To tackle this problem, we propose a novel stereo framework for combining 2D and 3D networks. The disparity range generated by the 2D network is used to guide the 3D network and reduce the computational complexity. Meanwhile, the 3D network can refine the rough disparity from coarse to fine. Through the cooperation of 2D and 3D networks, our method can achieve accurate stereo results at a fast speed. We evaluate our method on three popular public benchmark datasets. Experimental results from the KITTI official website show that, our method can achieve similar accuracy with other 3D stereo networks (PSMNet, GCNet, GwcNet, etc.) at a significantly faster speed. The ablation studies further demonstrate the facticity and reasonability of our propose method.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFB0204301)
- National Natural Science Foundation of China (61872374)
- State Key Laboratory of High Performance Computing
This publication has 22 references indexed in Scilit:
- Learning Depth with Convolutional Spatial Propagation NetworkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- Real-Time Stereo Matching Network with High Accuracy2019
- GA-Net: Guided Aggregation Net for End-To-End Stereo Matching2019
- Pyramid Stereo Matching Network2018
- End-to-End Learning of Geometry and Context for Deep Stereo Regression2017
- Unsupervised Monocular Depth Estimation with Left-Right Consistency2017
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- JOINT 3D ESTIMATION OF VEHICLES AND SCENE FLOWISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2015
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- A taxonomy and evaluation of dense two-frame stereo correspondence algorithms2002