Accurate and Efficient Stereo Matching via Attention Concatenation Volume
Top Cited Papers
- 28 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 46 (4) , 2461-2474
Abstract
Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this article, we present a novel cost volume construction method, named attention concatenation volume (ACV), which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume. The ACV can be seamlessly embedded into most stereo matching networks, the resulting networks can use a more lightweight aggregation network and meanwhile achieve higher accuracy. We further design a fast version of ACV to enable real-time performance, named Fast-ACV, which generates high likelihood disparity hypotheses and the corresponding attention weights from low-resolution correlation clues to significantly reduce computational and memory cost and meanwhile maintain a satisfactory accuracy. Furthermore, we design a highly accurate network ACVNet and a real-time network Fast-ACVNet based on our ACV and Fast-ACV respectively, which achieve state-of-the-art performance on several benchmarks.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62122029, 62061160490, U20B2064)
This publication has 34 references indexed in Scilit:
- Coatrsnet: Fully Exploiting Convolution and Attention for Stereo Matching by Region SeparationInternational Journal of Computer Vision, 2023
- RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching2021
- MVSNet: Depth Inference for Unstructured Multi-view Stereo2018
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- Object scene flow for autonomous vehicles2015
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth2014
- PMBP: PatchMatch Belief Propagation for Correspondence Field EstimationInternational Journal of Computer Vision, 2013
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- ImageNet: A large-scale hierarchical image database2009
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002