Asymmetric cost aggregation network for efficient stereo matching
Authors:
Open Access
- 13 April 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 17 (8) , 2450-2466
Abstract
Cost aggregation is crucial to the accuracy of stereo matching. A reasonable cost aggregation algorithm should aggregate costs within homogeneous regions where pixels have the same or similar disparities. Otherwise, the estimated disparity map is prone to the well‐known edge‐fattening issue and the problem of losing fine structures. However, current state‐of‐the‐art convolutional neural networks (CNNs) mainly do cost aggregation with square‐kernel convolutional layers that learn to adjust their kernel elements to make the actual receptive fields of the aggregated costs adapt to homogeneous regions with various shapes. This is a mechanism that easily leads to the above issues due to the translation equivalence and content‐insensitivity properties of CNNs. To tackle these problems, a novel densely connected asymmetric convolution block (Dense‐ACB) based on asymmetric convolutions is proposed to explicitly construct receptive fields with various shapes, which effectively alleviates the issues caused by mismatching shapes of receptive fields and homogeneous regions. The proposed Dense‐ACB brings new insight to CNN‐based stereo matching networks. Based on the proposed cost aggregation method, an efficient and effective stereo matching network is built, which not only achieves competitive overall accuracy compared with state‐of‐the‐art models but also effectively alleviates the edge‐fattening problem and preserves fine structures.Keywords
Funding Information
- Natural Science Foundation of Shaanxi Province (2021JQ‐487)
This publication has 65 references indexed in Scilit:
- Accurate Image-Guided Stereo Matching With Efficient Matching Cost and Disparity RefinementIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Object scene flow for autonomous vehicles2015
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth2014
- Speeding up Convolutional Neural Networks with Low Rank Expansions2014
- High Performance Stereo System for Dense 3-D ReconstructionIEEE Transactions on Circuits and Systems for Video Technology, 2013
- Secrets of adaptive support weight techniques for local stereo matchingComputer Vision and Image Understanding, 2013
- A Performance Study on Different Cost Aggregation Approaches Used in Real-Time Stereo MatchingInternational Journal of Computer Vision, 2007
- Stereoscopic depth processing in the visual cortex: a coarse-to-fine mechanismNature Neuroscience, 2002
- A variable window approach to early visionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- A computational theory of human stereo visionProceedings of the Royal Society of London. B. Biological Sciences, 1979