MA-Stereo: Real-Time Stereo Matching via Multi-Scale Attention Fusion and Spatial Error-Aware Refinement
- 25 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9954-9961
Abstract
Stereo matching is a fundamental task in computer vision. Real-time stereo matching has recently shown great potential in robotics and autonomous driving applications. However, the existing cost aggregation in real-time stereo matching suffers from accuracy limitations in ill-posed regions. Furthermore, most real-time stereo matching methods struggle to predict disparity in object details and edge areas, resulting in relatively blurred and lacking detailed disparity maps. To address these issues, we propose a real-time stereo matching architecture called MA-Stereo, which features a multi-scale attention fusion (MAF) module and an attention-based spatial error-aware refinement (ASER) module. The MAF adaptively fuses context and geometry information through attention mechanism, effectively improving cost aggregation. In addition, the ASER refines the predicted disparity map, fully leveraging high-frequency information and spatial evidence to accurately predict disparities for sharp edges and thin structures. Experimental results on the SceneFlow and KITTI benchmarks demonstrate that MA-Stereo outperforms almost all current state-of-the-art real-time stereo matching methods while maintaining relatively low runtime, achieving a favorable trade-off between accuracy and speed.Keywords
Funding Information
- National Natural Science Foundation of China (62171205, 62171380)
This publication has 36 references indexed in Scilit:
- Coatrsnet: Fully Exploiting Convolution and Attention for Stereo Matching by Region SeparationInternational Journal of Computer Vision, 2023
- RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching2021
- Domain-Invariant Stereo Matching Networks2020
- EdgeStereo: An Effective Multi-task Learning Network for Stereo Matching and Edge DetectionInternational Journal of Computer Vision, 2020
- NLCA-Net: a non-local context attention network for stereo matchingAPSIPA Transactions on Signal and Information Processing, 2020
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- Object scene flow for autonomous vehicles2015
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth2014
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- ImageNet: A large-scale hierarchical image database2009