Abstract
Stereo image Super-Resolution (SR) aims to enhance image resolution by leveraging complementary information in stereo pairs. Convolutional Neural Networks (CNNs), widely used in stereo image SR for their strong local pattern extraction capabilities, often fail to capture long-range dependencies critical for stereo correspondence. On the other hand, Swin Transformers have demonstrated superior performance in modeling long-range dependencies for stereo image SR tasks. However, their computational complexity scales quadratically with the window size, leading to a trade-off between global receptive fields and computational efficiency. To tackle these challenges, we propose StereoMamba+, a novel stereo image SR method designed to adaptively capture both local and global dependencies in stereo pairs. Leveraging the Mamba architecture as its backbone, StereoMamba+ integrates an Adaptive State Space Module (ASSM) that efficiently extracts and fuses global and local features, maintaining linear computational complexity. Additionally, a Gated Enhanced Feed-Forward Network (GEFN) selectively amplifies essential features and depth cues, and a Residual Frequency Block (RFB) is employed to capture global features in the frequency domain. To further enhance stereo correspondence, we introduce a Stereo Bi-Directional Cross Attention Module (SBCAM), aligning unique features along both horizontal and vertical epipolar lines to improve stereo consistency. Extensive experiments demonstrate that our proposed StereoMamba+ method achieves state-of-the-art performance on 2× and 4× stereo image SR tasks, delivering PSNR improvements of up to 0.45dB, while maintaining competitive parameter efficiency compared to existing methods.
Funding Information
  • Natural Sciences and Engineering Research Council of Canada (NSERC – PG 11R12450)
  • Telus (PG 11R10321)