LSFMamba: Local-Enhanced Spiral Fusion Mamba for Multi-Modal Land Cover Classification
Top Cited Papers
- 6 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 36 (5) , 6081-6094
Abstract
Multi-modal learning, which fuses complementary information from different modalities, has significantly improved the accuracy of land cover classification, especially under adverse conditions like cloudy or rainy weather. Recent advancements in multi-modal remote sensing land cover classification (MMRLC) have witnessed the efficacy of approaches based on CNN and Transformer. However, CNN exhibits limitations in capturing long-range dependencies, whereas Transformer suffers from high computational complexity. Recently, Mamba has garnered widespread attention due to its superior long-range modeling capabilities with linear complexity. Nevertheless, Mamba demonstrates notable limitations when directly applied to MMRLC, including limited local contextual modeling capacity, suboptimal multi-modal feature fusion and lack of a task-specific spatial continuity scanning strategy. Hence, to fully explore the potential of Mamba in multi-modal land cover classification, we propose LSFMamba, which comprises multiple hierarchically connected local-enhanced fusion Mamba (LFM) modules. Within each LFM module, a local-enhanced visual state space (LVSS) block is designed to extract features from different modalities, while a cross-modal interaction state space (CISS) block is created to fuse these multi-modal features. In the LVSS block, we integrate a multi-kernel CNN block into the gating branch in Mamba to enhance its local modeling capabilities. In the CISS block, features from different modalities are interleaved, facilitating cross-modal feature interaction through the state space model. Furthermore, we introduce a novel spiral scanning strategy to reassess the significance of central pixels, a design driven by the unique characteristics of pixel-wise classification task. Extensive experimental results on three multi-modal remote sensing datasets demonstrate that the proposed LSFMamba achieves state-of-the-art performance with lower complexity. The code will be released at https://github.com/hhchhang78/LSFMamba.Keywords
Funding Information
- National Natural Science Foundation of China (42571393)
- National Natural Science Foundation of China (62595732)
- National Key Research and Development Program of China (2022YFA1003800)
- Key Research and Development Program of Shaanxi Province (2025CY-YBXM-040)
- National Natural Science Foundation of China (PCL2024A06)
This publication has 47 references indexed in Scilit:
- Mamba-FETrack: Frame-Event Tracking via State Space Model2024
- A Review of Optical and SAR Image Deep Feature Fusion in Semantic SegmentationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024
- RSCaMa: Remote Sensing Image Change Captioning With State Space ModelIEEE Geoscience and Remote Sensing Letters, 2024
- S2EFT: Spectral-Spatial-Elevation Fusion Transformer for hyperspectral image and LiDAR classificationKnowledge-Based Systems, 2023
- Aligning semantic distribution in fusing optical and SAR images for land use classificationISPRS Journal of Photogrammetry and Remote Sensing, 2023
- AM³Net: Adaptive Mutual-Learning-Based Multimodal Data Fusion NetworkIEEE Transactions on Circuits and Systems for Video Technology, 2022
- S²ENet: Spatial–Spectral Cross-Modal Enhancement Network for Classification of Hyperspectral and LiDAR DataIEEE Geoscience and Remote Sensing Letters, 2021
- Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning modelISPRS Journal of Photogrammetry and Remote Sensing, 2021
- FusAtNet: Dual Attention based SpectroSpatial Multimodal Fusion Network for Hyperspectral and LiDAR Classification2020
- Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion ContestIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014