Multi-Feature Cross Attention-Induced Transformer Network for Hyperspectral and LiDAR Data Classification
Open Access
- 29 July 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (15) , 2775
Abstract
Transformers have shown remarkable success in modeling sequential data and capturing intricate patterns over long distances. Their self-attention mechanism allows for efficient parallel processing and scalability, making them well-suited for the high-dimensional data in hyperspectral and LiDAR imagery. However, further research is needed on how to more deeply integrate the features of two modalities in attention mechanisms. In this paper, we propose a novel Multi-Feature Cross Attention-Induced Transformer Network (MCAITN) designed to enhance the classification accuracy of hyperspectral and LiDAR data. The MCAITN integrates the strengths of both data modalities by leveraging a cross-attention mechanism that effectively captures the complementary information between hyperspectral and LiDAR features. By utilizing a transformer-based architecture, the network is capable of learning complex spatial-spectral relationships and long-range dependencies. The cross-attention module facilitates the fusion of multi-source data, improving the network’s ability to discriminate between different land cover types. Extensive experiments conducted on benchmark datasets demonstrate that the MCAITN outperforms state-of-the-art methods in terms of classification accuracy and robustness.Keywords
Funding Information
- National Natural Science Foundation of China (62076137)
This publication has 63 references indexed in Scilit:
- Current Advances in Hyperspectral Remote Sensing in Urban Planning2022
- Multiscale DenseNet Meets With Bi-RNN for Hyperspectral Image ClassificationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future ProspectsIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning modelISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Hyperspectral and Lidar Data Classification Based on Linear Self-Attention2021
- Hyperspectral Imagery for Environmental Urban Planning2018
- Cascaded Random Forest for Hyperspectral Image ClassificationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018
- The airborne hyperspectral image classification based on the random forest algorithm2016
- Semi-supervised classification of hyperspectral image using random forest algorithm2014
- An accurate SVM-based classification approach for hyperspectral image classification2013