Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification
Open Access
- 24 August 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (17) , 4148
Abstract
The fusion-based classification of hyperspectral (HS) and light detection and ranging (LiDAR) images has become a prominent research topic, as their complementary information can effectively improve classification performance. The current methods encompass pixel-, feature- and decision-level fusion. Among them, feature- and decision-level fusion have emerged as the mainstream approaches. Collaborative fusion of these two levels can enhance classification accuracy. Although various methods have been proposed, some shortcomings still exist. On one hand, current methods ignore the shared advanced features between HS and LiDAR images, impeding the integration of multimodal features and thereby limiting the classification performance. On the other hand, the existing methods face difficulties in achieving a balance between feature- and decision-level contributions, or they simply overlook the significance of one level and fail to utilize it effectively. In this paper, we propose a novel feature-decision level collaborative fusion network (FDCFNet) for hyperspectral and LiDAR classification to alleviate these problems. Specifically, a multilevel interactive fusion module is proposed to indirectly connect hyperspectral and LiDAR flows to refine the spectral-elevation information. Moreover, the fusion features of the intermediate branch can further enhance the shared-complementary information of hyperspectral and LiDAR to reduce the modality differences. In addition, a dynamic weight selection strategy is meticulously designed to adaptively assign weight to the output of three branches at the decision level. Experiments on three public benchmark datasets demonstrate the effectiveness of the proposed methods.Keywords
Funding Information
- National Natural Science Foundation of China (42171326, 42071323, LR23D010001, LY22F010014, 2022J076)
- Natural Science Foundation of Zhejiang Province (42171326, 42071323, LR23D010001, LY22F010014, 2022J076)
- Ningbo Natural Science Foundation (42171326, 42071323, LR23D010001, LY22F010014, 2022J076)
This publication has 34 references indexed in Scilit:
- Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the ArtIEEE Geoscience and Remote Sensing Magazine, 2016
- Land-cover classification using both hyperspectral and LiDAR dataInternational Journal of Image and Data Fusion, 2015
- Generalized Graph-Based Fusion of Hyperspectral and LiDAR Data Using Morphological FeaturesIEEE Geoscience and Remote Sensing Letters, 2014
- A decision fusion method based on multiple support vector machine system for fusion of hyperspectral and LIDAR dataInternational Journal of Image and Data Fusion, 2014
- Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion ContestIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Satellite Remote Sensing as a Tool in Disaster Management and Sustainable Development: Towards a Synergistic ApproachProcedia - Social and Behavioral Sciences, 2014
- Fusion of imaging spectrometer and LIDAR data over combined radiative transfer models for forest canopy characterizationRemote Sensing of Environment, 2007
- Mapping Sagebrush Distribution Using Fusion of Hyperspectral and Lidar ClassificationsPhotogrammetric Engineering & Remote Sensing, 2006
- A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera applicationProceedings of the IEEE, 1999
- Remote sensing for exploration; an overviewEconomic Geology, 1983