Fusion of Hyperspectral and Lidar Data Based On Dual-Branch Convolutional Neural Network
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3388-3391
Abstract
With to the development of sensors, the fusion of features from multisource data becomes an interesting but challenging problem. In this paper, the fusion of hyperspectral imagery (HSI) and light detection and ranging (LiDAR) data is investigated with a novel and simplified deep learning architecture, named the dual-branch convolutional neural network (DB-CNN). More specifically, a 3D CNN framework as one of the two branches is used to extract spectral-spatial features simultaneously from HSI, which can keep three-dimensional structural characteristics of HSI. Another one is 2D CNN with cascade blocks, which is developed to extract elevation feature from LiDAR data, and it can exploit the multiscale features. Finally, the features of two branches will be flattened and stacked, and then sent to the fully connected layers. The experiments show that the proposed DB-CNN method can effectively fuse the HSI and LiDAR data, and yield higher classification performance than some existing methods.Keywords
This publication has 5 references indexed in Scilit:
- Multisource Remote Sensing Data Classification Based on Convolutional Neural NetworkIEEE Transactions on Geoscience and Remote Sensing, 2017
- Hyperspectral and LiDAR Data Fusion Using Extinction Profiles and Deep Convolutional Neural NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016
- Extinction Profiles for the Classification of Remote Sensing DataIEEE Transactions on Geoscience and Remote Sensing, 2016
- Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature LearningIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Voxelization of full waveform LiDAR data for fusion with Hyperspectral Imagery2013