Deep Residual Network-Based Fusion Framework for Hyperspectral and LiDAR Data

Authors:
Open Access
Publisher website
Google Scholar
Abstract
This article presents a deep residual network-based fusion framework for hyperspectral and LiDAR data. In this framework, three new fusion methods are proposed, which are the residual network-based deep feature fusion (RNDFF), the residual network-based probability reconstruction fusion (RNPRF) and the residual network-based probability multiplication fusion (RNPMF). The three methods use extinction profile (EP), local binary pattern (LBP), and deep residual network. Specifically, EP and LBP features are extracted from two sources and stacked as spatial features. For RNDFF, the deep features of each source are extracted by a deep residual network, and then the deep features are stacked to create the fusion features which are classified by softmax classifier. For RNPRF, the deep features of each source are input to the softmax classifier to obtain the probability matrices, and then the probability matrices are fused by weighted addition to producing the final label assignment. For RNPMF, the probability matrices are fused by array multiplication. Experimental results demonstrate that the classification performance of the proposed methods significantly outperform existing methods in hyperspectral and LiDAR data fusion.
Funding Information
  • National Key Research and Development Program of China Stem Cell and Translational Research (2018YFB0505000)
  • National Natural Science Foundation of China (61901343, 41971296, 61871177, 61571345, 91538101, 61501346, 61502367, 61701360)
  • Higher Education Discipline Innovation Project (B08038)
  • Natural Science Foundation of Shaanxi Province (2016JQ6023)
  • Yangtze River Scholar Bonus Schemes of China (CJT160102)
  • Ten Thousand Talent Program
  • Natural Science Foundation of Zhejiang Province (LR19D010001)
  • Open Fund of State Laboratory of Information Engineering in Surveying
  • Mapping and Remote Sensing
  • Wuhan University (18R05)
  • Science and Technology on Space Intelligent Control Laboratory (ZDSYS-2019-03)

This publication has 50 references indexed in Scilit: