Toward the Vectorization of Hyperspectral Imagery
- 26 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 61 (01962892) , 1-14
Abstract
Hyperspectral images (HSIs) can provide rich spectral-spatial information that has been widely utilized in many fields, such as national defense, mineralogy and agriculture. Most of the recent HSI interpretation methods are conducted in the raster pattern, which results in high memory costs, amplification distortion, and difficulties in topological editing. To address this issue, a novel end-to-end vectorization framework is proposed, called as the HSI Vectorization Network (HSI-VecNet), which learns a vector representation from spectral-spatial information through cross-level interactions. Specifically, this framework integrates low-level geometry information and high-level semantic instance information, which consists of two branches: the HSI Semantic Instance Segmentation (HSIS) and the Spectral-Spatial Junction Prediction (SSJP). The HSIS conducts the raster-based classification and extracts the semantic information of each object in the HSI. In addition, the SSJP exploits spectral-spatial information to predict the positions of junctions in the HSI. The instance information of each object and the relations of junctions are then fused to vectorize the HSI. To verify the effectiveness of the proposed method, four hyperspectral datasets are vectorially labeled. Experimental results on these datasets demonstrate that the proposed end-to-end HSI-VecNet outperforms existing post-process vectorization methods. Our model and datasets will be made publicly available at https://github.com/yyyyll0ss/HSI-VecNet.Keywords
Funding Information
- National Natural Science Foundation of China (U22B2014, 62101072)
- Science and Technology Plan Project Fund of Hunan Province (2022RSC3064)
- Hunan Provincial Natural Science Foundation of China (2021JJ40570)
This publication has 49 references indexed in Scilit:
- Spectral–spatial classification of hyperspectral images using deep convolutional neural networksRemote Sensing Letters, 2015
- Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse ModelIEEE Transactions on Geoscience and Remote Sensing, 2015
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- A Metric for Polygon Comparison and Building Extraction EvaluationIEEE Geoscience and Remote Sensing Letters, 2014
- Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering TechniquesIEEE Transactions on Geoscience and Remote Sensing, 2009
- Spectral and Spatial Classification of Hyperspectral Data Using SVMs and Morphological ProfilesIEEE Transactions on Geoscience and Remote Sensing, 2008
- Random Forests for land cover classificationPattern Recognition Letters, 2006
- Sparse multinomial logistic regression: fast algorithms and generalization boundsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Classification of hyperspectral remote sensing images with support vector machinesIEEE Transactions on Geoscience and Remote Sensing, 2004
- ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURECartographica, 1973