CS-TTD: Triplet Transformer for Compressive Hyperspectral Target Detection
- 31 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-15
Abstract
Detecting targets in hyperspectral image under compressive sensing (CS) is crucial for real-time applications in front-ends. However, applying existing deep learning methods directly to compressed hyperspectral image has been challenging, including the uncertainty introduced by the random sensing matrix in the CS acquisition model, and the ineffectuality of traditional similarity metrics. In this paper, we present a solution to these challenges by introducing a Compressive Sensing-based Triplet Transformer Detector (CS-TTD). Our approach involves data augmentation using the Restricted Distribution Property (RDP) to generate samples for a balanced number of positive samples. followed by the Siamese Network with a triplet transformer to transition spectral vectors from the compressed domain to an embedding space. In addition, we introduce a Combine Convolution Net (CCN) classification module to replace traditional metrics for obtaining classification results. To improve the training and make full use of dataset labels, we also present a two-stage training approach, known as intercategory separation and intracategory aggregation (ISIA), combined with Hard-negative mining, Semi Hard-negative mining. Besides, to estimate the minimal number of compressed bands for sufficient detection performance, we introduce a kernel distribution estimation-based sequential iteration (KDE-SI). Our method achieves hyperspectral target detection without reconstruction, and experimental results demonstrate its performance at 0.16 compression ratio is comparative to existing methods in the original domain.Keywords
This publication has 48 references indexed in Scilit:
- Self-supervised learning with deep clustering for target detection in hyperspectral images with insufficient spectral variation priorInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Self-spectral learning with GAN based spectral–spatial target detection for hyperspectral imageNeural Networks, 2021
- Siamese hyperspectral target detection using synthetic training dataElectronics Letters, 2020
- Target tracking and classification using compressive sensing camera for SWIR videosSignal, Image and Video Processing, 2019
- Combined sparse and collaborative representation for hyperspectral target detectionPattern Recognition, 2015
- FaceNet: A unified embedding for face recognition and clustering2015
- A Simple Proof of the Restricted Isometry Property for Random MatricesConstructive Approximation, 2008
- Learning a Similarity Metric Discriminatively, with Application to Face Verification2005
- Adaptive subspace detectorsIEEE Transactions on Signal Processing, 2001
- Constrained subpixel target detection for remotely sensed imageryIEEE Transactions on Geoscience and Remote Sensing, 2000