SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging
Open Access
- 1 November 2024
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-10
Abstract
Hyperspectral imaging (HSI) finds broad applications in various fields due to its substantial optical signatures for the intrinsic identification of physical and chemical characteristics. However, it faces the inherent challenge of balancing spatial, temporal, and spectral resolution due to limited bandwidth. Here we present SpectraTrack, a computational HSI scheme that simultaneously achieves high spatial, temporal, and spectral resolution in the visible-to-near-infrared (VIS-NIR) spectral range. We deeply investigated the spatio-temporal-spectral multiplexing principle inherent in HSI videos. Based on this theoretical foundation, the SpectraTrack system uses two cameras including a line-scan imaging spectrometer for temporal-multiplexed hyperspectral data and an auxiliary RGB camera to capture motion flow. The motion flow guides hyperspectral reconstruction by reintegrating the scanned spectra into a 4D video. The SpectraTrack system can achieve around megapixel HSI at 100 fps with 1200 spectral channels, demonstrating its great application potential from drone-based anti-vibration video-rate HSI to high-throughput non-cooperative anti-spoofing.Keywords
This publication has 51 references indexed in Scilit:
- A compressive hyperspectral video imaging system using a single-pixel detectorNature Communications, 2024
- Spectral imaging with deep learningLight: Science & Applications, 2022
- A review of deep learning used in the hyperspectral image analysis for agricultureArtificial Intelligence Review, 2021
- Snapshot multidimensional photography through active optical mappingNature Communications, 2020
- Applying systems-level spectral imaging and analysis to reveal the organelle interactomeNature, 2017
- Hyperspectral phasor analysis enables multiplexed 5D in vivo imagingNature Methods, 2017
- High-speed molecular spectral imaging of tissue with stimulated Raman scatteringNature Photonics, 2012
- Optical Imaging and Spectroscopy2008
- Detection of preinvasive cancer cellsNature, 2000
- Orthogonal polarization spectral imaging: A new method for study of the microcirculationNature Medicine, 1999