A 44.3-mW 62.4-fps Hyperspectral Image Processor for Spectral Unmixing in MAV Remote Sensing
- 18 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 60 (5) , 1818-1829
Abstract
This article presents the first dedicated processor designed to support the complete spectral unmixing workflow for hyperspectral image (HSI) processing, including rank reduction, endmember extraction, and abundance estimation. The design employs architecture explorations, including folding and data interleaving, to reduce hardware complexity. To enhance the throughput, the processor incorporates deeply pipelined reconfigurable processing elements (PEs) for compute-intensive tasks involved in spectral unmixing. The proposed sparsity-adaptive clocking technique leverages data sparsity and minimizes dynamic power consumption. Fabricated in a 40-nm CMOS technology, the proposed processor occupies a core area of 2.56 mm2. The chip consumes 44.3 mW of power at a clock frequency of 175 MHz from a 0.68-V supply. The processor can concurrently generate eight endmembers and their associated abundances for a ${256}{\times }{ 256}{\times }64$ HSI, resulting in a throughput of 62.4 fps. Comparative analysis with a high-end CPU demonstrates a significant processing speed improvement of $544{\times }$ , accompanied by energy efficiency that is 1735 $537{\times }$ higher and area efficiency that is 31 $647{\times }$ higher. The proposed processor is $17.5{\times }$ faster, with 236 $735{\times }$ higher energy efficiency and $4158{\times }$ higher area efficiency in comparison to a high-end graphics processing unit (GPU). The proposed processor provides a promising solution to support real-time hyperspectral remote sensing, particularly for battery-powered micro air vehicles (MAVs).Keywords
Funding Information
- National Science and technology council, Taiwan, (NSTC 112-2218-E-002-029)
- Intelligent and Sustainable Medical Electronics Research Fund in National Taiwan University
This publication has 35 references indexed in Scilit:
- Deep Learning in Hyperspectral Unmixing: A Review2020
- Hyperspectral Nonlinear Unmixing via Generative Adversarial Network2020
- FPGA Implementation of L1/2 Sparsity Constrained Nonnegative Matrix Factorization Algorithm for Remotely Sensed Hyperspectral Image AnalysisIEEE Access, 2020
- The Potential of Multi-Sensor Remote Sensing Mineral Exploration: Examples from Southern Africa2019
- FPGA Acceleration of a Supervised Learning Method for Hyperspectral Image Classification2018
- Modern Trends in Hyperspectral Image Analysis: A ReviewIEEE Access, 2018
- FPGA implementation of the principal component analysis algorithm for dimensionality reduction of hyperspectral imagesJournal of Real-Time Image Processing, 2016
- Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based ApproachesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012
- FPGA Implementation of Abundance Estimation for Spectral Unmixing of Hyperspectral Data Using the Image Space Reconstruction AlgorithmIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2011
- Fast real-time onboard processing of hyperspectral imagery for detection and classificationJournal of Real-Time Image Processing, 2008