ASP-SIFT: Using Analog Signal Processing Architecture to Accelerate Keypoint Detection of SIFT Algorithm
- 13 September 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 28 (1) , 198-211
Abstract
The scale-invariant feature transform (SIFT) algorithm is still one of the most reliable image feature extraction methods. Despite its excellent robustness on various image transformations, SIFT's intensive computational burden has been severely preventing it from being used in real-time and energy-efficient embedded machine vision systems. To reduce processing time and energy cost while executing SIFT, an analog signal processing architecture, analog signal processing (ASP)-SIFT, is proposed in this article. In ASP-SIFT, the Gaussian pyramid construction, difference-of-Gaussian (DoG) pyramid construction and keypoint locating, which are the primary steps of the keypoint detection part of the SIFT algorithm, are done directly with analog circuit networks. Thus, by completing keypoint detection in the analog domain, the total processing time is approximately equal to the settling time of the circuit network. Besides, by adopting a current-mode circuit network operating in the subthreshold region, the power dissipation would be very low. Simulation results show that the total processing speed for a typical video graphics array (VGA)-format (640 x 480) image is up to 2.3 kframes per second, which is at least 3.26x faster than the state-of-the-art digital hardware accelerators, while the system power is 94.5 mW and the energy consumption is only 40 μJ per frame.Keywords
Funding Information
- National Natural Science Foundation of China (41871245, 91648116)
- National Key R&D Program of China (2018YFB1702501, 2017YFC1500601)
This publication has 31 references indexed in Scilit:
- Physical computing circuit with no clock to establish Gaussian pyramid of SIFT algorithm2015
- SIFT Hardware Implementation for Real-Time Image Feature ExtractionIEEE Transactions on Circuits and Systems for Video Technology, 2014
- Fast SIFT Design for Real-Time Visual Feature ExtractionIEEE Transactions on Image Processing, 2013
- A Programmable Difference-of-Gaussian Analog Complementary Metal Oxide Semiconductor Image Sensor Operating in the Subthreshold RegimeJapanese Journal of Applied Physics, 2013
- Horizontal Cell Feedback without Cone Type-Selective Inhibition Mediates “Red–Green” Color Opponency in Midget Ganglion Cells of the Primate RetinaJournal of Neuroscience, 2011
- Understanding the security and robustness of SIFT2010
- Y-Cell Receptive Field and Collicular Projection of Parasol Ganglion Cells in Macaque Monkey RetinaJournal of Neuroscience, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- An analog vlsi chip emulating sustained and transient response channels of the vertebrate retinaIEEE Transactions on Neural Networks, 2003
- Novel approach to high speed CMOS current comparatorsElectronics Letters, 1992