Characterizing a Heterogeneous System for Person Detection in Video Using Histograms of Oriented Gradients: Power Versus Speed Versus Accuracy
Authors:
- 29 April 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Vol. 3 (2) , 236-247
Abstract
This paper presents a new implementation, with complete analysis, of the processing operations required in a widely-used pedestrian detection algorithm (the histogram of oriented gradients (HOG) detector) when run in various configurations on a heterogeneous platform suitable for use as an embedded system. The platform consists of field-programmable gate array (FPGA), graphics processing unit (GPU), and central processing unit (CPU) and we detail the advantages of such an image processing system for real-time performance. We thoroughly analyze the consequent tradeoffs made between power consumption, latency and accuracy for each possible configuration. We thus demonstrate that prioritization of each of these factors can be made by selecting a specific configuration. These separate configurations may then be changed dynamically to respond to changing priorities of a real-time system, e.g., on a moving vehicle. We compare the performance of real-time implementations of linear and kernel support vector machines in HOG and evaluate the entire system against the state-of-the-art in real-time person detection. We also show that our FPGA implementation detects pedestrians more accurately than existing implementations, and that a heterogeneous configuration which performs image scaling on the GPU, and histogram extraction and classification on the FPGA, produces a good compromise between power and speed.Keywords
This publication has 27 references indexed in Scilit:
- Pedestrian detection at 100 frames per second2012
- Performance Comparison of Graphics Processors to Reconfigurable Logic: A Case StudyIEEE Transactions on Computers, 2010
- The Fastest Pedestrian Detector in the West2010
- A Massively Parallel FPGA-Based Coprocessor for Support Vector Machines2009
- Resource Sharing in Custom Instruction Set Extensions2008
- A Hardware Efficient Support Vector Machine Architecture for FPGA2008
- Dynamo: a runtime partitioning system for FPGA-based HW/SW image processing systemsJournal of Real-Time Image Processing, 2007
- Stanley: The robot that won the DARPA Grand ChallengeJournal of Field Robotics, 2006
- A Critical View of ContextInternational Journal of Computer Vision, 2006
- Have GPUs made FPGAs redundant in the field of video processing?2006