High-Performance Optical-Flow Architecture Based on a Multi-Scale, Multi-Orientation Phase-Based Model
- 14 October 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 20 (12) , 1797-1807
Abstract
The accurate estimation of optical flow is a problem widely experienced in computer vision and researchers in this field are devoting their efforts to formulate reliable and robust algorithms for real life applications. These approaches need to be evaluated, especially in controlled scenarios. Because of their stability phase-based methods have generally been adopted in the various techniques developed to date, although it is still difficult to be sure of their viability in real-time systems due to their high requirements in terms of computational load. We describe here the implementation of a phase-based optical flow in a field-programmable gate array (FPGA) device. The system benefits from phase-information stability as well as sub-pixel accuracy without requiring additional computations and at the same time achieves high-performance computation by taking full advantage of the parallel processing resources of FPGA devices. Furthermore, the architecture extends the implementation to a multi-resolution and multi-orientation implementation, which enhances its accuracy and covers a wide range of detected velocities. Deep pipelined datapath architecture with superscalar computing units at different stages allows real-time processing beyond VGA image resolution. The final circuit is of significant complexity and useful for a wide range of fields requiring portable optical-flow processing engines.Keywords
This publication has 31 references indexed in Scilit:
- Parallel evolutionary algorithms based on shared memory programming approachesThe Journal of Supercomputing, 2009
- Statistical Motion Information Extraction and Representation for Semantic Video AnalysisIEEE Transactions on Circuits and Systems for Video Technology, 2009
- Robust Bioinspired Architecture for Optical-Flow ComputationIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2009
- FPGA-Based Embedded Motion Estimation SensorInternational Journal of Reconfigurable Computing, 2008
- A VGA 30-fps Realtime Optical-Flow Processor Core for Moving Picture RecognitionIEICE Transactions on Electronics, 2008
- Optimal instantaneous rigid motion estimation insensitive to local minimaComputer Vision and Image Understanding, 2006
- Change-driven Image Architecture on FPGA with adaptive threshold for Optical-Flow Computation2006
- Hardware implementation of optical flow constraint equation using FPGAsComputer Vision and Image Understanding, 2005
- Real-time implementation of an optical flow algorithm2003
- Phase-Based Binocular Perception of Motion in Depth: Cortical-Like Operators and Analog VLSI ArchitecturesEURASIP Journal on Advances in Signal Processing, 2003