Optical flow estimation using high frame rate sequences
Authors:
- A. El GamalAGA. El Gamal
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 925-928
Abstract
Gradient-based optical flow estimation methods such as the Lucas-Kanade (1981) method work well for scenes with small displacements but fail when objects move with large displacements. Hierarchical matching-based methods do not suffer from large displacements but are less accurate. By utilizing the high speed imaging capability of CMOS image sensors, the frame rate can be increased to obtain more accurate optical flow with wide range of scene velocities in real time. Further, by integrating the memory and processing with the sensor on the same chip, optical flow estimation using high frame rate sequences can be performed without unduly increasing the off-chip data rate. The paper describes a method for obtaining high accuracy optical flow at a standard frame rate using high frame rate sequences. The Lucas-Kanade method is used to obtain optical flow estimates at high frame rate, which are then accumulated and refined to obtain optical flow estimates at a standard frame rate. The method is tested on video sequences synthetically generated by perspective warping. The results demonstrate significant improvements in optical flow estimation accuracy with moderate memory and computational power requirements.Keywords
This publication has 7 references indexed in Scilit:
- A CMOS image sensor for focal-plane low-power motion vector estimation2002
- Integration of image capture and processing: beyond single-chip digital camera2001
- Estimating motion in image sequencesIEEE Signal Processing Magazine, 1999
- Performance of optical flow techniquesInternational Journal of Computer Vision, 1994
- Computing optical flow across multiple scales: An adaptive coarse-to-fine strategyInternational Journal of Computer Vision, 1991
- A computational framework and an algorithm for the measurement of visual motionInternational Journal of Computer Vision, 1989
- Optical Flow Estimation: An Error Analysis of Gradient-Based Methods with Local OptimizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1987