Real-time stereo and optical flow data fusion
- 1 October 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 531-536
Abstract
In this paper, we propose a real-time method to detect obstacles using theoretical models of the ground plane, first in a 3D point cloud given by a stereo camera, and then in an optical flow field given by one of the stereo pair's camera. The idea of our method is to combine two partial occupancy grids from both sensor modalities with an occupancy grid framework. The two methods do not have the same range, precision and resolution. For example, the stereo method is precise for close objects but cannot see further than 7 m (with our lenses), while the optical flow method can see considerably further but has lower accuracy. Experiments that have been carried on the CyCab mobile robot and on a tractor demonstrate that we can combine the advantages of both algorithms to build local occupancy grids from incomplete data (optical flow from a monocular camera cannot give depth information without time integration)Keywords
This publication has 11 references indexed in Scilit:
- Variational optical flow computation in real timeIEEE Transactions on Image Processing, 2005
- Real-time detection of moving objects from moving vehicles using dense stereo and optical flow2005
- Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow MethodsInternational Journal of Computer Vision, 2005
- A Biomimetic VLSI Sensor for Visual Tracking of Small Moving TargetsIEEE Transactions on Circuits and Systems I: Regular Papers, 2004
- The development of machine vision for road vehicles in the last decade2003
- Algorithms for cooperative multisensor surveillanceProceedings of the IEEE, 2001
- Improved Occupancy Grids for Map BuildingAutonomous Robots, 1997
- Performance of optical flow techniquesInternational Journal of Computer Vision, 1994
- Using occupancy grids for mobile robot perception and navigationComputer, 1989
- A Simplex Method for Function MinimizationThe Computer Journal, 1965