Person following with a mobile robot using binocular feature-based tracking
Authors:
- 1 October 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 815-820
Abstract
We present the Binocular Sparse Feature Segmentation (BSFS) algorithm for vision-based person following with a mobile robot. BSFS uses Lucas-Kanade feature detection and matching in order to determine the location of the person in the image and thereby control the robot. Matching is performed between two images of a stereo pair, as well as between successive video frames. We use the Random Sample Consensus (RANSAC) scheme for segmenting the sparse disparity map and estimating the motion models of the person and background. By fusing motion and stereo information, BSFS handles difficult situations such as dynamic backgrounds, out-of-plane rotation, and similar disparity and/or motion between the person and background. Unlike color-based approaches, the person is not required to wear clothing with a different color from the environment. Our system is able to reliably follow a person in complex dynamic, cluttered environments in real time.Keywords
This publication has 13 references indexed in Scilit:
- Rapid object detection using a boosted cascade of simple features2005
- Multisensor-based human tracking behaviors with Markov chain Monte Carlo methods2005
- Optical flow-based real-time object tracking using non-prior training active feature modelReal-Time Imaging, 2005
- Optimal landmark configuration for vision-based control of mobile robots2004
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Case study: robotic person following using fuzzy control and image segmentationJournal of Robotic Systems, 2003
- An optical-flow person following behaviour2002
- Vision Based Person Tracking with a Mobile Robot1998
- A parallel stereo algorithm that produces dense depth maps and preserves image featuresMachine Vision and Applications, 1993
- Random sample consensusCommunications of the ACM, 1981