Sensor fusion for model based 3D tracking
- 1 September 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 524-529
Abstract
In this paper, we present a new approach for fusion of different measurements and sensors for 3D model based tracking. The underlying model of the tracked body is defined geometrically with generalized cylinders, which can hierarchically be connected by different kinds of joints. This results in an articulated body model with constrained kinematic degrees of freedom. The fusion approach incorporates this model knowledge together with the measurements, and tracks the target body iteratively with an extended iterative closest point approach. The resulting tracking system named VooDoo is used to track humans in a human-robot interaction (HRI) context. We only rely on sensors on board the robot, i.e. a color camera, a 3D time-of-flight camera and a laser range finder. The system runs in realtime (~ 20 Hz) and is able to robustly track a human in the vicinity of the robot. The pose and trajectory of the human interaction partner can then be used for haptic interaction like hand-overs, and for activity and gesture recognitionKeywords
This publication has 17 references indexed in Scilit:
- Sensor fusion for 3D human body tracking with an articulated 3D body model2006
- Modeling joint constraints for an articulated 3D human body model with artificial correspondences in ICP2006
- A full body human motion capture system using particle filtering and on-the-fly edge detection2005
- Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM2005
- Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture2003
- 3-D articulated pose tracking for untethered diectic reference2003
- Enforcing Constraints for Human Body Tracking2003
- Multi-modal anchoring for human–robot interactionRobotics and Autonomous Systems, 2003
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987