Visual Learning by Imitation With Motor Representations
- 16 May 2005
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Vol. 35 (3) , 438-449
Abstract
We propose a general architecture for action (mimicking) and program (gesture) level visual imitation. Action-level imitation involves two modules. The viewpoint transformation (VPT) performs a "rotation" to align the demonstrator's body to that of the learner. The visuo-motor map (VMM) maps this visual information to motor data. For program-level (gesture) imitation, there is an additional module that allows the system to recognize and generate its own interpretation of observed gestures to produce similar gestures/goals at a later stage. Besides the holistic approach to the problem, our approach differs from traditional work in i) the use of motor information for gesture recognition; ii) usage of context (e.g., object affordances) to focus the attention of the recognition system and reduce ambiguities, and iii) use iconic image representations for the hand, as opposed to fitting kinematic models to the video sequence. This approach is motivated by the finding of visuomotor neurons in the F5 area of the macaque brain that suggest that gesture recognition/imitation is performed in motor terms (mirror) and rely on the use of object affordances (canonical) to handle ambiguous actions. Our results show that this approach can outperform more conventional (e.g., pure visual) methods.Keywords
This publication has 21 references indexed in Scilit:
- Ego function of early imitation2002
- Teaching from examples in assembly and manipulation of snack food ingredients by robot2001
- Cognitive developmental robotics as a new paradigm for the design of humanoid robotsRobotics and Autonomous Systems, 2001
- Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated ImageComputer Vision and Image Understanding, 2000
- Visuomotor neurons: ambiguity of the discharge or ‘motor’ perception?International Journal of Psychophysiology, 2000
- A kurtosis-based dynamic approach to Gaussian mixture modelingIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 1999
- The Visual Analysis of Human Movement: A SurveyComputer Vision and Image Understanding, 1999
- DRAMA, a Connectionist Architecture for Control and Learning in Autonomous RobotsAdaptive Behavior, 1999
- Hidden Markov model approach to skill learning and its application to teleroboticsIEEE Transactions on Robotics and Automation, 1994
- Nature and uses of immaturity.American Psychologist, 1972