Jochen J. Steil

We present an on-line, robust, and efficient path planner for the redundant Mitsubishi PA-10 arm with 7 degrees of freedom (DOF) in non-stationary environments. Because of the specific kinematic model of the arm, path planning can be first reduced to a redundant 6-DOF problem in a 5D configuration space, which can be further decomposed into two problems: (i) 3D position planning in Cartesian space and (ii) planning in a 3D space composed of two orientation angles and an explicit parameterization of the arms redundancy. Position and orientation planning are interweaving and performed "on-the-fly" without explicit global knowledge of the environment using two instances of the dynamic wave expansion neural network (DWENN), an effective method for path generation in arbitrarily changing environments. The dynamic and explorative nature of the DWENN algorithm allows to treat stationary and dynamic obstacles in a unified manner. Through a number of simulative tests, we show that the planner is capable of reaching both a satisfactory robustness level and real-time performance, as required by many practical applications

A major challenge for the realization of intelligent robots is to supply them with cognitive abilities in order to allow ordinary users to program them easily and intuitively. One way of such programming is teaching work tasks by interactive demonstration. To make this effective and convenient for the user, the machine must be capable to establish a common focus of attention and be able to use and integrate spoken instructions, visual perceptions, and non-verbal clues like gestural commands. We report progress in building a hybrid architecture that combines statistical methods, neural networks, and finite state machines into an integrated system for instructing grasping tasks by man-machine interaction. The system combines the GRAVIS-robot for visual attention and gestural instruction with an intelligent interface for speech recognition and linguistic interpretation, and an modality fusion module to allow multi-modal task-oriented man-machine communication with respect to dextrous robot manipulation of objects.