Integrating force and vision feedback within virtual environments for telerobotic systems
Authors:
- B.J. NelsonBNB.J. Nelson
- P.K. KhoslaPKP.K. Khosla
- 22 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1588-1593
Abstract
Traditional telerobotic systems often provide feedback to the user through a variety of sensing modalities, for example through live video imagery, force reflection, or acoustic signals. When a supervisor guides a robotic task while immersed in a virtual environment, geometric representations of the world are provided as feedback. In this case, the supervisor interacts with the environment by visually observing these virtual objects and directing their motion. At issue is how to appropriately use various sensing modalities provided by disparate sensors in a system of this configuration. This paper focuses on assimilating the disparate feedback provided by force and vision sensors for telerobotic systems guided from within virtual environments. A framework for feedback assimilation is described based on the concept of sensor resolvability. Sensor resolvability is used in two ways, to update the virtual environment and to guide the desired task in the real world. Resolvability selects the appropriate sensing modality to use in updating the virtual environment within which the supervisor is immersed. It is also used to direct semi-autonomous agents that interact directly with the real world to perform the desired task. Experimental results demonstrate the significant advantages of assimilating disparate sensory feedback throughout a telerobotic task using the concept of sensor resolvability.Keywords
This publication has 10 references indexed in Scilit:
- Adaptive hybrid visual servoing/force control in unknown environment2002
- Force and vision resolvability for assimilating disparate sensory feedbackIEEE Transactions on Robotics and Automation, 1996
- Visual grasping with long delay time of a free floating object in orbitAutonomous Robots, 1994
- VISUAL SERVOING FOR ROBOTIC ASSEMBLY1993
- The Chimera II real-time operating system for advanced sensor-based control applicationsIEEE Transactions on Systems, Man, and Cybernetics, 1992
- Adaptive Robotic Visual Tracking1991
- A computational framework and an algorithm for the measurement of visual motionInternational Journal of Computer Vision, 1989
- Fusion of Multisensor DataThe International Journal of Robotics Research, 1988
- On the Representation and Estimation of Spatial UncertaintyThe International Journal of Robotics Research, 1986
- The singular value decomposition: Its computation and some applicationsIEEE Transactions on Automatic Control, 1980