Abstract
We propose Telekinetic Drive, a robot control system that directly connects user intent with robot output by leveraging subtle bodily micro-motions that unconsciously emerge when a user intends to control the robot. The system extracts features from micro-motions of the face and other body parts that occur when the user intends the robot to move in a specific direction, and learns the correspondence between these features and the robot’s movement directions through machine learning. The system is constructed using only camera based measurement and image analysis, and does not employ brain signals, gaze tracking, or electromyography for intent inference. Participants can operate a robot arm through mental effort alone, without wearing any devices or intentionally moving their bodies for control. This enables an experience akin to controlling the robot by telekinesis.
Funding Information
  • Secom Science and Technology Foundation (NA)
  • ACT-X (JPMJAX24CF)