“Wink to grasp” — comparing eye, voice & EMG gesture control of grasp with soft-robotic gloves
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2017, 1043-1048
Abstract
The ability of robotic rehabilitation devices to support paralysed end-users is ultimately limited by the degree to which human-machine-interaction is designed to be effective and efficient in translating user intention into robotic action. Specifically, we evaluate the novel possibility of binocular eye-tracking technology to detect voluntary winks from involuntary blink commands, to establish winks as a novel low-latency control signal to trigger robotic action. By wearing binocular eye-tracking glasses we enable users to directly observe their environment or the actuator and trigger movement actions, without having to interact with a visual display unit or user interface. We compare our novel approach to two conventional approaches for controlling robotic devices based on electromyo-graphy (EMG) and speech-based human-computer interaction technology. We present an integrated software framework based on ROS that allows transparent integration of these multiple modalities with a robotic system. We use a soft-robotic SEM glove (Bioservo Technologies AB, Sweden) to evaluate how the 3 modalities support the performance and subjective experience of the end-user when movement assisted. All 3 modalities are evaluated in streaming, closed-loop control operation for grasping physical objects. We find that wink control shows the lowest error rate mean with lowest standard deviation of (0.23 ± 0.07, mean ± SEM) followed by speech control (0.35 ± 0. 13) and EMG gesture control (using the Myo armband by Thalamic Labs), with the highest mean and standard deviation (0.46 ± 0.16). We conclude that with our novel own developed eye-tracking based approach to control assistive technologies is a well suited alternative to conventional approaches, especially when combined with 3D eye-tracking based robotic end-point control.Keywords
This publication has 20 references indexed in Scilit:
- Spatial and temporal resolutions of EEG: Is it really black and white? A scalp current density viewInternational Journal of Psychophysiology, 2015
- A virtual reality platform for safe evaluation and training of natural gaze-based wheelchair driving2015
- Real-Time Evaluation of a Noninvasive Neuroprosthetic Interface for Control of ReachIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2013
- Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfacesJournal of Neural Engineering, 2012
- Reach and grasp by people with tetraplegia using a neurally controlled robotic armNature, 2012
- Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEGMedical & Biological Engineering & Computing, 2010
- Snap clutch, a moded approach to solving the Midas touch problem2008
- A Particle-Swarm-Optimized Fuzzy–Neural Network for Voice-Controlled Robot SystemsIEEE Transactions on Industrial Electronics, 2005
- Evaluation of voice control, touch panel control and assistant control during steering of an endoscopeMinimally Invasive Therapy & Allied Technologies, 2005
- Eye gaze tracking techniques for interactive applicationsComputer Vision and Image Understanding, 2005