End-to-End Tactile Feedback Loop: From Soft Sensor Skin Over Deep GRU-Autoencoders to Tactile Stimulation
- 29 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 5 (4) , 6467-6474
Abstract
Tactile feedback is a key sensory channel that contributes to our ability to perform precise manipulations. Sensor skin provides robots with the sense of touch making them increasingly capable of, e.g., dexterous object manipulation. However, in applications like teleoperation, the complex sensory input of an infinite number of different textures must be projected to the human users skin in a meaningful manner. In addressing this issue, we deployed a deep gated recurrent unit-based autoencoder (GRU-AE) that captured the perceptual dimensions of tactile textures in latent space, thus, allowed the network to implicitly understand unseen textures. Furthermore, the expression of unknown textures in latent space allowed the definition of a control law to efficiently drive tactile displays, thus, allowed to convey tactile feedback in a psycho-physically meaningful manner. We experimentally verified our approach by evaluating the prediction performance of the GRU-AE on seen and unseen data that was gathered during active tactile exploration of objects of daily living. Then, we conducted a user study with a custom-made tactile display in which real tactile perceptions in response to active tactile object exploration were compared to the emulated tactile feedback using our proposed tactile feedback loop. The results suggest that our deep GRU-AE for tactile display control offers an efficient and intuitive method for efficient end-to-end tactile feedback during active tactile texture exploration for the implementation into real-time capable tactile feedback systems.Keywords
Funding Information
- JSPS (19H01130, 19K14948)
- Tateishi Science and Technology Foundation
- Research Institute for Science and Engineering of Waseda University
This publication has 27 references indexed in Scilit:
- Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and PerspectivesIEEE Transactions on Haptics, 2017
- Pervasive Haptics2016
- Tactile sensing in dexterous robot hands — ReviewRobotics and Autonomous Systems, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- A biomimetic soft fingertip applicable to haptic feedback systems for texture identification2013
- Psychophysical Dimensions of Tactile Perception of TexturesIEEE Transactions on Haptics, 2012
- Tactile Sensing—From Humans to HumanoidsIEEE Transactions on Robotics, 2010
- Biomechanically Optimized Distributed Tactile Transducer Based on Lateral Skin DeformationThe International Journal of Robotics Research, 2009
- Tactile information transmission by apparent movement phenomenon using shape-memory alloy deviceInternational Journal on Disability and Human Development, 2006
- Sensations on the Skin Similar to Directional Hearing, Beats, and Harmonics of the EarThe Journal of the Acoustical Society of America, 1957