Object recognition for robotics from tactile time series data utilising different neural network architectures
Authors:
- 18 July 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
Robots need to exploit high-quality information on grasped objects to interact with the physical environment. Haptic data can therefore be used for supplementing the visual modality. This paper investigates the use of Convolutional Neural Networks (CNN) and Long-Short Term Memory (LSTM) neural network architectures for object classification on Spatio-temporal tactile grasping data. Furthermore, we compared these methods using data from two different fingertip sensors (namely the BioTac SP and WTS-FT) in the same physical setup, allowing for a realistic comparison across methods and sensors for the same tactile object classification dataset. Additionally, we propose a way to create more training examples from the recorded data. The results show that the proposed method improves the maximum accuracy from 82.4 % (BioTac SP fingertips) and 90.7 % (WTS-FT fingertips) with complete time-series data to about 94 % for both sensor types.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Robust material classification with a tactile skin using deep learning2016
- A multi-modal approach to continuous material identification through tactile sensing2016
- Deep learning for tactile understanding from visual and haptic data2016
- Unplanned, model-free, single grasp object classification with underactuated hands and force sensors2015
- Material classification based on thermal and surface texture properties evaluated against human performance2014
- Tactile object recognition using deep learning and dropout2014
- Design of a flexible tactile sensor for classification of rigid and deformable objectsRobotics and Autonomous Systems, 2014
- Material classification based on thermal properties — A robot and human evaluation2013
- Haptic object recognition for multi-fingered robot hands2012
- Classification of rigid and deformable objects using a novel tactile sensor2011