Personalized Robot Assistant for Support in Dressing
Open Access
- 20 March 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. 11 (3) , 363-374
Abstract
Robot-assisted dressing is performed in close physical interaction with users who may have a wide range of physical characteristics and abilities. Design of user adaptive and personalized robots in this context is still indicating limited, or no consideration, of specific user-related issues. This paper describes the development of a multi-modal robotic system for a specific dressing scenario -putting on a shoe, where users’ personalized inputs contribute to a much improved task success rate. We have developed: 1) user tracking, gesture recognition and posture recognition algorithms relying on images provided by a depth camera; 2) a shoe recognition algorithm from RGB and depth images; 3) speech recognition and text-to-speech algorithms implemented to allow verbal interaction between the robot and user. The interaction is further enhanced by calibrated recognition of the users’ pointing gestures and adjusted robot’s shoe delivery position. A series of shoe fitting experiments have been performed on two groups of users, with and without previous robot personalization, to assess how it affects the interaction performance. Our results show that the shoe fitting task with the personalized robot is completed in shorter time, with a smaller number of user commands and reduced workload.Keywords
Funding Information
- CHIST-ERA (EU CHIST-ERA 2014)
- Ministerio de Economía y Competitividad (PCIN-2015-147)
- Engineering and Physical Sciences Research Council (EP/N021703/1)
- Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656)
This publication has 27 references indexed in Scilit:
- Comparison of Interaction Modalities for Mobile Indoor Robot Guidance: Direct Physical Interaction, Person Following, and Pointing ControlIEEE Transactions on Human-Machine Systems, 2015
- A friction-model-based framework for Reinforcement Learning of robotic tasks in non-rigid environments2015
- The Role of Healthcare Robots for Older People at Home: A ReviewInternational Journal of Social Robotics, 2014
- Closed-Loop Inverse Kinematics for Redundant Robots: Comparative Assessment and Two EnhancementsIEEE/ASME Transactions on Mechatronics, 2014
- Reinforcement learning of a motor skill for wearing a T-shirt using topology coordinatesAdvanced Robotics, 2013
- Real-time human pose recognition in parts from single depth imagesCommunications of the ACM, 2013
- “Commanding Your Robot” Older Adults’ Preferences for Methods of Robot ControlProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2012
- Visual recognition of pointing gestures for human–robot interactionImage and Vision Computing, 2007
- Human Population: The Next Half CenturyScience, 2003
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988