Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework
Authors:
- Ana IglesiasAna Iglesias
- Javier GarciaJGJavier Garcia
- Angel Garcia-OlayaAngel Garcia-Olaya
- Raquel FuentetajaRFRaquel Fuentetaja
- Fernando FernandezFFFernando Fernandez
- Adrian Romero-GarcesARAdrian Romero-Garces
- Rebeca MarfilRMRebeca Marfil
- Antonio BanderaABAntonio Bandera
- Karine Lan Hing TingKTKarine Lan Hing Ting
- Dimitri VoilmyDVDimitri Voilmy
- Cristina Suarez-MejiasCSCristina Suarez-Mejias
- 18 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 51 (6) , 601-612
Abstract
The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human–robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.Keywords
Funding Information
- EU ECHORD (FP7-ICT-601116 PT13/006/001)
- Ministerio de Ciencia Innovacion y Universidades
- Agencia Estatal de Investigación (RTI2018-099522-B-C43 TIN2017-88476-C2-2-R CSO2017-86747-R AT17-5509-UMA UMA18-FEDERJA-074 UMA-CEIATECH-10)
- Comunidad de Madrid-Spain
- Multiannual Agreement with UC3M
- Excellence of University Professors (EPUC3M17)
- Regional Programme of Research and Technological Innovation
- Comunidad de Madrid (2016-T2/TIC-1712)
- companys robotics research delegation to the ActivAgeing Living Lab
This publication has 30 references indexed in Scilit:
- Reimagining HCIInteractions, 2011
- Combining qualitative and quantitative research within mixed method research designs: A methodological reviewInternational Journal of Nursing Studies, 2011
- A unified methodology for the evaluation of accessibility and usability of mobile applicationsUniversal Access in the Information Society, 2010
- The Evaluation of Accessibility, Usability, and User Experience2009
- Integration and Publications as Indicators of "Yield" From Mixed Methods StudiesJournal of Mixed Methods Research, 2007
- Comprehensive geriatric assessment for older hospital patientsBritish Medical Bulletin, 2005
- Comparing accessibility evaluation tools: a method for tool effectivenessUniversal Access in the Information Society, 2004
- Designing A Mixed Methods Study In Primary CareThe Annals of Family Medicine, 2004
- Accessibility, usability and universal designE—positioning and definition of concepts describing person-environment relationshipsDisability and Rehabilitation, 2003
- Qualitative research in health care: Assessing quality in qualitative researchBMJ, 2000