A Review of Subjective Scales Measuring the User Experience of Voice Assistants
Open Access
- 25 January 2024
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 14893-14917
Abstract
The use of Voice Assistants (VA) in both commercial and personal contexts has experienced significant growth, emphasizing the importance of assessing their user experience (UX) for long-term viability. Currently, the development of appropriate scales that capture user viewpoints after interacting with a system has become a popular method for measuring UX of the Graphical User Interface (GUI) systems. However, the applicability of these scales that are meant for GUI systems on VA is still questionable, hence the need for analyzing the nature of previous scales used for measuring UX of VA. Additionally, in order to keep track of the state of UX research in the VA domain, it is crucial to understand the dimensions of UX that are being utilized. In this study, a comprehensive Systematic Literature Review (SLR) was carried out to identify 21 individual scales used for measuring UX of VA. Furthermore, this study present the evaluation criteria for assessing the rigor of operationalization during the development of these scales. The study analysis reveals that the scales used for measuring UX of VA extends beyond the traditional VUDA (value, usability, desirability, adoptability) principles and incorporates novel aspects such as anthropomorphism and machine personality. Future VA UX researchers should also acknowledge the variations in the rigorous measures employed during scale development, notwithstanding some common and accepted practices. Consequently, an overview is provided, along with suggestions for prospective studies in the field of VA UX research.Keywords
Funding Information
- Petchra Pra Jom Klao Doctoral Scholarship Research Funding through the King Mongkut’s University of Technology Thonburi
This publication has 105 references indexed in Scilit:
- Usability Testing for Serious Games: Making Informed Design Decisions with User DataAdvances in Human-Computer Interaction, 2012
- The impact of 3d virtual haptics in marketingPsychology & Marketing, 2011
- The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and ElaborationPLOS Medicine, 2009
- Does Instruction in the Use of Personal Digital Assistants Increase Medical Students' Comfort and Skill Level?Medical Reference Services Quarterly, 2009
- Scale Development ResearchThe Counseling Psychologist, 2006
- Measuring Psychodynamic-Interpersonal and Cognitive-Behavioral Techniques: Development of the Comparative Psychotherapy Process Scale.Psychotherapy, 2005
- Scale modification: alternative approaches and their consequencesJournal of Retailing, 2004
- Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI)Natural Language Engineering, 2000
- Sample size in factor analysis.Psychological Methods, 1999
- A First Course in Factor AnalysisTechnometrics, 1993