Development of Performance Indicators for AAC Application Design and Usability Evaluation
Open Access
- 28 September 2023
- journal article
- research article
- Published by Korean Academy of Speech-Language Pathology and Audiology in Communication Sciences & Disorders
- Vol. 28 (3) , 567-582
Abstract
Objectives: With advancements in scientific and technological progress, various Augmentative and Alternative Communication (AAC) applications (apps) have been developed. AAC users require AAC systems that align with their personal characteristics and needs. AAC performance indicators, which encompass usability evaluation, aim to measure communication effectiveness and satisfaction. These indicators can be utilized to assist AAC users in selecting appropriate AAC systems. The goal of this study was to develop performance indicators that would allow AAC users and stakeholders to evaluate AAC apps from multiple perspectives. Methods: Mobile apps and usability evaluations in prior studies were analyzed to extract keywords. Performance indicator items were developed based on this analysis. Expert validity was evaluated, and a survey of AAC users and stakeholders was done to adjust the number of items included and measure validity and reliability. Results: The analysis of prior studies for the development of performance indicator items was visualized in the form of a word cloud. The reliability assessment of AAC app performance indicators yielded a Cronbach’s α value of 0.9 or higher. Regarding content validity, the expert validity showed an S-CVI of 0.978, while the survey with AAC users and stakeholders resulted in 0.754. Exploratory factor analysis was performed to assess construct validity, revealing that all variables demonstrated a communalities value of 0.4 or higher. The items were categorized into five factors: usability, social communication, user-centered design, adoption, and empowerment. Conclusion: AAC app performance indicators should be user-centered, incorporating diverse perspectives and evaluating various aspects of app usage.Keywords
Funding Information
- Ministry of Health and Welfare (HJ21C0007)
This publication has 49 references indexed in Scilit:
- An Evaluation of the P300 Brain–Computer Interface, EyeLink Board, and Eye-Tracking Camera as Augmentative and Alternative Communication DevicesJournal of Speech, Language, and Hearing Research, 2022
- Augmentative and Alternative Interaction Service with AI Speakers to Access Home IoT Devices and Internet Services for People with Multiple Disabilities2022
- Development of a Location and Situation Based Augmentative and Alternative Communication Service2022
- Preliminary Investigation of the Perspectives of Parents of Children With Cerebral Palsy on the Supports, Challenges, and Realities of Integrating Augmentative and Alternative Communication Into Everyday LifeAmerican Journal of Speech-Language Pathology, 2020
- An AAC System Designed for Improving Behaviors and Attitudes in Communication Between Children with CCN and Their Peers2018
- A call for innovative social media research in the field of augmentative and alternative communicationAugmentative and Alternative Communication, 2017
- Measuring Safety and Efficiency in the Operating Room: Development and Validation of a Metric for Evaluating Task Execution in the Operating RoomJournal of the American College of Surgeons, 2013
- Validity and reliability multiple intelligent item using rasch measurement modelProcedia - Social and Behavioral Sciences, 2010
- Usability – Context, framework, definition, design and evaluationInteracting with Computers, 2009
- User experience - a research agendaBehaviour & Information Technology, 2006