Usability Testing of a Patient-Centered Mobile Health App for Supporting and Guiding the Pediatric Emergency Department Patient Journey: Mixed Methods Study (Preprint)
Preprint
- 5 November 2020
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Patient experience in emergency departments (EDs) remains often suboptimal and can be a source of stress, particularly in pediatric settings. In an attempt to support patients and their families before, during, and after their visit to a pediatric ED, a mobile health (mHealth) app was developed by a multidisciplinary team based on patient-centered care principles. OBJECTIVE This study aims to evaluate the usability (effectiveness, efficiency, and satisfaction) of a new mHealth app, InfoKids, by potential end users through usability testing. METHODS The app was assessed through an in-laboratory, video-recorded evaluation in which participants had to execute 9 goal-oriented tasks, ranging from account creation to the reception of a diagnostic sheet at the end of the emergency care episode. Effectiveness was measured based on the task completion rate, efficiency on time on task, and user satisfaction according to answers to the System Usability Scale questionnaire. Think-aloud usability sessions were also transcribed and analyzed. Usability problems were rated for their severity and categorized according to ergonomic criteria. RESULTS A total of 17 parents participated in the study. The overall completion rate was 97.4% (149/153). Overall, they reported good effectiveness, with the task successfully completed in 88.2% (135/153) of cases (95% CI 83%-93%). Each task, with the exception of the first, created difficulties for some participants but did not prevent their completion by most participants. Users reported an overall good to excellent perceived usability of the app. However, ergonomic evaluation identified 14 usability problems occurring 81 time. Among these, 50% (7/14) were serious as their severity was rated as either major or catastrophic and indicated areas of improvements for the app. Following the suggested usability improvements by participants, mitigation measures were listed to further improve the app and avoid barriers to its adoption. CONCLUSIONS Usability of the InfoKids app was evaluated as good to excellent by users. Areas of improvement were identified, and mitigation measures were proposed to inform its development toward a universal app for all ED patients visiting a digitalized institution. Its contribution could also be useful in paving the way for further research on mobile apps aimed at supporting and accompanying patients in their care episodes, as research in this area is scarce.Keywords
All Related Versions
- Published version: JMIR Pediatrics and Parenting, 5 (1), e25540.
This publication has 10 references indexed in Scilit:
- Emergency Department Patient ExperienceJournal of Patient Experience, 2017
- Usability Testing of Medical Devices2015
- Analysing the visual complexity of web pages using document structureBehaviour & Information Technology, 2013
- Shared Decision Making — The Pinnacle of Patient-Centered CareNew England Journal of Medicine, 2012
- Review of health information technology usability study methodologiesJournal of the American Medical Informatics Association, 2011
- The Values and Value of Patient-Centered CareThe Annals of Family Medicine, 2011
- Graph Design for the Eye and Mind2006
- The think aloud method: a guide to user interface designInternational Journal of Medical Informatics, 2004
- Developing Performance Support for Computer Systems2004
- Usability inspection methods1994