A Novel Hospital-to-Home System for Children With Medical Complexities: Usability Testing Study
Open Access
- 12 August 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (8) , e34572
Abstract
Background: Children with medical complexity (CMC) are a group of young people who have severe complex chronic conditions, substantial family-identified service needs, functional limitations, and high health care resource use. Technology-enabled hospital-to-home interventions designed to deliver comprehensive care in the home setting are needed to ease CMC family stress, provide proactive and comprehensive care to this fragile population, and avoid hospital admissions, where possible. Objective: In this usability testing study, we aimed to assess areas of strength and opportunity within the DigiComp Kids system, a hospital-to-home intervention for CMC and their families and care providers. Methods: Hospital-based clinicians, family members of medically complex children, and home-based clinicians participated in DigiComp Kids usability testing. Participants were recorded and tasked to think aloud while completing usability testing tasks. Participants were scored on the metrics of effectiveness, efficiency, and satisfaction, and the total usability score was calculated using the Single Usability Metric. Participants also provided insights into user experiences during the postusability testing interviews. Results: A total of 15 participants (5 hospital-based clinicians, 6 family members, and 4 home-based clinicians) participated in DigiComp Kids usability testing. The participants were able to complete all assigned tasks independently. Error-free rates for tasks ranged from 58% to 100%; the average satisfaction rating across groups was ≥80%, as measured by the Single Ease Question. Task times of participants were variable compared with the task times of an expert DigiComp Kids user. Single Usability Metric scores ranged from 80.5% to 89.5%. In qualitative interviews, participants stressed the need to find the right fit between user needs and the effort required to use the system. Interviews also revealed that the value of the DigiComp Kids system was in its ability to create a digital bridge between hospital and home, enabling participants to foster and maintain connections across boundaries. Conclusions: Usability testing revealed strong scores across the groups. Insights gained include the importance of tailoring the implementation of the system to match individual user needs, streamlining key system features, and consideration of the meaning attached to system use by participants to allow for insight into system adoption and sustainment.Keywords
This publication has 30 references indexed in Scilit:
- Critical Analysis of Strategies for Determining Rigor in Qualitative InquiryQualitative Health Research, 2015
- Content analysis and thematic analysis: Implications for conducting a qualitative descriptive studyNursing & Health Sciences, 2013
- Patterns and Costs of Health Care Use of Children With Medical ComplexityPediatrics, 2012
- A Holistic Framework to Improve the Uptake and Impact of eHealth TechnologiesJournal of Medical Internet Research, 2011
- Effect of Telecare Management on Pain and Depression in Patients With CancerJAMA, 2010
- Usability Testing Finds Problems for Novice Users of Pediatric PortalsJournal of the American Medical Informatics Association, 2009
- A Tertiary Care–Primary Care Partnership Model for Medically Complex and Fragile Children and Youth With Special Health Care NeedsArchives of Pediatrics & Adolescent Medicine, 2007
- A method to standardize usability metrics into a single score2005
- Task-Selection Bias: A Case for User-Defined TasksInternational Journal of Human–Computer Interaction, 2001
- Measuring usabilityCommunications of the ACM, 1994