Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)
Preprint
- 10 October 2019
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Medication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.Keywords
All Related Versions
- Published version: JMIR mHealth and uHealth, 8 (6), e16648.
This publication has 29 references indexed in Scilit:
- Differences in Perceptions of Health Information Between the Public and Health Care Professionals: Nonprobability Sampling Questionnaire SurveyJournal of Medical Internet Research, 2019
- Usability and Usefulness of a Mobile Health App for Pregnancy-Related Work Advice: Mixed-Methods ApproachJMIR mHealth and uHealth, 2019
- Medical Correctness and User Friendliness of Available Apps for Cardiopulmonary Resuscitation: Systematic Search Combined With Guideline Adherence and Usability EvaluationJMIR mHealth and uHealth, 2018
- Don't assume the patient understands: Qualitative analysis of the challenges low health literate patients face in the pharmacyResearch in Social and Administrative Pharmacy, 2016
- Making Quality Health Websites a National Public Health Priority: Toward Quality StandardsJournal of Medical Internet Research, 2016
- Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian WebsitesInteractive Journal of Medical Research, 2016
- Adherence and health care costsRisk Management and Healthcare Policy, 2014
- Untangling the Web2014
- Health Literacy2013
- Health Literacy among Spanish-Speaking Patients in the Emergency DepartmentJournal of the National Medical Association, 2008