Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development (Preprint)
Preprint
- 30 October 2019
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Web-based outpatient portals help patients engage in the management of their health by allowing them to access their medical information, schedule appointments, track their medications, and communicate with their physicians and care team members. Initial studies have shown that portal adoption positively affects health outcomes; however, early studies typically relied on survey data. Using data from health portal applications, we conducted systematic assessments of patients’ use of an outpatient portal to examine how patients engage with the tool. OBJECTIVE This study aimed to document the functionality of an outpatient portal in the context of outpatient care by mining portal usage data and to provide insights into how patients use this tool. METHODS Using audit log files from the outpatient portal associated with the electronic health record system implemented at a large multihospital academic medical center, we investigated the behavioral traces of a study population of 2607 patients who used the portal between July 2015 and February 2019. Patient portal use was defined as having an active account and having accessed any portal function more than once during the study time frame. RESULTS Through our analysis of audit log file data of the number and type of user interactions, we developed a taxonomy of functions and actions and computed analytic metrics, including frequency and comprehensiveness of use. We additionally documented the computational steps required to diagnose artifactual data and arrive at valid usage metrics. Of the 2607 patients in our sample, 2511 were active users of the patients portal where the median number of sessions was 94 (IQR 207). Function use was comprehensive at the patient level, while each session was instead limited to the use of one specific function. Only 17.45% (78,787/451,762) of the sessions were linked to activities involving more than one portal function. CONCLUSIONS In discussing the full methodological choices made in our analysis, we hope to promote the replicability of our study at other institutions and contribute to the establishment of best practices that can facilitate the adoption of behavioral metrics that enable the measurement of patient engagement based on the outpatient portal use.Keywords
All Related Versions
- Published version: Journal of Medical Internet Research, 22 (6), e16849.
This publication has 17 references indexed in Scilit:
- How Patients Use a Patient Portal: An Institutional Case Study of Demographics and Usage PatternsApplied Clinical Informatics, 2019
- Introducing a Patient Portal and Electronic Tablets to Inpatient CareAnnals of Internal Medicine, 2017
- Personal Health Record Use in the United States: Forecasting Future Adoption LevelsJournal of Medical Internet Research, 2016
- Patient PortalsChest, 2016
- Patients’ Continuing Use of an Online Health Record: A Quantitative Evaluation of 14,000 Patient Years of Access DataJournal of Medical Internet Research, 2014
- The Added Value of Log File Analyses of the Use of a Personal Health Record for Patients With Type 2 Diabetes MellitusJournal of Diabetes Science and Technology, 2014
- Impact of Patient Use of an Online Patient Portal on Diabetes OutcomesCanadian Journal of Diabetes, 2014
- Understanding the Usage of Content in a Mental Health Intervention for Depression: An Analysis of Log DataJournal of Medical Internet Research, 2014
- Factors Influencing the Use of a Web-Based Application for Supporting the Self-Care of Patients with Type 2 Diabetes: A Longitudinal StudyJournal of Medical Internet Research, 2011
- Effectiveness of a Web-based Intervention Aimed at Healthy Dietary and Physical Activity Behavior: A Randomized Controlled Trial About Users and UsageJournal of Medical Internet Research, 2011