Psychometric Properties of a Machine Learning–Based Patient-Reported Outcome Measure on Medication Adherence: Single-Center, Cross-Sectional, Observational Study
Authors:
- Virginie Korb-SavoldelliVKVirginie Korb-Savoldelli
- Yohann TranYTYohann Tran
- Germain PerrinGPGermain Perrin
- Justine TouchardJTJustine Touchard
- Jean PastreJPJean Pastre
- Adrien BorowikABAdrien Borowik
- Corine SchwartzCSCorine Schwartz
- Aymeric ChastelACAymeric Chastel
- Eric ThervetETEric Thervet
- Michel AziziMAMichel Azizi
- Laurence AmarLALaurence Amar
- Benjamin KablyBKBenjamin Kably
Open Access
- 16 October 2023
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e42384
Abstract
Background: Medication adherence plays a critical role in controlling the evolution of chronic disease, as low medication adherence may lead to worse health outcomes, higher mortality, and morbidity. Assessment of their patients' medication adherence by clinicians is essential for avoiding inappropriate therapeutic intensification, associated health care expenditures, and the inappropriate inclusion of patients in time- and resource-consuming educational interventions. In both research and clinical practices the most extensively used measures of medication adherence are patient-reported outcome measures (PROMs), because of their ability to capture subjective dimensions of nonadherence. Machine learning (ML), a subfield of artificial intelligence, uses computer algorithms that automatically improve through experience. In this context, ML tools could efficiently model the complexity of and interactions between multiple patient behaviors that lead to medication adherence. Objective: This study aimed to create and validate a PROM on medication adherence interpreted using an ML approach. Methods: This cross-sectional, single-center, observational study was carried out a French teaching hospital between 2021 and 2022. Eligible patients must have had at least 1 long-term treatment, medication adherence evaluation other than a questionnaire, the ability to read or understand French, an age older than 18 years, and provided their nonopposition. Included adults responded to an initial version of the PROM composed of 11 items, each item being presented using a 4-point Likert scale. The initial set of items was obtained using a Delphi consensus process. Patients were classified as poorly, moderately, or highly adherent based on the results of a medication adherence assessment standard used in the daily practice of each outpatient unit. An ML-derived decision tree was built by combining the medication adherence status and PROM responses. Sensitivity, specificity, positive and negative predictive values (NPVs), and global accuracy of the final 5-item PROM were evaluated. Results: We created an initial 11-item PROM with a 4-point Likert scale using the Delphi process. After item reduction, a decision tree derived from 218 patients including data obtained from the final 5-item PROM allowed patient classification into poorly, moderately, or highly adherent based on item responses. The psychometric properties were 78% (95% CI 40%-96%) sensitivity, 71% (95% CI 53%-85%) specificity, 41% (95% CI 19%-67%) positive predictive values, 93% (95% CI 74%-99%) NPV, and 70% (95% CI 55%-83%) accuracy. Conclusions: We developed a medication adherence tool based on ML with an excellent NPV. This could allow prioritization processes to avoid referring highly adherent patients to time- and resource-consuming interventions. The decision tree can be easily implemented in computerized prescriber order-entry systems and digital tools in smartphones. External validation of this tool in a study including a larger number of patients with diseases associated with low medication adherence is required to confirm its use in analyzing and assessing the complexity of medication adherence.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- Medication Adherence Measures: An OverviewBioMed Research International, 2015
- Theoretical Foundations of Adherence Behaviors: Synthesis and Application in Adherence to Oral Oncology AgentsClinical Journal of Oncology Nursing, 2015
- The impact of medication adherence on health outcomes for chronic metabolic diseases: A retrospective cohort studyResearch in Social and Administrative Pharmacy, 2014
- A systematic literature review of methodologies used to assess medication adherence in patients with diabetesCurrent Medical Research and Opinion, 2014
- The Delphi Technique2012
- Medication Adherence in the Asthmatic Child and AdolescentCurrent Allergy and Asthma Reports, 2011
- Improving the measurement of self-reported medication nonadherenceJournal of Clinical Epidemiology, 2011
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- The Hawthorne Effect: a randomised, controlled trialBMC Medical Research Methodology, 2007
- Quality criteria were proposed for measurement properties of health status questionnairesJournal of Clinical Epidemiology, 2007