Preferences and Willingness to Pay for Health App Assessments Among Health Care Stakeholders: Discrete Choice Experiment
Authors:
- Anna-Lena FreyAFAnna-Lena Frey
- Simon LeighSLSimon Leigh
- Carla ToroCTCarla Toro
- Carme Pratdepàdua BufillCBCarme Pratdepàdua Bufill
- Charles McCayCMCharles McCay
- Tatjana Prenđa TrupecTTTatjana Prenđa Trupec
- Giuseppe D'AVenioGDGiuseppe D'AVenio
- Menno KokMKMenno Kok
- Antanas MontvilaAMAntanas Montvila
- Philipp GoedeckerPGPhilipp Goedecker
- Petra HoogendoornPHPetra Hoogendoorn
Open Access
- 26 May 2025
- journal article
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 13 (1) , e57474
Abstract
Background: The adoption of high-quality health apps has been slow, despite the myriad benefits associated with their use. This is partly due to concerns regarding the effectiveness, safety, and data privacy of such apps. Quality assessments with robust and transparent criteria can address these concerns and, thereby, encourage the use of high-quality apps. However, a major challenge for such assessments is reaching a scale at which a substantial proportion of the more than 350,000 available health apps can be evaluated. Objective: To support the scaling of health app quality assessments, this study aimed to examine the preferences and willingness to pay for assessments with different value propositions among potential customers. Methods: We conducted 2 discrete choice experiments: one with 41 health app developers and another with 46 health system representatives (from health care institutions, authorities, and insurers) from across Europe. Mixed logit models were applied to examine the impact of assessment attributes on participants’ choices as well as to calculate marginal willingness to pay and predicted assessment uptake. Results: Among health app developers, the attributes with the largest impact on assessment choices were the associated clinical care uptake (integration into clinical guidelines and reimbursement or procurement) and cost (purchase price). Increased willingness to use assessed apps and app store integration of assessment results had a moderate impact on choices, while required developer time investment and time until assessment results become available made the smallest contribution. Among health system representatives, increased willingness of clinicians and patients to use evaluated apps had the greatest impact on assessment choices, followed by cost. Time until assessment result availability and the percentage of peers recommending the assessment made a moderate contribution, while reassessment frequency had the smallest impact on choices. On average, health app developers were willing to pay an additional €9020 (95% CI €4968-€13,072) if an assessment facilitates guideline integration and procurement or reimbursement (at the time of data collection, €1=US $1.11), while health system representatives were, on average, willing to pay €7037 (95% CI €4267-€9806) more if an assessment results in a large, rather than a small, increase in willingness to use the evaluated app. The predicted uptake of assessments that offer the preferred values for all attributes was 88.6% among app developers and 91.1% among health system representatives. Conclusions: These findings indicate that, to maximize uptake and willingness to pay among health app developers, it is advisable for assessments to facilitate or enable clinical guideline integration and reimbursement or procurement for high-scoring apps. Assessment scaling thus requires close collaboration with health authorities, health care institutions, and insurers. Furthermore, if health system organizations are targeted as customers, it is essential to provide evidence for the assessment’s impact on patients’ and clinicians’ willingness to use health apps.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Navigating Medical Device Certification: A Qualitative Exploration of Barriers and Enablers Amongst Innovators, Notified Bodies and Other StakeholdersTherapeutic Innovation & Regulatory Science, 2022
- After the four-year transition period: Is the European Union's Medical Device Regulation of 2017 likely to achieve its main goals?Health Policy, 2022
- The regulatory gap in digital health and alternative pathways to bridge itHealth Policy and Technology, 2022
- Effectiveness of mobile health-based self-management interventions in breast cancer patients: a meta-analysisSupportive Care in Cancer, 2021
- The efficacy of mindfulness meditation apps in enhancing users’ well-being and mental health related outcomes: a meta-analysis of randomized controlled trialsJournal of Affective Disorders, 2021
- The efficacy of app‐supported smartphone interventions for mental health problems: a meta‐analysis of randomized controlled trialsWorld Psychiatry, 2019
- Including Opt-Out Options in Discrete Choice Experiments: Issues to ConsiderThe Patient - Patient-Centered Outcomes Research, 2018
- Discrete Choice Experiments: A Guide to Model Specification, Estimation and SoftwarePharmacoEconomics, 2017
- Dummy coding vs effects coding for categorical variables: Clarifications and extensionsJournal of Choice Modelling, 2016
- Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?Health Economics, 2006