Antanas Montvila
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Antanas Montvila has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Petra Hoogendoorn
National eHealth Living Lab, Department of Public Health and Primary Care, Leiden University Medical Center, Leiden, the Netherlands
4 shared publications - Anna-Lena Frey
University of Reading
2 shared publications - Carla Toro
Warwick Medical School, University of Warwick, Coventry CV4 7AL, UK
2 shared publications - Carme Pratdepàdua Bufill
Fundació TIC Salut Social, Ministry of Health, Government of Catalonia, Aragó 330-332, Barcelona, 08009, Spain, 34 667162080
2 shared publications - Charles McCay
Ramsey Systems Ltd, Shrewsbury, United Kingdom
2 shared publications - Giuseppe D'Avenio
Centro Nazionale Tecnologie Innovative in Sanità Pubblica, Istituto Superiore di Sanità, 00161 Rome, Italy
2 shared publications
Latest Publications
- Open Access
- 23 October 2026
- Published by JMIR Publications Inc. in Journal of Participatory Medicine
- Vol. 18, e86473
Developing a Health App Quality Report for CEN-ISO/TS 82304-2 to Satisfy Health Care Professionals’ Information Needs on the Quality of Health Apps: Participatory Design Study
Background: Health apps, which comprise medical and wellness apps, hold potential to improve prevention, diagnosis, treatment, and management of disease. Yet, recommendation and prescription rates by health care professionals (HCPs) are low. Trusted standardized health app quality reports providing the information HCPs need to recommend or prescribe a specific app for an individual patient and guidelines from medical societies are considered crucial to enable this digital transformation of medicine. The CEN-ISO 82304‐2 (hereinafter “82304‐2”) Technical Specification, an initiative of the European Commission, includes a research-based health app quality assessment framework comprising 81 quality requirements. Results of 82304‐2 app assessments are summarized in an intuitive “health app quality label.” The 82304‐2 quality label’s potential to increase HCP willingness to recommend health apps was recently confirmed. To adequately enable decision-making and thus app recommendations, 82304‐2 proposes a more detailed “health app quality report” to complement the 82304‐2 quality label. Objective: This study aimed to design the 82304‐2 health app quality report that satisfies the information needs of individual HCPs in decision-making on an individual health app for an individual patient. Methods: A participatory design approach was applied. In an 18-month process of participatory prototyping with 9 HCPs with digital health expertise, the 82304‐2 quality report was iteratively designed. A convenience sample of 31 HCPs indicated the priority 82304‐2 quality requirements they considered useful in decision-making on recommending an app, and thus needed detailed quality information. Final feedback meetings with the 9 HCPs and 8 medical societies were used to finalize the 82304‐2 quality report design. Web-based questions in these meetings, feedback from the Dutch Patient Federation, and a comparative content analysis and the Health Education Materials Assessment Tool were used to evolve to and evaluate the final 82304‐2 quality report design. Results: In total, 37% (30/81) of the 82304‐2 quality requirements were prioritized by >50% of the HCPs. The final 82304‐2 quality report design provides detailed information for 90% (27/30) of the prioritized quality requirements. The reporting detail for 2 quality requirements requires more research. The final feedback meetings, the Patient Federation feedback, comparative content analysis, and Health Education Materials Assessment Tool provide indicative proof of the usefulness and usability of the quality report design. Conclusions: We succeeded in our aim to design the 82304‐2 health app quality report and found promising potential for its distinctive usefulness for HCPs and patients in recommending and considering a health app, respectively, and for medical societies in creating guidance. Further efforts are needed to test its effectiveness, fine-tune multistakeholder and intercontinental usefulness and usability, support medical societies in providing guidance and potentially training on recommending health apps, and advance from the current design to a scalable fully functional version of the quality report and associated open access database.
- 23 October 2026
- Published by JMIR Publications Inc. in Journal of Participatory Medicine
- Vol. 18, e86473
Open AccessDeveloping a Health App Quality Report for CEN-ISO/TS 82304-2 to Satisfy Health Care Professionals’ Information Needs on the Quality of Health Apps: Participatory Design Study
Background: Health apps, which comprise medical and wellness apps, hold potential to improve prevention, diagnosis, treatment, and management of disease. Yet, recommendation and prescription rates by health care professionals (HCPs) are low. Trusted standardized health app quality reports providing the information HCPs need to recommend or prescribe a specific app for an individual patient and guidelines from medical societies are considered crucial to enable this digital transformation of medicine. The CEN-ISO 82304‐2 (hereinafter “82304‐2”) Technical Specification, an initiative of the European Commission, includes a research-based health app quality assessment framework comprising 81 quality requirements. Results of 82304‐2 app assessments are summarized in an intuitive “health app quality label.” The 82304‐2 quality label’s potential to increase HCP willingness to recommend health apps was recently confirmed. To adequately enable decision-making and thus app recommendations, 82304‐2 proposes a more detailed “health app quality report” to complement the 82304‐2 quality label. Objective: This study aimed to design the 82304‐2 health app quality report that satisfies the information needs of individual HCPs in decision-making on an individual health app for an individual patient. Methods: A participatory design approach was applied. In an 18-month process of participatory prototyping with 9 HCPs with digital health expertise, the 82304‐2 quality report was iteratively designed. A convenience sample of 31 HCPs indicated the priority 82304‐2 quality requirements they considered useful in decision-making on recommending an app, and thus needed detailed quality information. Final feedback meetings with the 9 HCPs and 8 medical societies were used to finalize the 82304‐2 quality report design. Web-based questions in these meetings, feedback from the Dutch Patient Federation, and a comparative content analysis and the Health Education Materials Assessment Tool were used to evolve to and evaluate the final 82304‐2 quality report design. Results: In total, 37% (30/81) of the 82304‐2 quality requirements were prioritized by >50% of the HCPs. The final 82304‐2 quality report design provides detailed information for 90% (27/30) of the prioritized quality requirements. The reporting detail for 2 quality requirements requires more research. The final feedback meetings, the Patient Federation feedback, comparative content analysis, and Health Education Materials Assessment Tool provide indicative proof of the usefulness and usability of the quality report design. Conclusions: We succeeded in our aim to design the 82304‐2 health app quality report and found promising potential for its distinctive usefulness for HCPs and patients in recommending and considering a health app, respectively, and for medical societies in creating guidance. Further efforts are needed to test its effectiveness, fine-tune multistakeholder and intercontinental usefulness and usability, support medical societies in providing guidance and potentially training on recommending health apps, and advance from the current design to a scalable fully functional version of the quality report and associated open access database.
- Open Access
- 31 October 2025
- Published by JMIR Publications Inc. in JMIR Preprints
How to Satisfy Health Care Professionals’ Information Needs on the Quality of Health Apps – Developing a Health App Quality Report for CEN-ISO/TS 82304-2: Participatory Design Study (Preprint)
BACKGROUND Health apps, which comprise both medical and wellness apps, hold potential to improve prevention, diagnosis, treatment, and management of disease. Yet, adoption by health care professionals (HCP) including recommendation and prescription rates are low, even in countries where these apps are reimbursed. Professional guidelines from medical societies and trusted standardized health app quality assessment reports providing the information HCPs need to recommend or prescribe a specific app for an individual patient are crucial to enable this digital transformation of medicine. The CEN-ISO/TS 82304-2 (hereinafter “82304-2”) Technical Specification, an initiative of the European Commission, includes a research-based health app quality assessment framework comprising 81 quality requirements. Results of 82304-2 app assessments are summarized in a “health app quality label”. The 82304-2 label’s potential to increase willingness to recommend health apps was recently confirmed. However, to adequately inform HCPs for recommending and prescribing high-quality apps a more detailed “health app quality report” is required in addition to the 82304-2 label. OBJECTIVE To codesign the 82304-2 health app quality report by including the information detail that satisfies the information needs of individual HCPs in decision-making on a health app. METHODS A Participatory Design approach was applied to generate the report. In an 18-month process of participatory prototyping with 9 HCPs with digital health expertise the 82304-2 health app quality report was iteratively developed, designed, and validated. A convenience sample of 31 HCPs indicated the priority 82304-2 health app quality requirements that would inform their decision-making on recommending an app and as such need detailed quality information. Final feedback meetings with the 9 HCPs with digital health expertise and 8 medical societies were used to finalize the 82304-2 report design. Web-based questions in these meetings, as well as a comparative content analysis and the Health Education Materials Assessment Tool (HEMAT) were used to indicatively evaluate the 82304-2 report design. RESULTS In total 30/81 (37%) of the 82304-2 quality requirements were prioritized by >50% of the HCPs. The final 82304-2 report design provides detailed information for 27/30 (90%) of the prioritized 82304-2 quality requirements. The reporting detail for two 82304-2 quality requirements requires more research. The final feedback meetings, comparative content analysis and HEMAT provide indicative proof of the usefulness and usability of the 82304-2 report design. CONCLUSIONS We succeeded in our aim to design the 82304-2 health app quality report and found promising potential for its distinctive usefulness for HCPs and medical societies. Further efforts are needed to test and fine-tune its multi-stakeholder and intercontinental usefulness and usability, to support medical societies in providing guidance and potentially training on recommending health apps, and to advance from the current design to a scalable fully-functional version of the 82304-2 report and associated open access database.
- 31 October 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessHow to Satisfy Health Care Professionals’ Information Needs on the Quality of Health Apps – Developing a Health App Quality Report for CEN-ISO/TS 82304-2: Participatory Design Study (Preprint)
BACKGROUND Health apps, which comprise both medical and wellness apps, hold potential to improve prevention, diagnosis, treatment, and management of disease. Yet, adoption by health care professionals (HCP) including recommendation and prescription rates are low, even in countries where these apps are reimbursed. Professional guidelines from medical societies and trusted standardized health app quality assessment reports providing the information HCPs need to recommend or prescribe a specific app for an individual patient are crucial to enable this digital transformation of medicine. The CEN-ISO/TS 82304-2 (hereinafter “82304-2”) Technical Specification, an initiative of the European Commission, includes a research-based health app quality assessment framework comprising 81 quality requirements. Results of 82304-2 app assessments are summarized in a “health app quality label”. The 82304-2 label’s potential to increase willingness to recommend health apps was recently confirmed. However, to adequately inform HCPs for recommending and prescribing high-quality apps a more detailed “health app quality report” is required in addition to the 82304-2 label. OBJECTIVE To codesign the 82304-2 health app quality report by including the information detail that satisfies the information needs of individual HCPs in decision-making on a health app. METHODS A Participatory Design approach was applied to generate the report. In an 18-month process of participatory prototyping with 9 HCPs with digital health expertise the 82304-2 health app quality report was iteratively developed, designed, and validated. A convenience sample of 31 HCPs indicated the priority 82304-2 health app quality requirements that would inform their decision-making on recommending an app and as such need detailed quality information. Final feedback meetings with the 9 HCPs with digital health expertise and 8 medical societies were used to finalize the 82304-2 report design. Web-based questions in these meetings, as well as a comparative content analysis and the Health Education Materials Assessment Tool (HEMAT) were used to indicatively evaluate the 82304-2 report design. RESULTS In total 30/81 (37%) of the 82304-2 quality requirements were prioritized by >50% of the HCPs. The final 82304-2 report design provides detailed information for 27/30 (90%) of the prioritized 82304-2 quality requirements. The reporting detail for two 82304-2 quality requirements requires more research. The final feedback meetings, comparative content analysis and HEMAT provide indicative proof of the usefulness and usability of the 82304-2 report design. CONCLUSIONS We succeeded in our aim to design the 82304-2 health app quality report and found promising potential for its distinctive usefulness for HCPs and medical societies. Further efforts are needed to test and fine-tune its multi-stakeholder and intercontinental usefulness and usability, to support medical societies in providing guidance and potentially training on recommending health apps, and to advance from the current design to a scalable fully-functional version of the 82304-2 report and associated open access database.
- Open Access
- 26 May 2025
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 13 (1) , e57474
Preferences and Willingness to Pay for Health App Assessments Among Health Care Stakeholders: Discrete Choice Experiment
Background: The adoption of high-quality health apps has been slow, despite the myriad benefits associated with their use. This is partly due to concerns regarding the effectiveness, safety, and data privacy of such apps. Quality assessments with robust and transparent criteria can address these concerns and, thereby, encourage the use of high-quality apps. However, a major challenge for such assessments is reaching a scale at which a substantial proportion of the more than 350,000 available health apps can be evaluated. Objective: To support the scaling of health app quality assessments, this study aimed to examine the preferences and willingness to pay for assessments with different value propositions among potential customers. Methods: We conducted 2 discrete choice experiments: one with 41 health app developers and another with 46 health system representatives (from health care institutions, authorities, and insurers) from across Europe. Mixed logit models were applied to examine the impact of assessment attributes on participants’ choices as well as to calculate marginal willingness to pay and predicted assessment uptake. Results: Among health app developers, the attributes with the largest impact on assessment choices were the associated clinical care uptake (integration into clinical guidelines and reimbursement or procurement) and cost (purchase price). Increased willingness to use assessed apps and app store integration of assessment results had a moderate impact on choices, while required developer time investment and time until assessment results become available made the smallest contribution. Among health system representatives, increased willingness of clinicians and patients to use evaluated apps had the greatest impact on assessment choices, followed by cost. Time until assessment result availability and the percentage of peers recommending the assessment made a moderate contribution, while reassessment frequency had the smallest impact on choices. On average, health app developers were willing to pay an additional €9020 (95% CI €4968-€13,072) if an assessment facilitates guideline integration and procurement or reimbursement (at the time of data collection, €1=US $1.11), while health system representatives were, on average, willing to pay €7037 (95% CI €4267-€9806) more if an assessment results in a large, rather than a small, increase in willingness to use the evaluated app. The predicted uptake of assessments that offer the preferred values for all attributes was 88.6% among app developers and 91.1% among health system representatives. Conclusions: These findings indicate that, to maximize uptake and willingness to pay among health app developers, it is advisable for assessments to facilitate or enable clinical guideline integration and reimbursement or procurement for high-scoring apps. Assessment scaling thus requires close collaboration with health authorities, health care institutions, and insurers. Furthermore, if health system organizations are targeted as customers, it is essential to provide evidence for the assessment’s impact on patients’ and clinicians’ willingness to use health apps.
- 26 May 2025
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 13 (1) , e57474
Open AccessPreferences and Willingness to Pay for Health App Assessments Among Health Care Stakeholders: Discrete Choice Experiment
Background: The adoption of high-quality health apps has been slow, despite the myriad benefits associated with their use. This is partly due to concerns regarding the effectiveness, safety, and data privacy of such apps. Quality assessments with robust and transparent criteria can address these concerns and, thereby, encourage the use of high-quality apps. However, a major challenge for such assessments is reaching a scale at which a substantial proportion of the more than 350,000 available health apps can be evaluated. Objective: To support the scaling of health app quality assessments, this study aimed to examine the preferences and willingness to pay for assessments with different value propositions among potential customers. Methods: We conducted 2 discrete choice experiments: one with 41 health app developers and another with 46 health system representatives (from health care institutions, authorities, and insurers) from across Europe. Mixed logit models were applied to examine the impact of assessment attributes on participants’ choices as well as to calculate marginal willingness to pay and predicted assessment uptake. Results: Among health app developers, the attributes with the largest impact on assessment choices were the associated clinical care uptake (integration into clinical guidelines and reimbursement or procurement) and cost (purchase price). Increased willingness to use assessed apps and app store integration of assessment results had a moderate impact on choices, while required developer time investment and time until assessment results become available made the smallest contribution. Among health system representatives, increased willingness of clinicians and patients to use evaluated apps had the greatest impact on assessment choices, followed by cost. Time until assessment result availability and the percentage of peers recommending the assessment made a moderate contribution, while reassessment frequency had the smallest impact on choices. On average, health app developers were willing to pay an additional €9020 (95% CI €4968-€13,072) if an assessment facilitates guideline integration and procurement or reimbursement (at the time of data collection, €1=US $1.11), while health system representatives were, on average, willing to pay €7037 (95% CI €4267-€9806) more if an assessment results in a large, rather than a small, increase in willingness to use the evaluated app. The predicted uptake of assessments that offer the preferred values for all attributes was 88.6% among app developers and 91.1% among health system representatives. Conclusions: These findings indicate that, to maximize uptake and willingness to pay among health app developers, it is advisable for assessments to facilitate or enable clinical guideline integration and reimbursement or procurement for high-scoring apps. Assessment scaling thus requires close collaboration with health authorities, health care institutions, and insurers. Furthermore, if health system organizations are targeted as customers, it is essential to provide evidence for the assessment’s impact on patients’ and clinicians’ willingness to use health apps.
- Open Access
- 17 February 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Preferences and Willingness to Pay for Health App Assessments Among Health Care Stakeholders: Discrete Choice Experiment (Preprint)
BACKGROUND The adoption of high-quality health apps has been slow, despite the myriad benefits associated with their use. This is partly due to concerns regarding the effectiveness, safety, and data privacy of such apps. Quality assessments with robust and transparent criteria can address these concerns and, thereby, encourage the use of high-quality apps. However, a major challenge for such assessments is reaching a scale at which a substantial proportion of the more than 350,000 available health apps can be evaluated. OBJECTIVE To support the scaling of health app quality assessments, this study aimed to examine the preferences and willingness to pay for assessments with different value propositions among potential customers. METHODS We conducted 2 discrete choice experiments: one with 41 health app developers and another with 46 health system representatives (from health care institutions, authorities, and insurers) from across Europe. Mixed logit models were applied to examine the impact of assessment attributes on participants’ choices as well as to calculate marginal willingness to pay and predicted assessment uptake. RESULTS Among health app developers, the attributes with the largest impact on assessment choices were the associated clinical care uptake (integration into clinical guidelines and reimbursement or procurement) and cost (purchase price). Increased willingness to use assessed apps and app store integration of assessment results had a moderate impact on choices, while required developer time investment and time until assessment results become available made the smallest contribution. Among health system representatives, increased willingness of clinicians and patients to use evaluated apps had the greatest impact on assessment choices, followed by cost. Time until assessment result availability and the percentage of peers recommending the assessment made a moderate contribution, while reassessment frequency had the smallest impact on choices. On average, health app developers were willing to pay an additional €9020 (95% CI €4968-€13,072) if an assessment facilitates guideline integration and procurement or reimbursement (at the time of data collection, €1=US $1.11), while health system representatives were, on average, willing to pay €7037 (95% CI €4267-€9806) more if an assessment results in a large, rather than a small, increase in willingness to use the evaluated app. The predicted uptake of assessments that offer the preferred values for all attributes was 88.6% among app developers and 91.1% among health system representatives. CONCLUSIONS These findings indicate that, to maximize uptake and willingness to pay among health app developers, it is advisable for assessments to facilitate or enable clinical guideline integration and reimbursement or procurement for high-scoring apps. Assessment scaling thus requires close collaboration with health authorities, health care institutions, and insurers. Furthermore, if health system organizations are targeted as customers, it is essential to provide evidence for the assessment’s impact on patients’ and clinicians’ willingness to use health apps.
- 17 February 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPreferences and Willingness to Pay for Health App Assessments Among Health Care Stakeholders: Discrete Choice Experiment (Preprint)
BACKGROUND The adoption of high-quality health apps has been slow, despite the myriad benefits associated with their use. This is partly due to concerns regarding the effectiveness, safety, and data privacy of such apps. Quality assessments with robust and transparent criteria can address these concerns and, thereby, encourage the use of high-quality apps. However, a major challenge for such assessments is reaching a scale at which a substantial proportion of the more than 350,000 available health apps can be evaluated. OBJECTIVE To support the scaling of health app quality assessments, this study aimed to examine the preferences and willingness to pay for assessments with different value propositions among potential customers. METHODS We conducted 2 discrete choice experiments: one with 41 health app developers and another with 46 health system representatives (from health care institutions, authorities, and insurers) from across Europe. Mixed logit models were applied to examine the impact of assessment attributes on participants’ choices as well as to calculate marginal willingness to pay and predicted assessment uptake. RESULTS Among health app developers, the attributes with the largest impact on assessment choices were the associated clinical care uptake (integration into clinical guidelines and reimbursement or procurement) and cost (purchase price). Increased willingness to use assessed apps and app store integration of assessment results had a moderate impact on choices, while required developer time investment and time until assessment results become available made the smallest contribution. Among health system representatives, increased willingness of clinicians and patients to use evaluated apps had the greatest impact on assessment choices, followed by cost. Time until assessment result availability and the percentage of peers recommending the assessment made a moderate contribution, while reassessment frequency had the smallest impact on choices. On average, health app developers were willing to pay an additional €9020 (95% CI €4968-€13,072) if an assessment facilitates guideline integration and procurement or reimbursement (at the time of data collection, €1=US $1.11), while health system representatives were, on average, willing to pay €7037 (95% CI €4267-€9806) more if an assessment results in a large, rather than a small, increase in willingness to use the evaluated app. The predicted uptake of assessments that offer the preferred values for all attributes was 88.6% among app developers and 91.1% among health system representatives. CONCLUSIONS These findings indicate that, to maximize uptake and willingness to pay among health app developers, it is advisable for assessments to facilitate or enable clinical guideline integration and reimbursement or procurement for high-scoring apps. Assessment scaling thus requires close collaboration with health authorities, health care institutions, and insurers. Furthermore, if health system organizations are targeted as customers, it is essential to provide evidence for the assessment’s impact on patients’ and clinicians’ willingness to use health apps.
- Open Access
- 12 February 2022
- Published by Elsevier in Medical Image Analysis
- Vol. 78, 102391
Deep learning models for triaging hospital head MRI examinations
- 12 February 2022
- Published by Elsevier in Medical Image Analysis
- Vol. 78, 102391
Open AccessDeep learning models for triaging hospital head MRI examinations