KERMIT: Performance indicators in electronic patient reported outcome measures: a modified Delphi
Open Access
- 2 July 2025
- journal article
- research article
- Published by Springer Nature in Journal of Patient-Reported Outcomes
- Vol. 9 (1) , 1-7
Abstract
Introduction: The use of electronic patient reported outcome measures (ePROMs) is increasing in routine cancer care, with benefit demonstrated in improving patient survival, satisfaction and response time. ePROMs represent a complex intervention, with successful implementation reliant upon a range of questionnaires, platform, patient and clinician characteristics alongside the wider organisational readiness and environment. Key performance indicators (KPIs) assess the performance of a system. A KPI framework would offer value in assessing ePROM implementation projects, however the outcomes and indicators of importance are not clear. Method: A modified Delphi methodology was used to define a framework of KPIs for assessing the deployment of ePROMs in routine cancer care. Potential KPIs were identified through literature searches, de-duplicated and allocated to a matrix of domains. Delphi participants were identified through a literature review and study team networks. KPIs were presented to participants for prioritisation using an online platform. A final set of KPIs was identified through two rounds of consensus with participants rating each KPI for relevance. Results: The literature search generated a list of 196 potential KPIs of which 48 were considered by 15 experts in the Delphi process. Consensus was reached to include 12 KPIs in the first round and a further 2 KPIs in the second round. Participant’s open text responses were analysed, suggesting a number of areas of debate regarding which KPIs are most pertinent. Discussion: This work provides a framework of 14 KPIs, covering those of relevance to patients, clinicians and health services and recognising the acceptability, feasibility and impact of ePROMs. This framework offers a means to appraise the implementation of ePROMs, supporting teams as they implement ePROMs in routine cancer care and other healthcare settings.Keywords
This publication has 36 references indexed in Scilit:
- Effect of Electronic Symptom Monitoring on Patient-Reported Outcomes Among Patients With Metastatic CancerJAMA, 2022
- The role of patient-reported outcome measures in the continuum of cancer clinical care: ESMO Clinical Practice GuidelineAnnals of Oncology, 2022
- The Routine Clinical Implementation of Electronic Patient-reported Outcome Measures (ePROMs) at The Christie NHS Foundation TrustClinical Oncology, 2021
- Patient outcomes, patient experiences and process indicators associated with the routine use of patient-reported outcome measures (PROMs) in cancer care: a systematic reviewSupportive Care in Cancer, 2020
- Conduct and reporting of citation searching in Cochrane systematic reviews: A cross‐sectional studyResearch Synthesis Methods, 2019
- The REDCap consortium: Building an international community of software platform partnersJournal of Biomedical Informatics, 2019
- Improving an electronic system for measuring PROs in routine oncology practiceJournal of Cancer Survivorship, 2015
- The Delphi Technique in Nursing and Health Research2010
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Expert Opinions in Forecasting: The Role of the Delphi Technique2001