Development of a minimum checklist to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance
Open Access
- 29 October 2025
- journal article
- Published by BMJ in BMJ Surgery, Interventions, & Health Technologies
- Vol. 7 (1) , e000364
Abstract
Objectives: Medical device registries in Europe report limited information about their structure and methodological characteristics. This hinders their utility for evaluation of medical device safety and performance under the Medical Device Regulation. This study aimed to define a minimum checklist of items necessary for regulators to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance. Design: A three-round Delphi panel. Setting: A task within the Coordinating Research and Evidence for Medical Devices project. Participants: 101 experts in the medical device community (healthcare professionals, methodologists, registry experts, regulators, and assessors from notified bodies) were invited. Interventions: Based on a literature review and expert advice, 27 items relating to the quality of registry data and the analysis of medical device safety and performance were selected. In round 1, participants selected which items were required for a minimum checklist. They could also propose new items. Items selected by ≥70% of participants indicated consensus. Remaining items were discussed in round 2, resulting in a final checklist that was ranked by participants for importance (round 3). Main outcome measures: Consensus of items to be included in the minimum checklist. Results: 51 experts participated in round 1, achieving consensus on 18 (67%) items and suggesting 12 items. After discussion in round 2, 5 additional items were selected, resulting in a final set of 15 data quality items and 8 data analysis items. The most important items were ‘completeness of procedures’ (data quality) and ‘definition of outcome analyzed’” (quality of analysis). Conclusions: Reporting all items from the minimum checklist will facilitate judgment of the utility of registry data to evaluate medical devices during post-market surveillance.Keywords
Funding Information
- European Union Horizon 2020 Research and Innovation Program (965246)
This publication has 15 references indexed in Scilit:
- Advancing the Real-World Evidence for Medical Devices through Coordinated Registry NetworksBMJ Surgery, Interventions, & Health Technologies, 2022
- A tool to assess the registries quality: The Registry Evaluation and Quality Standards Tool (REQueST)European Journal of Public Health, 2021
- Improved clinical investigation and evaluation of high-risk medical devices: the rationale and objectives of CORE-MD (Coordinating Research and Evidence for Medical Devices)European Heart Journal - Quality of Care and Clinical Outcomes, 2021
- IDEAL as a guide to designing clinical device studies consistent with the new European Medical Device RegulationBMJ Surgery, Interventions, & Health Technologies, 2021
- Electronic health data quality maturity model for medical device evaluationsBMJ Surgery, Interventions, & Health Technologies, 2020
- Delphi procedure in core outcome set development: rating scale and consensus criteria determined outcome selectionJournal of Clinical Epidemiology, 2019
- A Delphi study to build consensus on the definition and use of big data in obesity researchInternational Journal of Obesity, 2019
- How to use the nominal group and Delphi techniquesInternational Journal of Clinical Pharmacy, 2016
- Delphi: myths and realityJournal of Health Organization and Management, 2003
- Research guidelines for the Delphi survey techniqueJournal of Advanced Nursing, 2000