Selection Bias in Real-World Data Studies Used to Support Health Technology Assessments: A Case Study in Metastatic Cancer
Open Access
- 6 February 2023
- journal article
- research article
- Published by MDPI AG in Current Oncology
- Vol. 30 (2) , 1945-1953
Abstract
Real-world evidence has been increasingly used to support evaluations of emerging therapies. These investigations are often conducted in settings that may not be representative of the underlying population. The purpose of this investigation was to empirically quantify the magnitude of this selection bias. Individuals diagnosed with solid metastatic cancer in Alberta, Canada, between 2010–2019 were identified using the provincial cancer registry for 13 common metastatic sites. Two outcomes used to support oncology reimbursement decisions were examined: the proportion of individuals who initiated systemic therapy and median overall survival (OS). These outcomes were assessed in the entire population and in a subset of individuals who were referred to a medical oncologist. Among the 23,152 individuals in the entire population, 40.8% (95% CI: 40.2–41.4) initiated systemic therapy, and the median OS from diagnosis was 5.4 months (95% CI: 5.3–5.6). Among those who were referred to a medical oncologist (n = 13,372; 57.8%), 67.4% (95% CI: 66.6–68.2) initiated systemic therapy, and the median OS from diagnosis was 11.2 months (95% CI: 10.9–11.5). The magnitude of bias varied by cancer site where lower referral rates were associated with greater bias. Non-referral is an important source of selection bias in real-world investigations. Studies that rely on limited-catchment real-world data should be interpreted with caution, particularly in metastatic cancer settings.Keywords
This publication has 11 references indexed in Scilit:
- Real-world data from expanded access programmes in health technology assessments: a review of NICE technology appraisalsBMJ Open, 2022
- The Role of Real‐World Evidence in FDA‐Approved New Drug and Biologics License ApplicationsClinical Pharmacology & Therapeutics, 2021
- Use of Real-World Evidence to Support FDA Approval of Oncology DrugsValue in Health, 2020
- Real-world evidence: the devil is in the detailDiabetologia, 2020
- Real-world evidence use in assessments of cancer drugs by NICEInternational Journal of Technology Assessment in Health Care, 2020
- Expanded Access as a source of real‐world data: An overview of FDA and EMA approvalsBritish Journal of Clinical Pharmacology, 2020
- Developing a framework to incorporate real-world evidence in cancer drug funding decisions: the Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaborationBMJ Open, 2020
- Multidimensional Evidence Generation and FDA Regulatory Decision MakingJAMA, 2017
- Selection Bias in Population-Based Cancer Case–Control Studies Due to Incomplete Sampling Frame CoverageCancer Epidemiology, Biomarkers & Prevention, 2012
- Assessment of selection bias in clinic‐based populations of childhood cancer survivors: A report from the childhood cancer survivor studyPediatric Blood & Cancer, 2009