Evidence Following Conditional NICE Technology Appraisal Recommendations: A Critical Analysis of Methods, Quality and Risk of Bias
Open Access
- 9 September 2024
- journal article
- research article
- Published by Springer Nature in PharmacoEconomics
- Vol. 42 (12) , 1373-1394
Abstract
Background The National Institute for Health and Care Excellence (NICE) may approve health technologies on condition of more evidence generated only in research (OiR) or only with research (OwR). NICE specifies the information needed to comply with its request, although it may not necessarily guarantee good quality and timely evidence for re-appraisal, before reaching a final decision. Aim This study aimed to critically appraise the methods, quality and risk of bias of evidence generated in response to NICE OiR and OwR technology appraisal (TA) and highly specialised technologies (HSTs) recommendations. Methods NICE TAs (between March 2000 and September 2020) and HST evaluations (to October 2023) of medicines were reviewed. Conditional recommendations were analysed to identify the evidence requested by NICE for re-appraisal. The new evidence was analysed for compliance with NICE’s request and assessed using the Cochrane Collaboration’s tools for risk of bias in randomised trials and the ROBINS-I tool for non-randomised evidence. Results NICE made 54 conditional recommendations from TAs (13 OiR and 41 OwR) and five conditional recommendations for HSTs (all OwR). Of these, 16 TAs presented additional evidence for re-appraisal (9 OiR [69%] and 7 OwR [17%]) and three HSTs (3 OwR [60%]). Two of the nine re-appraised TAs with OiR recommendation and four of the seven OwR complied fully with NICE’s request for further evidence, while all three from the HSTs complied. The majority of re-appraised TAs and HSTs included evidence that was deemed to be at serious, high, moderate or unclear risk of bias. Among the 26 randomised controlled trials from TAs assessed, eight were categorised as having low risk of bias in all domains and ten had at least one domain as a high risk of bias. Reporting was unclear for the remainder. Twenty-two non-randomised studies, primarily single-arm studies, were susceptible to biases mostly due to the selection of participants and to confounding. Two HSTs provided evidence from randomised controlled trials which were classified as unclear or high risk of bias. All non-randomised evidence from HSTs were categorised as moderate or serious risk of bias. Conclusions There is widespread non-compliance with agreed data requests and important variation in the quality of evidence submitted in response to NICE conditional approval recommendations. Quality standards ought to be stipulated in respect to evidence contributing to re-appraisals following NICE conditional approval recommendations.Keywords
Funding Information
- Medical Research Council (MR/S014357/1)
- Health and Care Research Wales (SRL 2022-25-20)
This publication has 83 references indexed in Scilit:
- Coverage with evidence development for medical devices in Europe: Can practice meet theory?Health Economics, 2022
- Effect of Doxorubicin Plus Olaratumab vs Doxorubicin Plus Placebo on Survival in Patients With Advanced Soft Tissue SarcomasJAMA, 2020
- Impact of long‐term elosulfase alfa treatment on respiratory function in patients with Morquio A syndromeJournal of Inherited Metabolic Disease, 2016
- Efficacy and safety of enzyme replacement therapy with BMN 110 (elosulfase alfa) for Morquio A syndrome (mucopolysaccharidosis IVA): a phase 3 randomised placebo‐controlled studyJournal of Inherited Metabolic Disease, 2014
- Imatinib dose escalation in 74 failure or suboptimal response chronic myeloid leukaemia patients at 3‐year follow‐upAmerican Journal of Hematology, 2010
- Phase IV study evaluating efficacy of escalated dose of imatinib in chronic myeloid leukemia patients showing suboptimal response to standard dose imatinibAnnals of Hematology, 2010
- Dasatinib or high‐dose imatinib for chronic‐phase chronic myeloid leukemia resistant to imatinib at a dose of 400 to 600 milligrams dailyCancer, 2009
- Combination therapy with etanercept and anakinra in the treatment of patients with rheumatoid arthritis who have been treated unsuccessfully with methotrexateArthritis & Rheumatism, 2004
- Memantine Treatment in Patients With Moderate to Severe Alzheimer Disease Already Receiving DonepezilJAMA, 2004
- Long‐term safety and maintenance of clinical improvement following treatment with anakinra (recombinant human interleukin‐1 receptor antagonist) in patients with rheumatoid arthritis: Extension phase of a randomized, double‐blind, placebo‐controlled trialArthritis & Rheumatism, 2002