Validation of the Economic and Health Outcomes Model of Type 2 Diabetes Mellitus (ECHO-T2DM)
- 12 November 2016
- journal article
- research article
- Published by Springer Nature in PharmacoEconomics
- Vol. 35 (3) , 375-396
Abstract
Background The Economic and Health Outcomes Model of Type 2 Diabetes Mellitus (ECHO-T2DM) was developed to address study questions pertaining to the cost-effectiveness of treatment alternatives in the care of patients with type 2 diabetes mellitus (T2DM). Naturally, the usefulness of a model is determined by the accuracy of its predictions. A previous version of ECHO-T2DM was validated against actual trial outcomes and the model predictions were generally accurate. However, there have been recent upgrades to the model, which modify model predictions and necessitate an update of the validation exercises. Objectives The objectives of this study were to extend the methods available for evaluating model validity, to conduct a formal model validation of ECHO-T2DM (version 2.3.0) in accordance with the principles espoused by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the Society for Medical Decision Making (SMDM), and secondarily to evaluate the relative accuracy of four sets of macrovascular risk equations included in ECHO-T2DM. Methods We followed the ISPOR/SMDM guidelines on model validation, evaluating face validity, verification, cross-validation, and external validation. Model verification involved 297 ‘stress tests’, in which specific model inputs were modified systematically to ascertain correct model implementation. Cross-validation consisted of a comparison between ECHO-T2DM predictions and those of the seminal National Institutes of Health model. In external validation, study characteristics were entered into ECHO-T2DM to replicate the clinical results of 12 studies (including 17 patient populations), and model predictions were compared to observed values using established statistical techniques as well as measures of average prediction error, separately for the four sets of macrovascular risk equations supported in ECHO-T2DM. Sub-group analyses were conducted for dependent vs. independent outcomes and for microvascular vs. macrovascular vs. mortality endpoints. Results All stress tests were passed. ECHO-T2DM replicated the National Institutes of Health cost-effectiveness application with numerically similar results. In external validation of ECHO-T2DM, model predictions agreed well with observed clinical outcomes. For all sets of macrovascular risk equations, the results were close to the intercept and slope coefficients corresponding to a perfect match, resulting in high R 2 and failure to reject concordance using an F test. The results were similar for sub-groups of dependent and independent validation, with some degree of under-prediction of macrovascular events. Conclusion ECHO-T2DM continues to match health outcomes in clinical trials in T2DM, with prediction accuracy similar to other leading models of T2DM.Keywords
Funding Information
- Janssen LLC
This publication has 59 references indexed in Scilit:
- Does Glycemic Control Offer Similar Benefits Among Patients With Diabetes in Different Regions of the World?Diabetes Care, 2011
- Contemporary model for cardiovascular risk prediction in people with type 2 diabetesEuropean Journal of Preventive Cardiology, 2011
- Effects of Intensive Blood-Pressure Control in Type 2 Diabetes MellitusNew England Journal of Medicine, 2010
- A Health Policy Model of CKD: 2. The Cost-Effectiveness of Microalbuminuria ScreeningAmerican Journal of Kidney Diseases, 2010
- A Health Policy Model of CKD: 1. Model Construction, Assumptions, and Validation of Health ConsequencesAmerican Journal of Kidney Diseases, 2010
- 10-Year Follow-up of Intensive Glucose Control in Type 2 DiabetesNew England Journal of Medicine, 2008
- Intensive Blood Glucose Control and Vascular Outcomes in Patients with Type 2 DiabetesNew England Journal of Medicine, 2008
- Effects of Intensive Glucose Lowering in Type 2 DiabetesNew England Journal of Medicine, 2008
- Computer Modeling of Diabetes and Its ComplicationsDiabetes Care, 2007
- Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33)The Lancet, 1998