The development of CHAMP: a checklist for the appraisal of moderators and predictors
Authors:
- Ralph van HoornRHRalph van Hoorn
- Marcia TummersMTMarcia Tummers
- Andrew BoothABAndrew Booth
- Ansgar GerhardusAGAnsgar Gerhardus
- Eva RehfuessEREva Rehfuess
- Daniel HindDHDaniel Hind
- Patrick M. BossuytPBPatrick M. Bossuyt
- Vivian WelchVWVivian Welch
- Thomas P. A. DebrayTDThomas P. A. Debray
- Martin UnderwoodMUMartin Underwood
- Pim CuijpersPCPim Cuijpers
- Helena KraemerHKHelena Kraemer
Open Access
- 21 December 2017
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 17 (1) , 1-9
Abstract
Personalized healthcare relies on the identification of factors explaining why individuals respond differently to the same intervention. Analyses identifying such factors, so called predictors and moderators, have their own set of assumptions and limitations which, when violated, can result in misleading claims, and incorrect actions. The aim of this study was to develop a checklist for critically appraising the results of predictor and moderator analyses by combining recommendations from published guidelines and experts in the field. Candidate criteria for the checklist were retrieved through systematic searches of the literature. These criteria were evaluated for appropriateness using a Delphi procedure. Two Delphi rounds yielded a pilot checklist, which was tested on a set of papers included in a systematic review on reinforced home-based palliative care. The results of the pilot informed a third Delphi round, which served to finalize the checklist. Forty-nine appraisal criteria were identified in the literature. Feedback was obtained from fourteen experts from (bio)statistics, epidemiology and other associated fields elicited via three Delphi rounds. Additional feedback from other researchers was collected in a pilot test. The final version of our checklist included seventeen criteria, covering the design (e.g. a priori plausibility), analysis (e.g. use of interaction tests) and results (e.g. complete reporting) of moderator and predictor analysis, together with the transferability of the results (e.g. clinical importance). There are criteria both for individual papers and for bodies of evidence. The proposed checklist can be used for critical appraisal of reported moderator and predictor effects, as assessed in randomized or non-randomized studies using individual participant or aggregate data. This checklist is accompanied by a user’s guide to facilitate implementation. Its future use across a wide variety of research domains and study types will provide insights about its usability and feasibility.Keywords
Funding Information
- FP7 Health 2012 Innovation (306141)
This publication has 56 references indexed in Scilit:
- Consensus-based recommendations for investigating clinical heterogeneity in systematic reviewsBMC Medical Research Methodology, 2013
- Patient-centered medicine and patient-oriented research: improving health outcomes for individual patientsBMC Medical Informatics and Decision Making, 2013
- Heterogeneity of treatment effects: from „How to treat” to „Whom to treat”Evidence-Based Spine-Care Journal, 2011
- Methodological criteria for the assessment of moderators in systematic reviews of randomised controlled trials: a consensus studyBMC Medical Research Methodology, 2011
- Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposalTrials, 2010
- Subgroup Analysis of Trials Is Rarely Easy (SATIRE): a study protocol for a systematic review to characterize the analysis, reporting, and claim of subgroup effects in randomized trialsTrials, 2009
- Dealing with heterogeneity of treatment effects: is the literature up to the challenge?Trials, 2009
- How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches.Health Psychology, 2008
- Development and validation of biomarker classifiers for treatment selectionJournal of Statistical Planning and Inference, 2007
- Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problemsStatistics in Medicine, 2002