Constraint-induced movement therapy: trial sequential analysis applied to Cochrane collaboration systematic review results
Open Access
- 26 December 2014
- journal article
- research article
- Published by Springer Nature in Trials
- Vol. 15 (1) , 1-12
Abstract
Trial sequential analysis (TSA) may establish when firm evidence about the efficacy of interventions is reached in a cumulative meta-analysis, combining a required information size with adjusted thresholds for conservative statistical significance. Our aim was to demonstrate TSA results on randomized controlled trials (RCTs) included in a Cochrane systematic review on the effectiveness of constraint-induced movement therapy (CIMT) for stroke patients. We extracted data on the functional independence measure (FIM) and the action research arm test (ARAT) from RCTs that compared CIMT versus other rehabilitative techniques. Mean differences (MD) were analyzed using a random-effects model. We calculated the information size and the cumulative Z-statistic, applying the O’Brien-Fleming monitoring boundaries. We included data from 14 RCTs. In the conventional meta-analysis (seven trials, 233 patients), the effect of CIMT on FIM was reported as significant (MD 2.88, 95% CI 0.08 to 5.68; P = 0.04). The diversity-adjusted required information size was 142 patients, and the cumulative Z-score did not cross the trial sequential monitoring boundary for benefit (adjusted 95% CI -0.02 to 5.78). The effect of CIMT on ARAT (nine trials, 199 patients) was reported as significant (MD 7.78, 95% CI 1.19 to 14.37; P = 0.02). However, the diversity-adjusted required information size was 252 patients, and the Z-score did not cross the trial sequential monitoring boundary for benefit (adjusted 95% CI -0.06 to 15.62). Although conventional meta-analyses of CIMT reached statistical significance, their overall results remain inconclusive and might be spurious. Researchers should not be overconfident on CIMT efficacy based on the results of meta-analyses and derived recommendations.Keywords
This publication has 63 references indexed in Scilit:
- The Number of Patients and Events Required to Limit the Risk of Overestimation of Intervention Effects in Meta-Analysis—A Simulation StudyPLOS ONE, 2011
- Estimating required information size by quantifying diversity in random-effects model meta-analysesBMC Medical Research Methodology, 2009
- Very Early Constraint-Induced Movement during Stroke Rehabilitation (VECTORS)Neurology, 2009
- Estimating Minimal Clinically Important Differences of Upper-Extremity Measures Early After StrokeArchives of Physical Medicine and Rehabilitation, 2008
- Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological studyBMJ, 2008
- Interpreting clinically significant changes in patient‐reported outcomesCancer, 2007
- Effect of Constraint-Induced Movement Therapy on Upper Extremity Function 3 to 9 Months After StrokeJAMA, 2006
- Measurement of health statusControlled Clinical Trials, 1989
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986
- A performance test for assessment of upper limb function in physical rehabilitation treatment and researchInternational Journal of Rehabilitation Research, 1981