A hypothesis test of feasibility for external pilot trials assessing recruitment, follow‐up, and adherence rates
Open Access
- 14 June 2021
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 40 (21) , 4714-4731
Abstract
The power of a large clinical trial can be adversely affected by low recruitment, follow‐up, and adherence rates. External pilot trials estimate these rates and use them, via prespecified decision rules, to determine if the definitive trial is feasible and should go ahead. There is little methodological research underpinning how these decision rules, or the sample size of the pilot, should be chosen. In this article we propose a hypothesis test of the feasibility of a definitive trial, to be applied to the external pilot data and used to make progression decisions. We quantify feasibility by the power of the planned trial, as a function of recruitment, follow‐up, and adherence rates. We use this measure to define hypotheses to test in the pilot, propose a test statistic, and show how the error rates of this test can be calculated for the common scenario of a two‐arm parallel group definitive trial with a single normally distributed primary endpoint. We use our method to redesign TIGA‐CUB, an external pilot trial comparing a psychotherapy with treatment as usual for children with conduct disorders. We then extend our formulation to include using the pilot data to estimate the standard deviation of the primary endpoint and incorporate this into the progression decision.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agenciesTrials, 2013
- The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiencyJournal of Clinical Epidemiology, 2012
- What is a pilot or feasibility study? A review of current practice and editorial policyBMC Medical Research Methodology, 2010
- A tutorial on pilot studies: the what, why and howBMC Medical Research Methodology, 2010
- Developing and evaluating complex interventions: the new Medical Research Council guidanceBMJ, 2008
- Power and sample size when multiple endpoints are consideredPharmaceutical Statistics, 2007
- Some geometric methods for constructing decision criteria based on two-dimensional parametersJournal of Statistical Planning and Inference, 2007
- Accounting for Variability in Sample Size Estimation with Applications to Nonadherence and Estimation of Variance and Effect SizeBiometrics, 2006
- Challenge of multiple co‐primary endpoints: a new approachStatistics in Medicine, 2006
- Sample size calculations for clinical studies allowing for uncertainty about the variancePharmaceutical Statistics, 2006