Advertisement
Original Article| Volume 65, ISSUE 3, P301-308, March 2012

The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency

  • Julius Sim
    Correspondence
    Corresponding author. Arthritis Research UK Primary Care Centre, Keele University, Keele, Staffordshire ST5 5BG, UK. Tel.: +44-1782-734253; fax: +44-1782-734255.
    Affiliations
    Arthritis Research UK Primary Care Centre, Keele University, Keele, Staffordshire ST5 5BG, UK
    Search for articles by this author
  • Martyn Lewis
    Affiliations
    Arthritis Research UK Primary Care Centre, Keele University, Keele, Staffordshire ST5 5BG, UK
    Search for articles by this author
Published:December 12, 2011DOI:https://doi.org/10.1016/j.jclinepi.2011.07.011

      Abstract

      Objective

      To investigate methods to determine the size of a pilot study to inform a power calculation for a randomized controlled trial (RCT) using an interval/ratio outcome measure.

      Study Design

      Calculations based on confidence intervals (CIs) for the sample standard deviation (SD).

      Results

      Based on CIs for the sample SD, methods are demonstrated whereby (1) the observed SD can be adjusted to secure the desired level of statistical power in the main study with a specified level of confidence; (2) the sample for the main study, if calculated using the observed SD, can be adjusted, again to obtain the desired level of statistical power in the main study; (3) the power of the main study can be calculated for the situation in which the SD in the pilot study proves to be an underestimate of the true SD; and (4) an “efficient” pilot size can be determined to minimize the combined size of the pilot and main RCT.

      Conclusion

      Trialists should calculate the appropriate size of a pilot study, just as they should the size of the main RCT, taking into account the twin needs to demonstrate efficiency in terms of recruitment and to produce precise estimates of treatment effect.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Wittes J.
        Sample size calculations for randomized controlled trials.
        Epidemiol Rev. 2002; 24: 39-53
        • Vickers A.J.
        Underpowering in randomized trials reporting a sample size calculation.
        J Clin Epidemiol. 2003; 56: 717-720
        • Lancaster G.A.
        • Dodd S.
        • Williamson P.R.
        Design and analysis of pilot studies: recommendations for good practice.
        J Eval Clin Pract. 2004; 10: 307-312
        • Julious S.A.
        Sample size of 12 per group rule of thumb for a pilot study.
        Pharm Stat. 2005; 4: 287-291
        • Birkett M.A.
        • Day S.J.
        Internal pilot studies for estimating sample size.
        Stat Med. 1994; 13: 2455-2463
        • Wittes J.
        • Brittain E.
        The role of internal pilot studies in increasing the efficiency of clinical trials.
        Stat Med. 1990; 9: 65-72
        • Zucker D.M.
        • Wittes J.T.
        • Schabenberger O.
        • Brittain E.
        Internal pilot studies II: comparison of various procedures.
        Stat Med. 1999; 18: 3493-3509
        • Friede T.
        • Kieser M.
        Sample size recalculation in internal pilot study designs: a review.
        Biom J. 2006; 48: 537-555
        • Machin D.
        • Campbell M.J.
        • Tan S.B.
        • Tan S.H.
        Sample size tables for clinical studies.
        3rd ed. Wiley-Blackwell, Chichester, UK2009
        • Miller I.
        • Miller M.
        John E Freund’s mathematical statistics.
        6th ed. Prentice Hall, Upper Saddle River, NJ1999
        • Browne R.H.
        On the use of a pilot sample for sample size determination.
        Stat Med. 1995; 14: 1933-1940
        • Johnson N.L.
        • Kotz S.
        Distributions in statistics: continuous univariate distributions—I.
        John Wiley, New York, NY1970
        • Kieser M.
        • Wassmer G.
        On the use of the upper confidence limit for the variance from a pilot sample for sample size determination.
        Biom J. 1996; 38: 941-949
        • Cohen J.
        Statistical power analysis for the behavioral sciences.
        2nd ed. Lawrence Erlbaum, Hillsdale, NJ1988
        • Julious S.A.
        Designing clinical trials with uncertain estimates of variability.
        Pharm Stat. 2004; 3: 261-268
        • Knottnerus J.A.
        • Bouter L.M.
        The ethics of sample size: two-sided testing and one-sided thinking.
        J Clin Epidemiol. 2001; 54: 109-110
        • Campbell M.J.
        • Julious S.A.
        • Altman D.G.
        Estimating sample sizes for binary, ordered categorical, and continuous outcomes in two group comparisons.
        BMJ. 1995; 311: 1145-1148
        • Newcombe R.G.
        • Altman D.G.
        Proportions and their differences.
        in: Altman D.G. Machin D. Bryant T.N. Gardner M.J. Statistics with confidence. 2nd ed. BMJ Books, London, UK2000: 45-56