Journal of Clinical Epidemiology
Volume 63, Issue 3 , Pages 282-288 , March 2010

Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis

  • Guido Schwarzer

      Affiliations

    • Institute of Medical Biometry and Medical Informatics, University Medical Center, Freiburg, Germany
    • German Cochrane Centre, University Medical Center, Freiburg, Germany
    • Corresponding Author InformationCorresponding author. Institute of Medical Biometry and Medical Informatics, University Medical Center, Stefan-Meier-Straße 26, D-79104 Freiburg, Germany Tel.: +49-761-203-6668; fax: +49-761-203-6680.
  • ,
  • James Carpenter

      Affiliations

    • Institute of Medical Biometry and Medical Informatics, University Medical Center, Freiburg, Germany
    • Medical Statistics Unit, London School of Hygiene & Tropical Medicine, London, UK
  • ,
  • Gerta Rücker

      Affiliations

    • Institute of Medical Biometry and Medical Informatics, University Medical Center, Freiburg, Germany
    • German Cochrane Centre, University Medical Center, Freiburg, Germany

,Accepted 29 May 2009.

References 

  1. Rothstein HR, Sutton AJ, Borenstein M. Publication bias in meta analysis: prevention, assessment and adjustments. Chichester, UK: Wiley; 2005;
  2. Nieminen P, Rücker G, Miettunen J, Carpenter JR, Schumacher M. Statistically significant papers in psychiatry were cited more often than others. J Clin Epidemiol. 2007;60:939–946
  3. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25:3443–3457
  4. Rücker G, Schwarzer G, Carpenter JR. Arcsine test for publication bias in meta-analyses with binary outcomes. Stat Med. 2008;27:746–763
  5. Copas J. What works?: selectivity models and meta-analysis. J R Stat Soc Ser A. 1999;162:95–109
  6. Copas J, Shi JQ. Meta-analysis, funnel plots and sensitivity analysis. Biostatistics. 2000;1:247–262
  7. Copas JB, Shi JQ. A sensitivity analysis for publication bias in systematic reviews. Stat Methods Med Res. 2001;10:251–265
  8. Little RJA, Rubin DB. Statistical analysis with missing data. 2nd edition. Chichester, UK: John Wiley & Sons; 2002;
  9. Carpenter JR, Schwarzer G, Rücker G, Künstler R. Empirical evaluation shows the Copas selection model provides a useful summary in 80% of meta-analyses. J Clin Epidemiol. 2009;62:624–631
  10. Carpenter J, Rücker G, Schwarzer G. Copas: an R package for fitting the Copas selection model. R Journal. 2009;[accepted for publication]
  11. R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria 2008. ISBN 3-900051-07-0. Available at http://www.R-project.org. Accessed Aug 21, 2009.
  12. Duval S, Tweedie R. A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000;95:89–98
  13. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56:455–463
  14. Duval S. The trim and fill method. In:  Rothstein HR,  Sutton AJ,  Borenstein M editor. Publication bias in meta-analysis—prevention, assessment and adjustments. Chichester, UK: Wiley; 2005;p. 127–144
  15. Schwarzer G. Meta: an R package for meta-analysis. R News. 2007;7(3):40–45Available at http://cran.r-project.org/doc/Rnews/Rnews_2007-3.pdfAccessed Aug 21, 2009
  16. Rücker G, Schwarzer G, Carpenter J, Olkin I. Why add anything to nothing? The arcsine difference as a measure of treatment effect in meta-analysis with zero cells. Stat Med. 2009;28:721–738doi: 10.1002/sim.3511
  17. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Stat Med. 2007;27:4544–4562
  18. Higgins J.P. Green S. (editors) Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.1 [updated September 2008]. The Cochrane Collaboration, 2008. Available at http://www.cochrane-handbook.org. Accessed Aug 21, 2009.
  19. Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Stat Med. 2003;22:2113–2126
  20. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999;18:2693–2708
  21. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–188
  22. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991;337:867–872
  23. Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR. Empirical assessment of effect of publication bias on meta-analyses. Br Med J. 2000;320:1574–1577

PII: S0895-4356(09)00223-6

doi: 10.1016/j.jclinepi.2009.05.008

Journal of Clinical Epidemiology
Volume 63, Issue 3 , Pages 282-288 , March 2010