Journal of Clinical Epidemiology
Volume 64, Issue 4 , Pages 349-357 , April 2011

Uptake of methods to deal with publication bias in systematic reviews has increased over time, but there is still much scope for improvement

  • Sheetal Parekh-Bhurke

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • Faculty of Health, School of Allied Health Professions, University of East Anglia, Norwich, United Kingdom
    • Corresponding Author InformationCorresponding author. Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, NR4 7TJ. Tel.: 02380 595701; fax: 023 8059 5639.
    • ,
  • Chun S. Kwok

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Chun Pang

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Lee Hooper

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Yoon K. Loke

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Jon J. Ryder

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Alex J. Sutton

      Affiliations

    • Department of Health Sciences, University of Leicester, Leicester, United Kingdom
    • ,
  • Caroline B. Hing

      Affiliations

    • Department of Trauma and Orthopaedics, St George's Hospital, Tooting, London, United Kingdom
    • ,
  • Ian Harvey

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • ,
  • Fujian Song

      Affiliations

    • Faculty of Health, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich, United Kingdom
    • Faculty of Health, School of Allied Health Professions, University of East Anglia, Norwich, United Kingdom

,Accepted 23 April 2010.

References 

  1. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 1990;263:1385–1389
  2. Song F, Parekh S, Hooper L, Loke Y, Ryder JJ, Sutton AJ, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1–219
  3. Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ. Publication and related biases. Health Technol Assess. 2000;4:1–115
  4. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174
  5. Lowry R. Available at http://faculty.vassar.edu/lowry/kappa.htmlAccessed Dec 4, 2009
  6. McDonald S, Taylor L, Adams C. Searching the right database. A comparison of four databases for psychiatry journals. Health Libr Rev. 1999;16:151–156
  7. Lefebvre C, Manheimer E, Glanville J. Searching for studies. In:  Higgins JPT,  Green S editor. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.2 (updated September 2009). The Cochrane Collaboration; 2009;Available at www.cochrane-handbook.orgAccessed Dec 4, 2009
  8. Gulmezoglu AM, Pang T, Horton R, Dickersin K. WHO facilitates international collaboration in setting standards for clinical trial registration. Lancet. 2005;365:1829–1831
  9. DeAngelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. JAMA. 2004;292:1363–1364
  10. Abbasi K. Compulsory registration of clinical trials. BMJ. 2004;329:637–638
  11. Laine C, Horton R, DeAngelis CD, Drazen JM, Frizelle FA, Godlee F, et al. Clinical trial registration: looking back and moving ahead. Lancet. 2007;369:1909–1911
  12. Whittington CJ, Kendall T, Fonagy P, Cottrell D, Cotgrove A, Boddington E. Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet. 2004;363:1341–1345
  13. Batt K, Rushby JAF, Riquelme MC. The costs, effects and cost-effectiveness of strategies to increase coverage of routine immunizations in low- and middle-income countries: systematic review of the grey literature. Bull World Health Organ. 2004;82:689–696
  14. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358:252–260
  15. van Driel ML, De Sutter A, De Maeseneer J, Christiaens T. Searching for unpublished trials in Cochrane reviews may not be worth the effort. J Clin Epidemiol. 2009;62(8):838–844.e3
  16. Davey-Smith G, Egger M. Meta-analysis: unresolved issues and future developments. BMJ. 1998;316:221–225
  17. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003;7:1–76
  18. Moher D, Pham B, Lawson ML, Klassen TP. The inclusion of reports of randomised trials published in languages other than English in systematic reviews. Health Technol Assess. 2003;7(41):1–90
  19. Heres S, Wagenpfeil S, Hamann J, Kissling W, Leucht S. Language bias in neuroscience—is the Tower of Babel located in Germany?. Eur Psychiatry. 2004;19:230–232
  20. Brazzelli M, Lewis SC, Deeks JJ, Sandercock PAG. No evidence of bias in the process of publication of diagnostic accuracy studies in stroke submitted as abstracts. J Clin Epidemiol. 2009;62:425–430
  21. Little J, Higgins JPT, editors. The HuGENet™ HuGE review handbook, version 1.0. Available at http://www.hugenet.ca. Accessed Dec 4, 2009.
  22. Pan Z, Trikalinos TA, Kavvoura FK, Lau J, Ioannidis JPA. Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature. [see comment] PLoS Med. 2005;2(12):e334
  23. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ. 2006;333:597–600
  24. Ioannidis JPA, Trikalinos TA. The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. CMAJ. 2007;176:1091–1096
  25. Sterne JAC, Egger M, Moher D. Addressing reporting biases. In:  Higgins JPT,  Green S editor. Cochrane Handbook for Systematic Reviews of Intervention. Version 5.0.1 (updated September 2008). The Cochrane Collaboration; 2008;Available at www.cochrane-handbook.orgAccessed Dec 4, 2009

 Competing interest: none declared.

 Authors' contributions: F.S., Y.K.L., L.H., J.J.R., A.J.S., and I.H. developed the review protocol. S.P.B., J.J.R., and F.S. conducted literature search. S.P.B., F.S., L.H., Y.K.L., J.J.R., C.B.H., C.S.K., and C.P. extracted and/or checked data from included studies. F.S., A.J.S., and I.H. provided methodological support. S.P.B., F.S., C.S.K., and C.P. analyzed data and drafted the article. All authors commented on the final manuscript.

PII: S0895-4356(10)00197-6

doi: 10.1016/j.jclinepi.2010.04.022

Journal of Clinical Epidemiology
Volume 64, Issue 4 , Pages 349-357 , April 2011

Article Tools

* Image Usage & Resolution