Further exploration of dissemination bias in qualitative research required to facilitate assessment within qualitative evidence syntheses



      To conceptualise and discuss dissemination bias in qualitative research.


      It is likely that the mechanisms leading to dissemination bias in quantitative research, including time lag, language, gray literature, and truncation bias also contribute to dissemination bias in qualitative research. These conceptual considerations have informed the development of a research agenda.


      Further exploration of dissemination bias in qualitative research is needed, including the extent of non-dissemination and related dissemination bias, and how to assess dissemination bias within qualitative evidence syntheses. We also need to consider the mechanisms through which dissemination bias in qualitative research could occur to explore approaches for reducing it.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Noyes J.
        • Popay J.
        • Pearson A.
        • Hannes K.
        • Booth A.
        Qualitative research and Cochrane reviews.
        in: Higgins J. Green S. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration, Oxford, UK2011
        • Bohren M.A.
        • Hunter E.C.
        • Munthe-Kaas H.M.
        • Souza J.P.
        • Vogel J.P.
        • Gulmezoglu A.M.
        Facilitators and barriers to facility-based delivery in low- and middle-income countries: a qualitative evidence synthesis.
        Reprod Health. 2014; 11: 71
        • Gulmezoglu A.M.
        • Chandler J.
        • Shepperd S.
        • Pantoja T.
        Reviews of qualitative evidence: a new milestone for Cochrane.
        Cochrane Database Syst Rev. 2013; 11 (ED000073): ED000073
        • Lewin S.
        • Bosch-Capblanch X.
        • Oliver S.
        • Akl E.A.
        • Vist G.E.
        • Lavis J.N.
        • et al.
        Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence.
        PLoS Med. 2012; 9: e1001187
        • Kane G.A.
        • Wood V.A.
        • Barlow J.
        Parenting programmes: a systematic review and synthesis of qualitative research.
        Child Care Health Dev. 2007; 33: 784-793
        • Glenton C.
        • Lewin S.
        • Gulmezoglu A.M.
        Expanding the evidence base for global recommendations on health systems: strengths and challenges of the OptimizeMNH guidance process.
        Implement Sci. 2016; 11: 98
        • Hannes K.
        • Macaitis K.
        A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers.
        Qual Res. 2012; 12: 402-442
        • Booth A.
        • Noyes J.
        • Flemming K.
        • Gerhardus A.
        • Wahlster P.
        • van der Wilt G.J.
        • et al.
        Guidance on choosing qualitative evidence synthesis methods for use in health technology assessments of complex interventions [Online].
        2016 (Available at) (Accessed October 18, 2016)
        • Riese H.
        • Carlsen B.
        • Glenton C.
        Qualitative research synthesis: how the whole can be greater than the sum of parts.
        Antropology. 2014; 21: 22-30
        • Tan T.P.
        • Stokes T.
        • Shaw E.J.
        Use of qualitative research as evidence in the clinical guideline program of the National Institute for Health and Clinical Excellence.
        Int J Evid Based Healthc. 2009; 7: 169-172
        • Glenton C.
        • Lewin S.
        • Norris S.
        Using evidence from qualitative research to develop WHO guidelines (chapter 15).
        in: Norris S. World health Organization Handbook for Guideline Development (2nd edition). 2nd ed. WHO: World Health Organization, Geneva, Switzerland2016
        • Haynes A.B.
        • Weiser T.G.
        • Berry W.R.
        • Lipsitz S.R.
        • Breizat A.H.
        • Dellinger E.P.
        • et al.
        A surgical safety checklist to reduce morbidity and mortality in a global population.
        N Engl J Med. 2009; 360: 491-499
        • Korkiakangas T.
        Mobilising a team for the WHO Surgical Safety Checklist: a qualitative video study.
        BMJ Qual Saf. 2017; 26: 177-188
        • Bergs J.
        • Lambrechts F.
        • Simons P.
        • Vlayen A.
        • Marneffe W.
        • Hellings J.
        • et al.
        Barriers and facilitators related to the implementation of surgical safety checklists: a systematic review of the qualitative evidence.
        BMJ Qual Saf. 2015; 24: 776-786
        • Lewin S.
        • Glenton C.
        • Munthe-Kaas H.
        • Carlsen B.
        • Colvin C.J.
        • Gülmezoglu M.
        • et al.
        Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual).
        PLoS Med. 2015; 12: e1001895
        • Chan A.-W.
        • Song F.
        • Vickers A.
        • Jefferson T.
        • Dickersin K.
        • Gøtzsche P.C.
        • et al.
        Increasing value and reducing waste: addressing inaccessible research.
        Lancet. 2014; 383: 257-266
        • Rothstein H.R.
        • Sutton A.J.
        • Borenstein M.
        Publication bias in meta-analysis. Publication bias in meta-analysis.
        John Wiley & Sons, Ltd, Chichester, UK2006: 1-7
        • Loder E.
        • Groves T.
        • Schroter S.
        • Merino J.G.
        • Weber W.
        Qualitative research and the BMJ.
        BMJ. 2016; 352: i641
        • Greenhalgh T.
        • Annandale E.
        • Ashcroft R.
        • Barlow J.
        • Black N.
        • Bleakley A.
        • et al.
        An open letter to the BMJ editors on qualitative research.
        BMJ. 2016; 352: i563
        • Meerpohl J.J.
        • Schell L.K.
        • Bassler D.
        • Gallus S.
        • Kleijnen J.
        • Kulig M.
        • et al.
        Evidence-informed recommendations to reduce dissemination bias in clinical research: conclusions from the OPEN (Overcome failure to Publish nEgative fiNdings) project based on an international consensus meeting.
        BMJ open. 2015; 5: e006666
        • Hopewell S.
        • Clarke M.
        • Stewart L.
        • Tierney J.
        Time to publication for results of clinical trials.
        Cochrane Database Syst Rev. 2007; : MR000011
        • Tanner-Smith E.E.
        • Polanin J.R.
        A retrospective analysis of dissemination biases in the brief alcohol intervention literature.
        Psychol Addict Behav. 2015; 29: 49-62
        • Toews I.
        • Glenton C.
        • Lewin S.
        • Berg R.C.
        • Noyes J.
        • Booth A.
        • et al.
        Extent, awareness and perception of dissemination bias in qualitative research: an explorative survey.
        PLoS One. 2016; 11: e0159290
      1. International Committee of Medical Journal Editors. Overlapping Publications, 2016. Available at Accessed October 18, 2016.

        • Song F.
        • Parekh S.
        • Hooper L.
        • Loke Y.K.
        • Ryder J.
        • Sutton A.J.
        • et al.
        Dissemination and publication of research findings: an updated review of related biases.
        Health Technol Assess. 2010; 14 (iii, ix-xi, 1–193)
        • Dwan K.
        • Altman D.G.
        • Cresswell L.
        • Blundell M.
        • Gamble C.L.
        • Williamson P.R.
        Comparison of protocols and registry entries to published reports for randomised controlled trials.
        Cochrane Database Syst Rev. 2011; : MR000031
        • Campbell R.
        • Pound P.
        • Morgan M.
        • Daker-White G.
        • Britten N.
        • Pill R.
        • et al.
        Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.
        Health Technol Assess. 2011; 15: 1-164
        • Blumle A.
        • Meerpohl J.J.
        • Schumacher M.
        • von Elm E.
        Fate of clinical research studies after ethical approval—follow-up of study protocols until publication.
        PLoS One. 2014; 9: e87184
        • Baudart M.
        • Ravaud P.
        • Baron G.
        • Dechartres A.
        • Haneef R.
        • Boutron I.
        Public availability of results of observational studies evaluating an intervention registered at ClinicalTrials.go.
        BMC Med. 2016; 14: 1-11
        • Malicki M.
        • Marusic A.
        • OPEN Consortium
        Is there a solution to publication bias? Researchers call for changes in dissemination of clinical research results.
        J Clin Epidemiol. 2014; 67: 1103-1110
        • Schmucker C.
        • Schell L.K.
        • Portalupi S.
        • Oeller P.
        • Cabrera L.
        • Bassler D.
        • et al.
        Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries.
        PLoS One. 2014; 9: e114023
        • Franco A.
        • Malhotra N.
        • Simonovits G.
        Publication bias in the social sciences: unlocking the file drawer.
        Science. 2014; 345: 1502-1505
        • Eyding D.
        • Lelgemann M.
        • Grouven U.
        • Harter M.
        • Kromp M.
        • Kaiser T.
        • et al.
        Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials.
        BMJ. 2010; 341: c4737
        • Petticrew M.
        • Egan M.
        • Thomson H.
        • Hamilton V.
        • Kunkler R.
        • Roberts H.
        Publication bias in qualitative research: what becomes of qualitative research presented at conferences?.
        J Epidemiol Community Health. 2008; 62: 552-554
        • Sterne J.
        • Egger M.
        • Moher D.
        Chapter 10: Addressing reporting biases. Cochrane Handbook for Systematic Reviews of Intervention Version 510.
        (updated March 2011) The Cochrane Collaboration, Oxford, UK2011
        • Booth A.
        • Lewin S.
        • Glenton C.
        • Munthe-Kaas H.
        • Meerpohl J.J.
        • Noyes J.
        • et al.
        Applying the GRADE-CERQual approach (7): understanding the potential impacts of dissemination bias.