Advertisement
Original Article| Volume 79, P96-103, November 2016

Reported estimates of diagnostic accuracy in ophthalmology conference abstracts were not associated with full-text publication

  • Daniël A. Korevaar
    Correspondence
    Corresponding author. Tel.: 0031-20566-1099.
    Affiliations
    Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
    Search for articles by this author
  • Jérémie F. Cohen
    Affiliations
    Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands

    INSERM U1153, Obstetrical, Perinatal and Pediatric Epidemiology Research Team (EPOPé), Center for Epidemiology and Statistics Sorbonne Paris Cité, Paris Descartes University, 53, avenue de l'Observatoire, 75014 Paris, France
    Search for articles by this author
  • René Spijker
    Affiliations
    Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, University Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands

    Medical Library, Academic Medical Center, University of Amsterdam, Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
    Search for articles by this author
  • Ian J. Saldanha
    Affiliations
    Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 North Wolfe Street, Baltimore, MD 21205, USA
    Search for articles by this author
  • Kay Dickersin
    Affiliations
    Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 North Wolfe Street, Baltimore, MD 21205, USA
    Search for articles by this author
  • Gianni Virgili
    Affiliations
    Department of Translational Surgery and Medicine, Eye Clinic, University of Florence, largo Brambilla, 3, 50134 Florence, Italy
    Search for articles by this author
  • Lotty Hooft
    Affiliations
    Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, University Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
    Search for articles by this author
  • Patrick M.M. Bossuyt
    Affiliations
    Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
    Search for articles by this author

      Abstract

      Objective

      To assess whether conference abstracts that report higher estimates of diagnostic accuracy are more likely to reach full-text publication in a peer-reviewed journal.

      Study Design and Setting

      We identified abstracts describing diagnostic accuracy studies, presented between 2007 and 2010 at the Association for Research in Vision and Ophthalmology (ARVO) Annual Meeting. We extracted reported estimates of sensitivity, specificity, area under the receiver operating characteristic curve (AUC), and diagnostic odds ratio (DOR). Between May and July 2015, we searched MEDLINE and EMBASE to identify corresponding full-text publications; if needed, we contacted abstract authors. Cox regression was performed to estimate associations with full-text publication, where sensitivity, specificity, and AUC were logit transformed, and DOR was log transformed.

      Results

      A full-text publication was found for 226/399 (57%) included abstracts. There was no association between reported estimates of sensitivity and full-text publication (hazard ratio [HR] 1.09 [95% confidence interval {CI} 0.98, 1.22]). The same applied to specificity (HR 1.00 [95% CI 0.88, 1.14]), AUC (HR 0.91 [95% CI 0.75, 1.09]), and DOR (HR 1.01 [95% CI 0.94, 1.09]).

      Conclusion

      Almost half of the ARVO conference abstracts describing diagnostic accuracy studies did not reach full-text publication. Studies in abstracts that mentioned higher accuracy estimates were not more likely to be reported in a full-text publication.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Schmucker C.
        • Schell L.K.
        • Portalupi S.
        • Oeller P.
        • Cabrera L.
        • Bassler D.
        • et al.
        Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries.
        PLoS One. 2014; 9: e114023
        • Scherer R.W.
        • Langenberg P.
        • von E.E.
        Full publication of results initially presented in abstracts.
        Cochrane Database Syst Rev. 2007; : MR000005
        • Hua F.
        • Walsh T.
        • Glenny A.M.
        • Worthington H.
        Thirty percent of abstracts presented at dental conferences are published in full: a systematic review.
        J Clin Epidemiol. 2016; 75: 16-28
        • Dwan K.
        • Gamble C.
        • Williamson P.R.
        • Kirkham J.J.
        Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review.
        PLoS One. 2013; 8: e66844
        • Dickersin K.
        The existence of publication bias and risk factors for its occurrence.
        JAMA. 1990; 263: 1385-1389
        • Song F.
        • Parekh-Bhurke S.
        • Hooper L.
        • Loke Y.K.
        • Ryder J.J.
        • Sutton A.J.
        • et al.
        Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies.
        BMC Med Res Methodol. 2009; 9: 79
        • Sterne J.A.C.
        • Egger M.
        • Moher D.
        Chapter 10: addressing reporting biases.
        in: Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0. The Cochrane Collaboration, 2011
        • Chan A.W.
        • Song F.
        • Vickers A.
        • Jefferson T.
        • Dickersin K.
        • Gotzsche P.C.
        • et al.
        Increasing value and reducing waste: addressing inaccessible research.
        Lancet. 2014; 383: 257-266
        • Hooft L.
        • Bossuyt P.M.
        Prospective registration of marker evaluation studies: time to act.
        Clin Chem. 2011; 57: 1684-1686
        • Rifai N.
        • Altman D.G.
        • Bossuyt P.M.
        Reporting bias in diagnostic and prognostic studies: time for action.
        Clin Chem. 2008; 54: 1101-1103
        • Korevaar D.A.
        • Ochodo E.A.
        • Bossuyt P.M.
        • Hooft L.
        Publication and reporting of test accuracy studies registered in ClinicalTrials.gov.
        Clin Chem. 2014; 60: 651-659
        • Brazzelli M.
        • Lewis S.C.
        • Deeks J.J.
        • Sandercock P.A.
        No evidence of bias in the process of publication of diagnostic accuracy studies in stroke submitted as abstracts.
        J Clin Epidemiol. 2009; 62: 425-430
        • Wilson C.
        • Kerr D.
        • Noel-Storr A.
        • Quinn T.J.
        Associations with publication and assessing publication bias in dementia diagnostic test accuracy studies.
        Int J Geriatr Psychiatry. 2015; 30: 1250-1256
        • Deeks J.J.
        • Macaskill P.
        • Irwig L.
        The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed.
        J Clin Epidemiol. 2005; 58: 882-893
        • Bachmann L.M.
        • Puhan M.A.
        • ter Riet G.
        • Bossuyt P.M.
        Sample sizes of studies on diagnostic accuracy: literature survey.
        BMJ. 2006; 332: 1127-1129
        • Ochodo E.A.
        • de Haan M.C.
        • Reitsma J.B.
        • Hooft L.
        • Bossuyt P.M.
        • Leeflang M.M.
        Overinterpretation and misreporting of diagnostic accuracy studies: evidence of “spin”.
        Radiology. 2013; 267: 581-588
        • van Enst W.A.
        • Ochodo E.
        • Scholten R.J.
        • Hooft L.
        • Leeflang M.M.
        Investigation of publication bias in meta-analyses of diagnostic test accuracy: a meta-epidemiological study.
        BMC Med Res Methodol. 2014; 14: 70
        • Linnet K.
        • Bossuyt P.M.
        • Moons K.G.
        • Reitsma J.B.
        Quantifying the accuracy of a diagnostic test or marker.
        Clin Chem. 2012; 58: 1292-1301
        • Glas A.S.
        • Lijmer J.G.
        • Prins M.H.
        • Bonsel G.J.
        • Bossuyt P.M.
        The diagnostic odds ratio: a single indicator of test performance.
        J Clin Epidemiol. 2003; 56: 1129-1135
        • Walter S.D.
        • Sinuff T.
        Studies reporting ROC curves of diagnostic and prediction data can be incorporated into meta-analyses using corresponding odds ratios.
        J Clin Epidemiol. 2007; 60: 530-534
        • Kho M.E.
        • Brouwers M.C.
        Conference abstracts of a new oncology drug do not always lead to full publication: proceed with caution.
        J Clin Epidemiol. 2009; 62: 752-758
        • Juzych M.S.
        • Shin D.H.
        • Coffey J.
        • Juzych L.
        • Shin D.
        Whatever happened to abstracts from different sections of the association for research in vision and ophthalmology?.
        Invest Ophthalmol Vis Sci. 1993; 34: 1879-1882
        • Scherer R.W.
        • Dickersin K.
        • Langenberg P.
        Full publication of results initially presented in abstracts. A meta-analysis.
        JAMA. 1994; 272: 158-162
        • Saldanha I.J.
        • Scherer R.W.
        • Rodriguez-Barraquer I.
        • Jampel H.D.
        • Dickersin K.
        Dependability of results in conference abstracts of randomized controlled trials in ophthalmology and author financial conflicts of interest as a factor associated with full publication.
        Trials. 2016; 17: 213
        • Korevaar D.A.
        • Cohen J.F.
        • Hooft L.
        • Bossuyt P.M.
        Literature survey of high-impact journals revealed reporting weaknesses in abstracts of diagnostic accuracy studies.
        J Clin Epidemiol. 2015; 68: 708-715
        • Scherer R.W.
        • Ugarte-Gil C.
        • Schmucker C.
        • Meerpohl J.J.
        Authors report lack of time as main reason for unpublished research presented at biomedical conferences: a systematic review.
        J Clin Epidemiol. 2015; 68: 803-810
        • Wager E.
        • Williams P.
        “Hardly worth the effort”? Medical journals' policies and their editors' and publishers' views on trial registration and publication bias: quantitative and qualitative study.
        BMJ. 2013; 347: f5248
        • Lumbreras B.
        • Parker L.A.
        • Porta M.
        • Pollan M.
        • Ioannidis J.P.
        • Hernandez-Aguado I.
        Overinterpretation of clinical applicability in molecular diagnostic research.
        Clin Chem. 2009; 55: 786-794
        • Dickersin K.
        • Rennie D.
        The evolution of trial registries and their use to assess the clinical trial enterprise.
        JAMA. 2012; 307: 1861-1864
        • De Angelis C.D.
        • Drazen J.M.
        • Frizelle F.A.
        • Haug C.
        • Hoey J.
        • Horton R.
        • et al.
        Clinical trial registration: a statement from the International Committee of Medical Journal Editors.
        JAMA. 2004; 292: 1363-1364
        • Hooft L.
        • Korevaar D.A.
        • Molenaar N.
        • Bossuyt P.M.
        • Scholten R.J.
        Endorsement of ICMJE's Clinical Trial Registration Policy: a survey among journal editors.
        Neth J Med. 2014; 72: 349-355
        • Zarin D.A.
        • Tse T.
        • Ide N.C.
        Trial Registration at ClinicalTrials.gov between May and October 2005.
        N Engl J Med. 2005; 353: 2779-2787
        • Viergever R.F.
        • Li K.
        Trends in global clinical trial registration: an analysis of numbers of registered clinical trials in different parts of the world from 2004 to 2013.
        BMJ Open. 2015; 5: e008932
        • Korevaar D.A.
        • Bossuyt P.M.
        • Hooft L.
        Infrequent and incomplete registration of test accuracy studies: analysis of recent study reports.
        BMJ Open. 2014; 4: e004596
        • Altman D.G.
        The time has come to register diagnostic and prognostic research.
        Clin Chem. 2014; 60: 580-582
        • Rifai N.
        • Bossuyt P.M.
        • Ioannidis J.P.
        • Bray K.R.
        • McShane L.M.
        • Golub R.M.
        • et al.
        Registering diagnostic and prognostic trials of tests: is it the right thing to do?.
        Clin Chem. 2014; 60: 1146-1152
        • Moher D.
        • Glasziou P.
        • Chalmers I.
        • Nasser M.
        • Bossuyt P.M.
        • Korevaar D.A.
        • et al.
        Increasing value and reducing waste in biomedical research: who's listening?.
        Lancet. 2016; 387: 1573-1586