Advertisement
Review Article| Volume 60, ISSUE 3, P241-249, March 2007

Reporting in randomized clinical trials improved after adoption of the CONSORT statement

  • Robert L. Kane
    Correspondence
    Corresponding author. University of Minnesota School of Public Health, D351 Mayo (MMC 197), 420 Delaware Street SE, Minneapolis, MN 55455, USA. Tel.: 612-624-1185; fax: 612-624-8448.
    Affiliations
    University of Minnesota Clinical Outcomes Research Center, Minneapolis, MN, USA

    University of Minnesota School of Public Health, Division of Health Policy and Management, Minneapolis, MN, USA
    Search for articles by this author
  • Jye Wang
    Affiliations
    University of Minnesota School of Public Health, Division of Health Policy and Management, Minneapolis, MN, USA
    Search for articles by this author
  • Judith Garrard
    Affiliations
    University of Minnesota School of Public Health, Division of Health Policy and Management, Minneapolis, MN, USA
    Search for articles by this author

      Abstract

      Objective

      To examine the extent to which the Consolidated Standards of Reporting Trials (CONSORT) reporting guidelines improved clinical trials reporting and subject attrition, which may undermine the credibility of published randomized clinical trials (RCTs).

      Study Design and Setting

      Published RCTs reported in two major medical journals before and after the CONSORT guidelines were systematically reviewed; one used the CONSORT statement (JAMA) and one did not (NEJM).

      Results

      The quality of RCT reporting improved for both journals, but JAMA showed more significant and consistent improvements in all aspects of RCT reporting. Subject attrition was better accounted for after the publication of CONSORT, although the attrition rates for various reasons actually increased. Attrition due to unknown reasons, as a percentage of total attrition, declined dramatically, from 68.7% pre-CONSORT to 13.0% post-CONSORT.

      Conclusions

      Attrition of study subjects remains a serious problem in RCTs. Bias from selective attrition can undermine the presumptive scientific advantage of RCTs. The CONSORT guidelines improved RCT reporting when they were implemented but did not substantially improve reported attrition rates.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Peto R.
        • Collins R.
        • Gray R.
        Large-scale randomized evidence: large, simple trials and overviews of trials.
        J Clin Epidemiol. 1995; 48: 23-40
        • Berger V.W.
        • Bears J.D.
        When can a clinical trial be called ‘randomized’?.
        Vaccine. 2003; 21: 468-472
        • Campbell D.T.
        Reforms as social experiments.
        Am Psychol. 1969; 24: 409-429
        • Cook T.D.
        • Campbell D.T.
        Quasi-experimentation: design and analysis issues for field settings.
        Rand McNally, Chicago, IL1979
        • Shadish W.R.
        • Cook T.D.
        • Campbell D.T.
        Experimental and quasi-experimental designs for generalized causal inference.
        Houghton Mifflin Company, Boston, MA2002
        • Deeg D.J.H.
        Attrition in longitudinal population studies: does it affect the generalizability of the findings? An introduction to the series.
        J Clin Epidemiol. 2002; 55: 213-215
        • Dunn G.
        • Maracy M.
        • Dowrick C.
        • Ayuso-Mateos J.-L.
        • Dalgard O.
        • Page H.
        • et al.
        Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up.
        Br J Psychiatry. 2003; 183: 323-331
        • Dunn G.
        Estimating the causal effects of treatment.
        Epidemiol Psichiatr Soc. 2002; 11: 206-215
        • White I.R.
        • Moodie E.
        • Thompson S.G.
        • Croudace T.
        A modelling strategy for the analysis of clinical trials with partly missing longitudinal data.
        Int J Methods Psychiatr Res. 2003; 12: 139-150
        • Van Beijsterveldt C.E.M.
        • van Boxtel M.P.
        • Bosma H.
        • Houx P.J.
        • Buntinx F.
        • Jolles J.
        Predictors of attrition in a longitudinal cognitive aging study: the Maastricht Aging Study (MAAS).
        J Clin Epidemiol. 2002; 55: 216-223
        • Kempen G.I.J.M.
        • van Sonderen E.
        Psychological attributes and changes in disability among low-functioning older persons: does attrition affect the outcomes?.
        J Clin Epidemiol. 2002; 55: 224-229
        • The Standards of Reporting Trials Group
        A proposal for structured reporting of randomized controlled trials.
        JAMA. 1994; 272: 1926-1931
        • International Committee of Medical Journal Editors
        Uniform requirements for manuscripts submitted to biomedical journals.
        JAMA. 1993; 269: 2282-2286
        • DerSimonian R.
        • Charette L.J.
        • McPeek B.
        • Mosteller F.
        Reporting on methods in clinical trials.
        N Engl J Med. 1982; 306: 1332-1337
        • Rennie D.
        Reporting randomized controlled trials: an experiment and a call for response from readers.
        JAMA. 1995; 273: 1054-1055
        • Moher D.
        • Dulberg C.D.
        • Wells G.A.
        Statistical power, sample size, and their reporting in randomized controlled trials.
        JAMA. 1994; 272: 122-124
        • Begg C.
        • Cho M.
        • Eastwood S.
        • Horton R.
        • Moher D.
        • Olkin I.
        • et al.
        Improving the quality of reporting of randomized controlled trials: the CONSORT statement.
        JAMA. 1996; 276: 637-649
        • Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature
        Call for comments on a proposal to improve reporting of clinical trials in the biomedical literature.
        Ann Intern Med. 1994; 121: 894-895
        • Moher D.
        • Schulz K.F.
        • Altman D.G.
        The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials.
        Lancet. 2001; 357: 1191-1194
        • Moher D.
        • Jones A.
        • Lepage L.
        Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation.
        JAMA. 2001; 285: 1992-1995
        • Devereaux P.J.
        • Manns B.J.
        • Ghali W.A.
        • Quan H.
        • Guyatt G.H.
        The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the Consolidated Standards of Reporting Trials (CONSORT) checklist.
        Control Clin Trials. 2002; 23: 380-388
        • Northridge M.D.
        • Levin B.
        • Feinleib M.
        • Susser M.W.
        Statistics in the journal—significance, confidence, and all that.
        Am J Public Health. 1997; 87 ([Editorial]): 1092-1095
        • Hollis S.
        • Campbell F.
        What is meant by intention to treat analysis? Survey of published randomised controlled trials.
        BMJ. 1999; 319: 670-674
        • Hill C.L.
        • LaValley M.P.
        • Felson D.T.
        Discrepancy between published report and actual conduct of randomized clinical trials.
        J Clin Epidemiol. 2002; 55: 783-786
        • Mennemeyer S.T.
        Can econometrics rescue epidemiology?.
        Ann Epidemiol. 1997; 7: 249-250
        • Schulz K.F.
        • Chalmers I.
        • Hayes R.J.
        • Altman D.G.
        Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.
        JAMA. 1995; 273: 408-412
        • D'Agostino Jr., R.H.
        Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group.
        Stat Med. 1998; 17: 2265-2281
        • Slavin R.E.
        Best evidence synthesis: an intelligent alternative to meta-analysis.
        J Clin Epidemiol. 1995; 48: 9-18
      1. Field M. Lohr K. Guidelines for clinical practice: from development to use. National Academy Press, Washington, DC1992