Advertisement
Original Article| Volume 154, P85-96, February 2023

Reporting quality was suboptimal in a systematic review of randomized controlled trials with adaptive designs

  • Sujata Purja
    Affiliations
    Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
    Search for articles by this author
  • Author Footnotes
    1 Chinle Comprehensive Health Care Facility, Highway 191 Chinle, AZ 86503, USA.
    Sunuk Park
    Footnotes
    1 Chinle Comprehensive Health Care Facility, Highway 191 Chinle, AZ 86503, USA.
    Affiliations
    Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
    Search for articles by this author
  • SuA Oh
    Affiliations
    Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
    Search for articles by this author
  • Minji Kim
    Affiliations
    Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
    Search for articles by this author
  • EunYoung Kim
    Correspondence
    Corresponding author. Tel: +82-10-9933-3373; fax: +82-02-816-7338.
    Affiliations
    Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea

    The Graduate School for Food and Drug Administration, and The Graduate School for Pharmaceutical Industry Management, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
    Search for articles by this author
  • Author Footnotes
    1 Chinle Comprehensive Health Care Facility, Highway 191 Chinle, AZ 86503, USA.
Published:December 16, 2022DOI:https://doi.org/10.1016/j.jclinepi.2022.12.010

      Abstract

      Objective

      The study was conducted to evaluate the reporting quality of randomized controlled trials (RCTs) that use an adaptive design (AD) based on the 2020 AD Consolidated Standards for Reporting Trials 2010 extension (ACE) guidelines and identify factors associated with better reporting quality.

      Study Design and Setting

      PubMed, Embase, Cochrane, Web of Science, and Google Scholar were searched until November 1, 2022. Multivariable linear regression analysis was performed to investigate potential predictors.

      Results

      In total, 109 RCTs were included in our study. The mean compliance rate for the ACE checklist items was 69.75% ± 16.02. Key methodological items including allocation concealment and its implementations were poorly reported. There was also suboptimal reporting of checklist items related to the conduct of interim analyzes. Multivariable regression analysis showed better reporting quality with trial registration, nonindustry affiliation (first author), a sample size of >100, general medical journal type, publication date (≥2020), funding, and disclosure of the number of interim analyzes.

      Conclusion

      Our study showed that RCTs with AD had suboptimal reporting of 2020 ACE checklist items, particularly AD-specific items. Following the development of ACE guidelines, stricter adherence to the ACE guideline is necessary to improve their reporting quality. Pre-ACE and post-ACE adherence comparisons can be conducted in the future.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Dimairo M.
        • Pallmann P.
        • Wason J.
        • Todd S.
        • Jaki T.
        • Julious S.A.
        • et al.
        The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design.
        BMJ. 2020; 369: m115
        • FDA
        Adaptive Designs for Clinical Trials of Drugs and Biologics: Guidance for Industry.
        (Available at:)
        • Bauer P.
        • Bretz F.
        • Dragalin V.
        • König F.
        • Wassmer G.
        Twenty-five years of confirmatory adaptive designs: opportunities and pitfalls.
        Stat Med. 2016; 35: 325-347
        • Chow S.C.
        • Chang M.
        Adaptive design methods in clinical trials - a review.
        Orphanet J Rare Dis. 2008; 3: 11
        • Dimairo M.
        • Coates E.
        • Pallmann P.
        • Todd S.
        • Julious S.A.
        • Jaki T.
        • et al.
        Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design.
        BMC Med. 2018; 16: 210
        • Lin M.
        • Lee S.
        • Zhen B.
        • Scott J.
        • Horne A.
        • Solomon G.
        • et al.
        CBER's experience with adaptive design clinical trials.
        Ther Innov Regul Sci. 2016; 50: 195-203
        • Quinlan J.
        • Gaydos B.
        • Maca J.
        • Krams M.
        Barriers and opportunities for implementation of adaptive designs in pharmaceutical product development.
        Clin Trials. 2010; 7: 167-173
        • Hatfield I.
        • Allison A.
        • Flight L.
        • Julious S.A.
        • Dimairo M.
        Adaptive designs undertaken in clinical research: a review of registered clinical trials.
        Trials. 2016; 17: 150
        • Yordanov Y.
        • Dechartres A.
        • Porcher R.
        • Boutron I.
        • Altman D.G.
        • Ravaud P.
        Avoidable waste of research related to inadequate methods in clinical trials.
        BMJ. 2015; 350: h809
        • Chalmers I.
        • Glasziou P.
        Avoidable waste in the production and reporting of research evidence.
        Lancet. 2009; 374: 86-89
        • Moher D.
        • Hopewell S.
        • Schulz K.F.
        • Montori V.
        • Gøtzsche P.C.
        • Devereaux P.J.
        • et al.
        CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials.
        BMJ. 2010; 340: c869
        • Jung Y.J.
        • Oh Y.
        • Purja S.
        • Jeong H.
        • Kim E.
        Assessment of the reporting quality of randomized controlled trials related to the pharmacotherapy of COVID-19 based on the CONSORT 2010 checklist: a systematic review.
        Clin Microbiol Infect. 2022; 28: 620-624
        • Yin Y.
        • Shi F.
        • Zhang Y.
        • Zhang X.
        • Ye J.
        • Zhang J.
        Evaluation of reporting quality of randomized controlled trials in patients with COVID-19 using the CONSORT statement.
        PLoS One. 2021; 16: e0257093
        • Yuniar C.T.
        • Pratiwi B.
        • Ihsan A.F.
        • Laksono B.T.
        • Risfayanti I.
        • Fathadina A.
        • et al.
        Adverse events reporting quality of randomized controlled trials of COVID-19 vaccine using the CONSORT criteria for reporting harms: a systematic review.
        Vaccines (Basel). 2022; 10: 313
        • Liampas I.
        • Chlinos A.
        • Siokas V.
        • Brotis A.
        • Dardiotis E.
        Assessment of the reporting quality of RCTs for novel oral anticoagulants in venous thromboembolic disease based on the CONSORT statement.
        J Thromb Thrombolysis. 2019; 48: 542-553
        • Ghimire S.
        • Kyung E.
        • Kang W.
        • Kim E.
        Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals.
        Trials. 2012; 13: 77
        • Ghimire S.
        • Kyung E.
        • Lee H.
        • Kim E.
        Oncology trial abstracts showed suboptimal improvement in reporting: a comparative before-and-after evaluation using CONSORT for Abstract guidelines.
        J Clin Epidemiol. 2014; 67: 658-666
        • Stevely A.
        • Dimairo M.
        • Todd S.
        • Julious S.A.
        • Nicholl J.
        • Hind D.
        • et al.
        An investigation of the shortcomings of the CONSORT 2010 statement for the reporting of group sequential randomised controlled trials: a methodological systematic review.
        PLoS One. 2015; 10: e0141104
        • Mistry P.
        • Dunn J.A.
        • Marshall A.
        A literature review of applied adaptive design methodology within the field of oncology in randomised controlled trials and a proposed extension to the CONSORT guidelines.
        BMC Med Res Methodol. 2017; 17: 108
        • Page M.J.
        • McKenzie J.E.
        • Bossuyt P.M.
        • Boutron I.
        • Hoffmann T.C.
        • Mulrow C.D.
        • et al.
        The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.
        BMJ. 2021; 372: n71
        • Bhatt D.L.
        • Mehta C.
        Adaptive designs for clinical trials.
        N Engl J Med. 2016; 375: 65-74
        • Sterne J.A.C.
        • Savović J.
        • Page M.J.
        • Elbers R.G.
        • Blencowe N.S.
        • Boutron I.
        • et al.
        RoB 2: a revised tool for assessing risk of bias in randomised trials.
        BMJ. 2019; 366: l4898
        • Koo T.K.
        • Li M.Y.
        A guideline of selecting and reporting intraclass correlation coefficients for reliability research.
        J chiropractic Med. 2016; 15: 155-163
      1. Norman G.R. Streiner D.L. Biostatistics: The Bare Essentials. 3rd ed. BC Decker Inc., Hamilton, Ontario2008
        • Bothwell L.E.
        • Avorn J.
        • Khan N.F.
        • Kesselheim A.S.
        Adaptive design clinical trials: a review of the literature and ClinicalTrials.gov.
        BMJ Open. 2018; 8: e018320
        • Mhaskar R.
        • Djulbegovic B.
        • Magazin A.
        • Soares H.P.
        • Kumar A.
        Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols.
        J Clin Epidemiol. 2012; 65: 602-609
        • Feys F.
        • Bekkering G.E.
        • Singh K.
        • Devroey D.
        Do randomized clinical trials with inadequate blinding report enhanced placebo effects for intervention groups and nocebo effects for placebo groups?.
        Syst Rev. 2014; 3: 14
        • Chow S.-C.
        • Corey R.
        Benefits, challenges and obstacles of adaptive clinical trial designs.
        Orphanet J Rare Dis. 2011; 6: 79
        • Reveiz L.
        • Cortés-Jofré M.
        • Asenjo Lobos C.
        • Nicita G.
        • Ciapponi A.
        • Garcìa-Dieguez M.
        • et al.
        Influence of trial registration on reporting quality of randomized trials: study from highest ranked journals.
        J Clin Epidemiol. 2010; 63: 1216-1222
        • De Angelis C.
        • Drazen J.M.
        • Frizelle F.A.
        • Haug C.
        • Hoey J.
        • Horton R.
        • et al.
        Clinical trial registration: a statement from the international committee of medical journal editors.
        Lancet. 2004; 364: 911-912
        • Harvey L.A.
        Trial registration: a pre-requisite for publication and an ethical responsibility.
        Spinal Cord. 2017; 55: 329-330
        • Song S.Y.
        • Kim B.
        • Kim I.
        • Kim S.
        • Kwon M.
        • Han C.
        • et al.
        Assessing reporting quality of randomized controlled trial abstracts in psychiatry: adherence to CONSORT for abstracts: a systematic review.
        PLoS One. 2017; 12: e0187807
        • To M.J.
        • Jones J.
        • Emara M.
        • Jadad A.R.
        Are reports of randomized controlled trials improving over time? A systematic review of 284 articles published in high-impact general and specialized medical journals.
        PLoS One. 2013; 8: e84779
        • Peters J.P.
        • Hooft L.
        • Grolman W.
        • Stegeman I.
        Assessment of the quality of reporting of randomised controlled trials in otorhinolaryngologic literature - adherence to the CONSORT statement.
        PLoS One. 2015; 10: e0122328
        • Salandra R.
        Knowledge dissemination in clinical trials: exploring influences of institutional support and type of innovation on selective reporting.
        Res Policy. 2018; 47: 1215-1228
        • Tuech J.J.
        • Moutel G.
        • Pessaux P.
        • Thoma V.
        • Schraub S.
        • Herve C.
        Disclosure of competing financial interests and role of sponsors in phase III cancer trials.
        Eur J Cancer. 2005; 41: 2237-2240
        • Lundh A.
        • Krogsbøll L.T.
        • Gøtzsche P.C.
        Sponsors' participation in conduct and reporting of industry trials: a descriptive study.
        Trials. 2012; 13: 146
        • Liu K.
        • Zeng J.
        • Pei W.
        • Chen S.
        • Luo Z.
        • Lu L.
        • et al.
        Assessing the reporting quality in randomized controlled trials of acupuncture for postherpetic neuralgia using the CONSORT statement and STRICTA guidelines.
        J Pain Res. 2019; 12: 2359-2370
        • Tardy M.P.
        • Gal J.
        • Chamorey E.
        • Almairac F.
        • Vandenbos F.
        • Bondiau P.Y.
        • et al.
        Quality of randomized controlled trials reporting in the treatment of adult patients with high-grade gliomas.
        Oncologist. 2018; 23: 337-345
        • Sandhu S.S.
        • Sandhu J.
        • Kaur H.
        Reporting quality of randomized controlled trials in orthodontics--what affects it and did it improve over the last 10 years?.
        Eur J Orthod. 2015; 37: 356-366
        • Yap C.
        • Bedding A.
        • de Bono J.
        • Dimairo M.
        • Espinasse A.
        • Evans J.
        • et al.
        The need for reporting guidelines for early phase dose-finding trials: dose-Finding CONSORT Extension.
        Nat Med. 2022; 28: 6-7