Advertisement
Original Article| Volume 139, P210-213, November 2021

Download started.

Ok

GRADE Notes 2: Criteria for searching non-randomized or indirect evidence should be defined early in the guideline production process

      Abstract

      Objective

      To discuss two alternative approaches for complementing the body of direct evidence from Randomized Controlled Trials (RCTs) when it is judged insufficient from a guideline panel making recommendations. The approaches included expanding the evidence's body to non-randomises studies on the population of interest or to RCTs on indirect populations.

      Study Design and Setting

      In this report, we adopt the perspective of an evidence review team developing guidelines following the GRADE approach. Our experience is based on the development of two evidence-based guidelines promoted by The Italian National Institute of Health (ISS) and focusing on diagnosis and treatment of Autism Spectrum Disorders (ASD) in children/adolescents and adults.

      Results

      We left panel members deciding case by case whether the direct evidence from RCTs was sufficient or not and indicating which alternative to implement. This strategy presented unanticipated challenges both from an organizational and methodological standpoint.

      Conclusion

      We suggest an early-stage production of a research protocol to define the criteria for expanding the body of evidence. These criteria should be informed by considerations around the certainty in the evidence, the clinical applicability of the results, feasibility and conflict of interest.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Schünemann HJ
        • Wiercioch W
        • Etxeandia I
        • et al.
        Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise.
        CMAJ. 2014; 186: E123-E142
        • Hulley SB
        • Cummings S
        • Browner W
        • Grady D
        • Newman T.
        Designing Clinical Research 2013.
        Philadelphia. Lippincott Williams & Wilkins, 2013
        • Ferreira JC
        • Patino CM.
        Choosing wisely between randomized controlled trials and observational designs in studies about interventions.
        J Bras Pneumol. 2016; 42: 165
        • Joffe S
        • Miller FG.
        Equipoise: asking the right questions for clinical trial design.
        Nat Rev Clin Oncol. 2012; 9: 230-235
        • Balshem H
        • Helfand M
        • Schunemann HJ
        • Oxman AD
        • Kunz R
        • Brozek J
        • et al.
        GRADE guidelines: 3. Rating the quality of evi- dence.
        J Clin Epidemiol. 2011; 64: 401-406
        • Guyatt GH
        • Oxman AD
        • Kunz R
        • Brozek J
        • Alonso-Coello P
        • Rind D
        • et al.
        GRADE guidelines 6. Rating the quality of evi- dence—imprecision.
        J Clin Epidemiol. 2011; 64: 1283-1293
        • Guyatt GH
        • Oxman AD
        • Kunz R
        • Woodcock J
        • Brozek J
        • Helfand M
        • et al.
        GRADE guidelines: 8. Rating the quality of evidence–indirect- ness.
        J Clin Epidemiol. 2011; 64: 1303-1310
        • Guyatt GH
        • Oxman AD
        • Kunz R
        • Woodcock J
        • Brozek J
        • Helfand M
        • et al.
        GRADE guidelines: 7. Rating the quality of evidence—incon- sistency.
        J Clin Epidemiol. 2011; 64: 1294-1302
        • Guyatt GH
        • Oxman AD
        • Montori V
        • Vist G
        • Kunz R
        • Brozek J
        • et al.
        GRADE guidelines: 5. Rating the quality of evidence—publi- cation bias.
        J Clin Epidemiol. 2011; 64: 1277-1282
        • Guyatt GH
        • Oxman AD
        • Vist G
        • Kunz R
        • Brozek J
        • Alonso-Coello P
        • et al.
        GRADE guidelines: 4. Rating the quality of evidence–study limitations (risk of bias).
        J Clin Epidemiol. 2011; 64: 407-415
        • Morgano GP
        • Fulceri F
        • Nardocci F
        • et al.
        Introduction and methods of the evidence-based guidelines for the diagnosis and management of autism spectrum disorder by the Italian National Institute of Health.
        Health Qual Life Outcomes. 2020; 18: 81
        • Cuello-Garcia CA
        • Morgan RL
        • Brozek J
        • Santesso N
        • Verbeek J
        • Thayer K
        • et al.
        A scoping review and survey provides the rationale, perceptions, and preferences for the integration of randomized and nonrandomized studies in evidence syntheses and GRADE assessments.
        J Clin Epidemiol. 2018; 98: 33-40https://doi.org/10.1016/j.jclinepi.2018.01.010