Advertisement
Series: grading of recommendations assessment, development and evaluation (GRADE)| Volume 76, P89-98, August 2016

GRADE Guidelines: 16. GRADE evidence to decision frameworks for tests in clinical practice and public health

Published:February 27, 2016DOI:https://doi.org/10.1016/j.jclinepi.2016.01.032

      Abstract

      Objectives

      To describe the grading of recommendations assessment, development and evaluation (GRADE) interactive evidence to decision (EtD) frameworks for tests and test strategies for clinical, public health, or coverage decisions.

      Study Design and Setting

      As part of the GRADE Working Group's DECIDE project, we conducted workshops, user testing with systematic review authors, guideline developers and other decision makers, and piloted versions of the EtD framework.

      Results

      EtD frameworks for tests share the structure, explicitness, and transparency of other EtD frameworks. They require specifying the purpose of the test, linked or related management, and the key outcomes of concern for different test results and subsequent management. The EtD criteria address test accuracy and assessments of the certainty of the additional evidence necessary for decision making. When there is no direct evidence of test effects on patient-important outcomes, formal or informal modeling is needed to estimate effects. We describe the EtD criteria based on examples developed with GRADEpro (www.gradepro.org), GRADE's software that also allows development and dissemination of interactive summary of findings tables.

      Conclusion

      EtD frameworks for developing recommendations and making decisions about tests lay out the sequential steps in reviewing and assessing the different types of evidence that need to be linked.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Bossuyt P.M.
        • Irwig L.
        • Craig J.
        • Glasziou P.
        Comparative accuracy: assessing new tests against existing diagnostic pathways.
        BMJ. 2006; 332: 1089-1092
        • Mustafa R.
        • Wiercioch W.
        • Cheung A.
        • Prediger B.
        • Brozek J.
        • Bossuyt P.
        • et al.
        Decision making about healthcare related tests and diagnostic strategies: A review of methodological and practical challenges and introduction to a new series.
        J Clin Epidemiol. 2016;
      1. P. Alonso-Coello, H. Schunemann, J. Moberg, R. Brignardello-Petersen, E. Akl, M. Davoli, et al. Grade evidence to decision frameworks: 1. Introduction. BMJ. in press.

      2. P. Alonso-Coello, A.D. Oxman, J. Moberg, R. Brignardello-Petersen, E. Akl, M. Davoli, et al. GRADE evidence to decision frameworks: 2. Clinical practice guidelines. BMJ. in press.

        • Köbberling J.
        • Trampisch H.J.
        • Windeler J.
        Memorandum for the evaluation of diagnostic measures.
        J Clin Chem Clin Biochem. 1990; 28: 873-879
        • Knottnerus J.A.
        The effects of disease verification and referral on the relationship between symptoms and diseases.
        Med Decis Making. 1987; 7: 139-148
        • Knottnerus J.A.
        • van Weel C.
        • Muris J.W.
        Evaluation of diagnostic procedures.
        BMJ. 2002; 324: 477-480
        • Ferrante di Ruffano L.
        • Davenport C.
        • Eisinga A.
        • Hyde C.
        • Deeks J.J.
        A capture-recapture analysis demonstrated that randomized controlled trials evaluating the impact of diagnostic tests on patient outcomes are rare.
        J Clin Epidemiol. 2012; 65: 282-287
        • Guyatt G.H.
        • Oxman A.D.
        • Kunz R.
        • Falck-Ytter Y.
        • Vist G.E.
        • Liberati A.
        • et al.
        Going from evidence to recommendations.
        BMJ. 2008; 336: 1049-1051
        • Andrews J.C.
        • Schunemann H.J.
        • Oxman A.D.
        • Pottie K.
        • Meerpohl J.J.
        • Coello P.A.
        • et al.
        GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation's direction and strength.
        J Clin Epidemiol. 2013; 66: 726-735
        • Andrews J.
        • Guyatt G.
        • Oxman A.D.
        • Alderson P.
        • Dahm P.
        • Falck-Ytter Y.
        • et al.
        GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendations.
        J Clin Epidemiol. 2013; 66: 719-725
        • Brozek J.L.
        • Akl E.A.
        • Compalati E.
        • Kreis J.
        • Terracciano L.
        • Fiocchi A.
        • et al.
        Grading quality of evidence and strength of recommendations in clinical practice guidelines part 3 of 3. The GRADE approach to developing recommendations.
        Allergy. 2011; 66: 588-595
        • Schunemann H.J.
        • Hill S.R.
        • Kakad M.
        • Bellamy R.
        • Uyeki T.M.
        • Hayden F.G.
        • et al.
        WHO rapid advice guidelines for pharmacological management of sporadic human infection with avian influenza A (H5N1) virus.
        Lancet Infect Dis. 2007; 7: 21-31
        • Schunemann H.J.
        • Hill S.R.
        • Kakad M.
        • Vist G.E.
        • Bellamy R.
        • Stockman L.
        • et al.
        Transparent development of the WHO rapid advice guidelines.
        PLos Med. 2007; 4: e119
        • Schunemann H.J.
        • Oxman A.D.
        • Akl E.A.
        • Brozek J.L.
        • Montori V.M.
        • Heffner J.
        • et al.
        Moving from evidence to developing recommendations in guidelines: article 11 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report.
        Proc Am Thorac Soc. 2012; 9: 282-292
        • Schunemann H.J.
        • Oxman A.D.
        • Brozek J.
        • Glasziou P.
        • Jaeschke R.
        • Vist G.E.
        • et al.
        Grading quality of evidence and strength of recommendations for diagnostic tests and strategies.
        BMJ (Clinical Research Ed.). 2008; 336: 1106-1110
        • Hsu J.
        • Brozek J.L.
        • Terracciano L.
        • Kreis J.
        • Compalati E.
        • Stein A.T.
        • et al.
        Application of GRADE: making evidence-based recommendations about diagnostic tests in clinical practice guidelines.
        Implement Sci. 2011; 6: 62
        • Brozek J.L.
        • Akl E.A.
        • Jaeschke R.
        • Lang D.M.
        • Bossuyt P.
        • Glasziou P.
        • et al.
        Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies.
        Allergy. 2009; 64: 1109-1116
        • Schunemann H.J.
        • Mustafa R.
        • Brozek J.
        [Diagnostic accuracy and linked evidence–testing the chain].
        Z Evidenz, Fortbildung Qualitat im Gesundheitswesen. 2012; 106: 153-160
        • Fiocchi A.
        • Brozek J.
        • Schunemann H.
        • Bahna S.L.
        • von Berg A.
        • Beyer K.
        • et al.
        World Allergy Organization (WAO) Diagnosis and Rationale for Action against Cow's Milk Allergy (DRACMA) guidelines.
        Pediatr Allergy Immunol. 2010; 21: 1-125
        • Treweek S.
        • Oxman A.D.
        • Alderson P.
        • Bossuyt P.M.
        • Brandt L.
        • Brozek J.
        • et al.
        Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence (DECIDE): protocol and preliminary results.
        Implement Sci. 2013; 8: 6
        • World Health Organization
        The use of delamanid in the treatment of multidrug-resistant tuberculosis Interim policy guidance.
        2014 (Available at) (Accessed December 8, 2014)
        • World Health Organization
        The use of bedaquiline in the treatment of multidrug-resistant tuberculosis. Interim policy guidance.
        2013 (Available at) (Accessed December 8, 2014)
        • Al-Hameed F.
        • Al-Dorzi H.M.
        • Shamy A.
        • Qadi A.
        • Bakhsh E.
        • Aboelnazar E.
        • et al.
        The Saudi clinical practice guideline for the diagnosis of the first deep venous thrombosis of the lower extremity.
        Ann Thorac Med. 2015; 10: 3-15
        • Harris R.P.
        • Helfand M.
        • Woolf S.H.
        • Lohr K.N.
        • Mulrow C.D.
        • Teutsch S.M.
        • et al.
        Current methods of the US Preventive Services Task Force: a review of the process.
        Am J Prev Med. 2001; 20: 21-35
        • Richardson W.S.
        • Wilson M.C.
        • Nishikawa J.
        • Hayward R.S.
        The well-built clinical question: a key to evidence-based decisions.
        ACP J Club. 1995; 123: A12-A13
        • Guyatt G.
        • Montori V.
        • Devereaux P.J.
        • Schunemann H.
        • Bhandari M.
        Patients at the Center: in our practice, and in our use of language.
        ACP J Club. 2004; 140: A11-A12
        • Guyatt G.
        • Oxman A.D.
        • Akl E.A.
        • Kunz R.
        • Vist G.
        • Brozek J.
        • et al.
        GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables.
        J Clin Epidemiol. 2011; 64: 383-394
        • World Health Organization
        Commercial serodiagnostic tests for diagnosis of tuberculosis: policy statement.
        WHO Library, Geneva, Switzerland2011 (Available at) (Accessed November 1, 2015)
        • Mustafa R.
        • Wiercioch W.
        • Santesso N.
        • Cheung A.
        • Prediger B.
        • Baldeh T.
        • et al.
        Decision-making about healthcare related tests and diagnostic strategies: user testing of GRADE evidence tables.
        PLoS One. 2015; 10: e0134553
        • Spencer F.A.
        • Iorio A.
        • You J.
        • Murad M.H.
        • Schunemann H.J.
        • Vandvik P.O.
        • et al.
        Uncertainties in baseline risk estimates and confidence in treatment effects.
        BMJ. 2012; 345: e7401
        • Guyatt G.H.
        • Oxman A.D.
        • Kunz R.
        • Vist G.E.
        • Falck-Ytter Y.
        • Schunemann H.J.
        What is “quality of evidence” and why is it important to clinicians?.
        BMJ. 2008; 336: 995-998
        • Balshem H.
        • Helfand M.
        • Schunemann H.J.
        • Oxman A.D.
        • Kunz R.
        • Brozek J.
        • et al.
        GRADE guidelines: 3. Rating the quality of evidence.
        J Clin Epidemiol. 2011; 64: 401-406
        • Akl E.A.
        • Kennedy C.
        • Konda K.
        • Caceres C.F.
        • Horvath T.
        • Ayala G.
        • et al.
        Using GRADE methodology for the development of public health guidelines for the prevention and treatment of HIV and other STIs among men who have sex with men and transgender people.
        BMC Public Health. 2012; 12: 386
        • Goodacre S.
        • Sampson F.
        • Stevenson M.
        • Wailoo A.
        • Sutton A.
        • Thomas S.
        • et al.
        Measurement of the clinical and cost-effectiveness of non-invasive diagnostic testing strategies for deep vein thrombosis.
        Health Technol Assess. 2006; 10: 1-168
        • Schunemann H.J.
        • Wiercioch W.
        • Etxeandia I.
        • Falavigna M.
        • Santesso N.
        • Mustafa R.
        • et al.
        Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise.
        CMAJ : Can Med Assoc J = J de l'Association medicale canadienne. 2014; 186: E123-E142
        • Bates S.M.
        • Jaeschke R.
        • Stevens S.M.
        • Goodacre S.
        • Wells P.S.
        • Stevenson M.D.
        • et al.
        Diagnosis of DVT: antithrombotic therapy and prevention of thrombosis, 9th ed.: American College of Chest Physicians Evidence-Based Clinical Practice guidelines.
        Chest. 2012; 141: e351S-e418S