Advertisement

The UpPriority tool supported prioritization processes for updating clinical guideline questions

      Highlights

      • Updating strategies can be optimized with prioritization processes that help identify CGs, CG sections, CQs, or recommendations in the greatest need for updating.
      • We recently developed the UpPriority tool, a pragmatic tool for prioritizing CG questions for updating. The tool was based on a published methodological systematic review and a multistep process involving relevant stakeholders.
      • We applied the UpPriority tool to a set of CGs using a step-by-step process that included: 1) establishment of the UpPriority Implementation Working Group, 2) mapping of the CG questions and recommendations, 3) development of a survey to prioritize CQs, 4) assessment of CQ's priority according to six items, 5) calculation and ranking of priority scores, 6) decision of prioritized CQs for updating, and 7) development of the priority report. We assessed the tool implementation process (appraisers’ experience when using the tool) and the inter-observer reliability of the tool, and we provided suggestions for improvement.
      • The UpPriority is a useful tool to identify which CQs within a CG need to be prioritized for update in a real-world scenario.

      Abstract

      Objective

      We aim to 1) use the UpPriority tool to identify which clinical questions (CQs) within the clinical guidelines (CGs) need to be prioritized for updating and 2) assess the implementation of the tool in a real-world set of CGs.

      Study Design and Setting

      We systematically assessed CQs from a sample of CGs developed in the Spanish National Health System CG program. We applied the UpPriority tool to each CG using a step-by-step process that included: 1) establishment of the UpPriority Implementation Working Group, 2) mapping of the original CG questions and recommendations, 3) development of a survey to prioritize CQs, 4) assessment of CQ's priority according to six items, 5) calculation and ranking of priority scores, 6) decision of prioritized CQs for updating, and 7) development of the priority report. We assessed the tool implementation process (appraisers’ experience when using the tool) and the inter-observer reliability of the tool, and we provided suggestions for improvement.

      Results

      We included four CGs with a total of 107 CQs on the following topics: chronic heart failure (10 CQs), inherited retinal dystrophies (39 CQs), menopause (20 CQs), and open-angle glaucoma (38 CQs). We included a total of 30 participants, most of them clinicians that were members of the original CG development groups. CQs were classified in three groups: 1) high priority (CQs prioritized for updating [16/107; 15.0%]), 2) medium priority (CQs that could be prioritized for updating [47/107; 43.9%]), and low priority (CQs that were not prioritized for updating [44/107; 41.1%]). The mean time each appraiser needed to assess the CQs with the tool was 3.8 hours (range 0.5 to 10). Agreement among the appraisers varied among the CGs. Appraisers considered that the tool was useful. We suggest some areas for consideration when using the tool including: 1) identification of key appraisers, 2) customization of training materials, 3) establishment of priority thresholds, and 4) provision of methodological support.

      Conclusion

      The UpPriority is a useful tool to identify which CQs within a CG need to be prioritized for update in a real-world scenario. Recruitment and training of topic experts are the main challenges when using the tool.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Martínez García L
        • Pardo-Hernandez H
        • Superchi C
        • Nino de Guzman E
        • Ballesteros M
        • Ibargoyen Roteta N
        • et al.
        Methodological systematic review identifies major limitations in prioritization processes for updating.
        J Clin Epidemiol. 2017; 86: 11-24
        • El-Harakeh A
        • Lotfi T
        • Ahmad A
        • Morsi RZ
        • Fadlallah R
        • Bou-Karroum L
        • et al.
        The implementation of prioritization exercises in the development and update of health practice guidelines: a scoping review.
        PLoS One. 2020; 15e0229249
        • Martínez García L
        • Pardo-Hernandez H
        • Sanabria AJ
        • Alonso-Coello P
        Pregnancy clinical guideline updating working G. Continuous surveillance of a pregnancy clinical guideline: an early experience.
        Syst Rev. 2017; 6: 143
        • Martínez García L
        • Pardo-Hernández H
        • Sanabria AJ
        • Alonso-Coello P
        • Penman K
        • E McFarlane
        • et al.
        Guideline on terminology and definitions of updating clinical guidelines: the updating glossary.
        J Clin Epidemiol. 2018; 95: 28-33
        • Fadlallah R
        • El-Harakeh A
        • Bou-Karroum L
        • Lotfi T
        • El-Jardali F
        • Hishi L
        • et al.
        A common framework of steps and criteria for prioritizing topics for evidence syntheses: a systematic review.
        J Clin Epidemiol. 2020; 120: 67-85
        • El-Harakeh A
        • Morsi RZ
        • Fadlallah R
        • Bou-Karroum L
        • Lotfi T
        • Akl EA.
        Prioritization approaches in the development of health practice guidelines: a systematic review.
        BMC Health Serv Res. 2019; 19: 692
        • Sanabria AJ
        • Pardo-Hernandez H
        • Ballesteros M
        • Canelo-Aybar C
        • McFarlarne E
        • Niño de Guzman E
        • et al.
        The UpPriority tool was developed to guide the prioritization of clinical guideline questions for updating.
        J Clin Epidemiol. 2020; 126: 80-92
      1. European Commission Initiative on Breast Cancer [Internet]. Updating strategy of the European breast guidelines on screening and diagnosis. 2017 [cited 25 January 2021]. Available from: https://healthcare-quality.jrc.ec.europa.eu/discover-ecibc/methodologies/guidelines-updating

      2. Parmelli E, Saz Parkinson Z, Janusch Roi A, Alonso Coello P The European Breast Guidelines on screening and diagnosis of breast cancer: piloting of an updating strategy. Colloquium Abstracts [Internet]. Abstracts.cochrane.org. 2019 [cited 25 January 2021]. Available from: https://abstracts.cochrane.org/2019-santiago/european-breast-guidelines-screening-and-diagnosis-breast-cancer-piloting-updating

      3. Parmelli E, Saz Parkinson Z, Lerda D, Alonso-Coello P, Martínez García L. Developing the updating strategy for the European Breast Guidelines within the European Commission Initiative on Breast Cancer The 25th Cochrane Colloquium [Internet]. Colloquium2018.cochrane.org. 2018 [cited 25 January 2021]. Available from: https://colloquium2018.cochrane.org/abstracts/developing-updating-strategy-european-breast-guidelines-within-european-commission

        • Landis JR
        • Koch GG.
        The measurement of observer agreement for categorical data.
        Biometrics. 1977; 33: 159-174
      4. Grupo de trabajo de la Guía de Práctica Clínica sobre Tratamiento de la Insuficiencia Cardiaca Crónica. Guía de Práctica Clínica sobre Tratamiento de la Insuficiencia Cardiaca Crónica. Ministerio de Sanidad, Servicios Sociales e Igualdad. Unidad de Evaluación de Tecnologías Sanitarias de la Comunidad de Madrid; 2016. Guías de Práctica Clínica en el SNS.

      5. Grupo de trabajo de la Guía de Práctica Clínica para las Distrofias Hereditarias de Retina. Guía de Práctica Clínica para las Distrofias Hereditarias de Retina. Ministerio de Sanidad, Servicios Sociales e Igualdad. Servicio de Evaluación del Servicio Canario de la Salud; 2017. Guías de Práctica Clínica en el SNS.

      6. Grupo de trabajo de la Guía de Práctica Clínica sobre el abordaje de síntomas vasomotores y vaginales asociados a la menopausia y la postmenopausia. Guía de Práctica Clínica sobre el abordaje de síntomas vasomotores y vaginales asociados a la menopausia y la postmenopausia. Ministerio de Sanidad, Servicios Sociales e Igualdad. Agencia de Evaluación de Tecnologías Sanitarias de Andalucía (AETSA); 2017. Guías de Práctica Clínica en el SNS.

      7. Grupo de trabajo de la Guía de Práctica Clínica sobre el glaucoma de ángulo abierto. Ministerio de Sanidad, Servicios Sociales e Igualdad. Agència de Qualitat i Avaluació Sanitàries de Catalunya (AQuAS) y el Centro Cochrane Iberoamericano (CCIb); 2017. Guías de Práctica Clínica en el SNS: AQuAS.

        • Agbassi C
        • Messersmith H
        • McNair S
        • Brouwers M.
        Priority-based initiative for updating existing evidence-based clinical practice guidelines: the results of two iterations.
        J Clin Epidemiol. 2014; 67: 1335-1342
      8. Developing NICE guidelines: the manual. London: National Institute for Health and Care Excellence; 2014 (updated October 2020).

        • Becker M
        • Jaschinski T
        • Eikermann M
        • Mathes T
        • Bühn S
        • Koppert W
        • et al.
        A systematic decision-making process on the need for updating clinical practice guidelines proved to be feasible in a pilot study.
        J Clin Epidemiol. 2018; 96: 101-109
        • Vogel JP
        • Dowswell T
        • Lewin S
        • Bonet M
        • Hampson L
        • Kellie F
        • et al.
        Developing and applying a ‘living guidelines’ approach to WHO recommendations on maternal and perinatal health.
        BMJ Global Health. 2019; 4e001683
        • van der Veer SN
        • Haller MC
        • Pittens CACM
        • Broerse J
        • Castledine C
        • Gallieni M
        • et al.
        Setting priorities for optimizing vascular access decision making – an international survey of patients and clinicians.
        PLOS ONE. 2015; 10e0128228