Assessing the certainty of evidence of test accuracy studies when there are challenges with establishing a reference standard

Published:November 28, 2022DOI:
      We provide real-world case examples of potential solutions when a reference standard is not clearly defined, easily replicable, or when it is infeasible or unethical to perform the reference standard on all patients.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Schünemann H.J.
        • Mustafa R.A.
        • Brozek J.
        • Steingart K.R.
        • Leeflang M.
        • Hassan Murad M.
        • et al.
        GRADE guidelines: 21 part 1. Study design, risk of bias, and indirectness in rating the certainty across a body of evidence for test accuracy.
        J Clin Epidemiol. 2020; 122: 129-141
        • Hanson K.E.
        • Caliendo A.M.
        • Arias C.A.
        • Hayden M.K.
        • Englund J.A.
        • Lee M.J.
        • et al.
        The infectious diseases society of America guidelines on the diagnosis of COVID-19: molecular diagnostic testing.
        Clin Infect Dis. 2021; : ciab048
        • Patel P.
        • Patel P.
        • Bhatt M.
        • Braun C.
        • Begum H.
        • Wiercioch W.
        • et al.
        Systematic review and meta-analysis of test accuracy for the diagnosis of suspected pulmonary embolism.
        Blood Adv. 2020; 4: 4296-4311
        • Mustafa R.A.
        • Santesso N.
        • Khatib R.
        • Mustafa A.A.
        • Wiercioch W.
        • Kehar R.
        • et al.
        Systematic reviews and meta-analyses of the accuracy of HPV tests, visual inspection with acetic acid, cytology, and colposcopy.
        Int J Gynaecol Obstet. 2016; 132: 259-265
        • Santesso N.
        • Mustafa R.A.
        • Schünemann H.J.
        • Arbyn M.
        • Blumenthal P.D.
        • Cain J.
        • et al.
        World Health Organization Guidelines for treatment of cervical intraepithelial neoplasia 2-3 and screen-and-treat strategies to prevent cervical cancer.
        Int J Gynaecol Obstet. 2016; 132: 252-258
        • Qaseem A.
        • Etxeandia-Ikobaltzeta I.
        • Mustafa R.A.
        • Kansagara D.
        • Fitterman N.
        • Wilt T.J.
        • et al.
        Appropriate use of point-of-care ultrasonography in patients with acute dyspnea in emergency department or inpatient settings: a clinical guideline from the American college of physicians.
        Ann Intern Med. 2021; 174: 985-993