Advertisement
Original Article| Volume 79, P86-89, November 2016

Administrative database code accuracy did not vary notably with changes in disease prevalence

  • Carl van Walraven
    Correspondence
    Corresponding author. Ottawa Hospital Research Institute, University of Ottawa, Carling Ave, Ottawa, Ontario K1Y 4E9, Canada. Tel.: 613-761-4903; fax: 613-761-5492.
    Affiliations
    Department of Medicine, University of Ottawa, 501 Smyth Road, Ottawa K1H 8L6, Canada

    Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa K1H 8L6, Canada

    Institute for Clinical Evaluative Sciences, 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    Search for articles by this author
  • Shane English
    Affiliations
    Department of Medicine, University of Ottawa, 501 Smyth Road, Ottawa K1H 8L6, Canada

    Clinical Epidemiology Program, Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa K1H 8L6, Canada
    Search for articles by this author
  • Peter C. Austin
    Affiliations
    Institute for Clinical Evaluative Sciences, 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada

    Institute for Health Policy, Management and Evaluation, University of Toronto, 155 College Street, Toronto, Ontario M5T 3M6, Canada

    Sunnybrook Research Institute, 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada
    Search for articles by this author

      Abstract

      Objectives

      Previous mathematical analyses of diagnostic tests based on the categorization of a continuous measure have found that test sensitivity and specificity varies significantly by disease prevalence. This study determined if the accuracy of diagnostic codes varied by disease prevalence.

      Study Design and Setting

      We used data from two previous studies in which the true status of renal disease and primary subarachnoid hemorrhage, respectively, had been determined. In multiple stratified random samples from the two previous studies having varying disease prevalence, we measured the accuracy of diagnostic codes for each disease using sensitivity, specificity, and positive and negative predictive value.

      Results

      Diagnostic code sensitivity and specificity did not change notably within clinically sensible disease prevalence. In contrast, positive and negative predictive values changed significantly with disease prevalence.

      Conclusion

      Disease prevalence had no important influence on the sensitivity and specificity of diagnostic codes in administrative databases.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Huston P.
        • Naylor C.D.
        Health services research: reporting on studies using secondary data sources.
        CMAJ. 1996; 155: 1697-1709
        • Benchimol E.I.
        • Manuel D.G.
        • To T.
        • Griffiths A.M.
        • Rabeneck L.
        • Guttmann A.
        Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data.
        J Clin Epidemiol. 2011; 64: 821-829
        • van Walraven C.
        • Bennett C.
        • Forster A.J.
        Administrative database research infrequently uses validated diagnostic or procedural codes.
        J Clin Epidemiol. 2011; 64: 1054-1059
        • Sackett D.L.
        • Haynes R.B.
        • Guyatt G.H.
        • Tugwell P.
        The interpretation of diagnostic data. Clinical epidemiology. A basic science for clinical medicine.
        Little, Brown, Boston1991: 69-152
        • Goldman L.
        Quantitative aspects of clinical reasoning.
        in: Isselbacher K.J. Braunwald E. Wilson J.D. Martin J.B. Fauci A.S. Kasper D.L. Harrison's principles of internal medicine. 13th ed. McGraw-Hill, New York1994: 43-48
        • Brenner H.
        • Gefeller O.
        Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence.
        Stat Med. 1997; 16: 981-991
        • van Walraven C.
        • Austin P.C.
        • Manuel D.
        • Knoll G.
        • Jennings A.
        • Forster A.J.
        The usefulness of administrative databases for identifying disease cohorts is increased with a multivariate model.
        J Clin Epidemiol. 2010; 63: 1332-1341
        • Manjunath G.
        • Sarnak M.J.
        • Levey A.S.
        Prediction equations to estimate glomerular filtration rate: an update.
        Curr Opin Nephrol Hypertens. 2001; 10: 785-792
        • National Kidney Foundation
        K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification.
        Am J Kidney Dis. 2002; 39: S1-S266
        • Levey A.S.
        • Eckardt K.U.
        • Tsukamoto Y.
        • Levin A.
        • Coresh J.
        • Rossert J.
        • et al.
        Definition and classification of chronic kidney disease: a position statement from kidney disease: improving global outcomes (KDIGO).
        Kidney Int. 2005; 67: 2089-2100
        • English S.W.
        • McIntyre L.
        • Fergusson D.
        • Turgeon A.
        • Sun C.
        • dos Santos M.P.
        • et al.
        Enriched administrative data can be used to retrospectively identify all known cases of primary subarachnoid hemorrhage.
        J Clin Epidemiol. 2016; 70: 146-154