Journal of Clinical Epidemiology
Volume 59, Issue 9 , Pages 926-933 , September 2006

Interrater reliability of measurements of comorbid illness should be reported

  • Stephen F. Hall

      Affiliations

    • Department of Otolaryngology, Queen's University, and Division of Cancer Care and Epidemiology, Queen's Cancer Research Institute, Queen's University, Kingston, Ontario, Canada
    • Corresponding Author InformationCorresponding author. Tel.: 613-544-3310 ext. 3618; fax: 613-547-5654.
    • ,
  • Patti A. Groome

      Affiliations

    • Department of Community Health and Epidemiology, Queen's University and Division of Cancer Care and Epidemiology, Queen's Cancer Research Institute, Queen's University, Kingston, Ontario, Canada
    • ,
  • David L. Streiner

      Affiliations

    • Kunin-Lunenfeld Applied Research Unit, Baycrest Center for Geriatric Care, Toronto, Ontario, Canada
    • ,
  • Paula A. Rochon

      Affiliations

    • Kunin-Lunenfeld Applied Research Unit, Baycrest Center for Geriatric Care, Toronto, Ontario, Canada

,Accepted 20 December 2005.

References 

  1. Fletcher RH, Fletcher SW, Wagner EH. Clinical epidemiology: the essentials. 3rd ed.. Baltimore: Williams & Wilkins; 1996;
  2. Hall S, Rochon P, Streiner D, Paszat L, Groome PA, Rohland SL. Measuring comorbidity for survival studies in head and neck oncology. Laryngoscope. 2002;112:1988–1996
  3. Charlson ME, Pompei P, Ales KL, Mackenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987;40:373–383
  4. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613–619
  5. Kaplan MH, Feinstein AR. The importance of classifying initial co-morbidity in evaluating the outcome of diabetes mellitus. J Chron Dis. 1974;27:387–404
  6. Linn BS, Linn MW, Lee G. Cumulative Illness Rating Scale. J Am Geriatr Soc. 1968;5:622–626
  7. Miller MD, Paradis CF, Houck PR, Mazumdar S, Stack JA, Rifai AH, et al. Rating chronic medical illness burden in geropsychiatric patients: application of the Cumulative Illness Rating Scale. Psychiatry Res. 1992;41:237–248
  8. Miller MD, Towers A. A manual of guidelines for scoring the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Pittsburgh, PA: University of Pittsburgh; 1991;
  9. Cleary PD, Greenfield S, Mulley AG, Pauker SG, Schroeder SA, Wexler L, et al. Variations in length of stay and outcomes for six medical and surgical conditions in Massachusetts and California. JAMA. 1991;266:73–79
  10. Greenfield S, Apalone G. Assessment of comorbidity: the Index of Co-existent Disease. 1991;[unpublished manual]
  11. Piccirillo JF. Importance of comorbidity in head and neck cancer. Laryngoscope. 2000;110:593–602
  12. Groome PA, O'Sullivan B. Glottic cancer in Ontario Canada and the SEER areas of the United States: Do different management philosophies produce different outcome profiles?. J Clin Epidemiol. 2001;54:301–315
  13. Barbera L, Groome PA, Mackillop WJ, Schulze K, O'Sullivan B, Irish JC, et al. The role of computed tomography in the T classification of laryngeal carcinoma. Cancer. 2001;91:394–407
  14. Groome PA, O'Sullivan B, Irish JC, Rothwell DM, Schulze K, Warde PR, et al. Management and outcome differences in supraglottic cancer between Ontario, Canada, and the Surveillance, Epidemiology, and End Results areas of the United States. J Clin Oncol. 2002;21:496–505
  15. MedQuest 5.0. Arlington, VA: Fu Associates; 2000;
  16. Portney LG, Watkins MP. Statistical measures of reliability. In: Foundations of clinical research: applications to practice. 1st ed.. Norwalk, CT: Appleton & Lange; 1993;
  17. Streiner DL, Norman G. Health measurement scales: a practical guide to their development and use. 3rd ed.. Oxford: Oxford University Press; 2003;
  18. Rosner B. Fundamentals of biostatistics. 4th ed.. Belmont, CA: Duxbury Press; 1995;
  19. Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174
  20. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–428
  21. McGraw KO, Wong SP. Forming inferences about some intraclass coefficients. Psychol Methods. 1996;1:30–46
  22. Nichols, DP. SPSS FAQ#4: Intraclass correlation from SPSS for Windows/Choosing an intraclass correlation coefficient. http://www.utexas.edu/its/rc/answers/spss/spss4.html.
  23. Waite K, Oddone E, Weinberger M, Samsa G. Lack of association between patients' measured burden of disease and risk for hospital readmission. J Clin Epidemiol. 1994;47:1229–1236
  24. Imamura K, McKinnon M, Middleton R, Black N. Reliability of a comorbidity measure: the Index of Co-Existent Disease (ICED). J Clin Epidemiol. 1997;50:1011–1016
  25. Greenfield S, Blanco D, Elashoff RM, Ganz PA. Patterns of care related to age of breast cancer patients. JAMA. 1987;257:2766–2770
  26. Newschaffer CJ, Bush TL, Penberthy LT. Comorbidity measurement in elderly female breast cancer patients with administrative and medical records data. J Clin Epidemiol. 1997;50:725–733
  27. Extermann M. Measuring comorbidity in older cancer patients. Eur J Cancer. 2000;36:453–471
  28. Hall SF, Groome PA, Rothwell D, Dixon PF. Using TNM staging to predict survival in patients with squamous cell carcinoma of head & neck. Head Neck. 1999;21:30–38
  29. Reid BC, Alberg AJ, Klassen AC, Koch WM, Samet JM. The American Society of Anesthesiologists' class as a comorbidity index in a cohort of head and neck cancer surgical patients. Head Neck. 2001;23:985–994
  30. Gabriel SE, Crowson CS, O'Fallon WM. A comparison of two comorbidity instruments in arthritis. J Clin Epidemiol. 1999;52:1137–1142
  31. Liu M, Domen K, Chino N. Comorbidity measures for stroke outcome research: a preliminary study. Arch Phys Med Rehabil. 1997;78:166–172
  32. Kiefe CI, Funkhouser E, Fouad MN, May DS. Chronic disease as a barrier to breast and cervical cancer screening. J Gen Intern Med. 1998;13:357–365
  33. Krousel-Wood MA, Abdoh A, Re R. Comparing comorbid-illness indices assessing outcome variation: the case of prostatectomy. J Gen Intern Med. 1996;11:32–38
  34. Rochon PA, Katz JN, Morrow LA, McGlinchey-Berroth R, Ahlquist MM, Sarkarati M, et al. Comorbid illness is associated with survival and length of hospital stay in patients with chronic disability: A prospective comparison of three comorbidity indices. Med Care. 1996;34:1093–1101

PII: S0895-4356(06)00080-1

doi: 10.1016/j.jclinepi.2006.02.006

Journal of Clinical Epidemiology
Volume 59, Issue 9 , Pages 926-933 , September 2006

Article Tools

* Image Usage & Resolution