Advertisement
Original article| Volume 56, ISSUE 3, P221-229, March 2003

How to measure comorbidity

a critical review of available methods
  • Vincent de Groot
    Correspondence
    Corresponding author. Tel.: +31 20-4440756; fax: +31 20-4440787.
    Affiliations
    Department of Rehabilitation Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands

    Institute for Research in Extramural Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands
    Search for articles by this author
  • Heleen Beckerman
    Affiliations
    Department of Rehabilitation Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands

    Institute for Research in Extramural Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands
    Search for articles by this author
  • Gustaaf J Lankhorst
    Affiliations
    Department of Rehabilitation Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands

    Institute for Research in Extramural Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands
    Search for articles by this author
  • Lex M Bouter
    Affiliations
    Institute for Research in Extramural Medicine, VU University Medical Center, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands
    Search for articles by this author

      Abstract

      The object of this article was to systematically review available methods to measure comorbidity and to assess their validity and reliability. A search was made in Medline and Embase, with the keywords comorbidity and multi-morbidity, to identify articles in which a method to measure comorbidity was described. The references of these articles were also checked, and using a standardized checklist the relevant data were extracted from these articles. An assessment was made of the content, concurrent, predictive and construct validity, and the reliability. Thirteen different methods to measure comorbidity were identified: one disease count and 12 indexes. Data on content and predictive validity were available for all measures, while data on construct validity were available for nine methods, data on concurrent validity, and interrater reliability for eight methods, and data on intrarater reliability for three methods. The Charlson Index is the most extensively studied comorbidity index for predicting mortality. The Cumulative Illness Rating Scale (CIRS) addresses all relevant body systems without using specific diagnoses. The Index of Coexisting Disease (ICED) has a two-dimensional structure, measuring disease severity and disability, which can be useful when mortality and disability are the outcomes of interest. The Kaplan Index was specifically developed for use in diabetes research. The Charlson Index, the CIRS, the ICED and the Kaplan Index are valid and reliable methods to measure comorbidity that can be used in clinical research. For the other indexes, insufficient data on the clinimetric properties are available.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Feinstein A.R
        The pre-therapeutic classification of co-morbidity in chronic disease.
        J Chronic Dis. 1970; 23: 455-468
        • Streiner D.L
        • Norman G.R
        Health Measurement Scales. A practical guide to their development and use. Vol. 2. Oxford University Press;, Oxford1995 (p. 1–230.)
        • Fleiss J.L
        Reliability of measurement. The design and analysis of clinical experiments. John Wiley & Sons;, New York1986 (p. 1–32.)
        • Mulrow C.D
        • Gerety M.B
        • Cornell J.E
        • Lawrence V.A
        • Kanten D.N
        The relationship between disease and function and perceived health in very frail elders.
        J Am Geriatr Soc. 1994; 42: 374-380
        • Charlson M.E
        • Pompei P
        • Ales K.L
        • MacKenzie C.R
        A new method of classifying prognostic comorbidity in longitudinal studies.
        J Chronic Dis. 1987; 40: 373-383
        • Katz J.N
        • Chang L.C
        • Sangha O
        • Fossel A.H
        • Bates D.W
        Can comorbidity be measured by questionnaire rather than medical record review?.
        Med Care. 1996; 34: 73-84
        • Roos L.L.J
        • Nicol J.P
        • Cageorge S.M
        Using administrative data for longitudinal research.
        J Chronic Dis. 1987; 40: 41-49
        • Deyo R.A
        • Cherkin D.C
        • Ciol M.A
        Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.
        J Clin Epidemiol. 1992; 45: 613-619
        • Romano P.S
        • Roos L.L
        • Jollis J.G
        Adapting a clinical comorbidity index for use with ICD-9-CM administrative data.
        J Clin Epidemiol. 1993; 46 (discussion 1081–9): 1075-1079
        • D'Hoore W
        • Sicotte C
        • Tilquin C
        Risk adjustment in outcome assessment.
        Methods Inf Med. 1993; 32: 382-387
        • D'Hoore W
        • Bouckaert A
        • Tilquin C
        Practical considerations on the use of the Charlson comorbidity index with administrative data bases.
        J Clin Epidemiol. 1996; 49: 1429-1433
        • Ghali W.A
        • Hall R.E
        • Rosen A.K
        • Ash A.S
        • Moskowitz M.A
        Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data.
        J Clin Epidemiol. 1996; 49: 273-278
        • Cleves M.A
        • Sanchez N
        • Draheim M
        Evaluation of two competing methods for calculating Charlson's comorbidity index when analyzing short-term mortality using administrative data.
        J Clin Epidemiol. 1997; 50: 903-908
        • Newschaffer C.J
        • Bush T.L
        • Penberthy L.E
        • Bellantoni M
        • Helzlsour K
        • Diener-West M
        Does comorbid disease interact with cancer? An epidemiologic analysis of mortality in a cohort of elderly breast cancer patients.
        J Gerontol. 1998; 53: M372-M378
        • Librero J
        • Peiro S
        • Ordinana R
        Chronic comorbidity and outcomes of hospital care.
        J Clin Epidemiol. 1999; 52: 171-179
        • Charlson M
        • Szatrowski T.P
        • Peterson J
        • Gold J
        Validation of a combined comorbidity index.
        J Clin Epidemiol. 1994; 47: 1245-1251
        • Melchiorre P.J
        • Findley T
        • Boda W
        Functional outcome and comorbidity indexes in the rehabilitation of the traumatic versus the vascular unilateral lower limb amputee.
        Am J Phys Med Rehabil. 1996; 75: 9-14
        • Liu M
        • Domen K
        • Chino N
        Comorbidity measures for stroke outcome research.
        Arch Phys Med Rehabil. 1997; 78: 166-172
        • Rochon P.A
        • Katz J.N
        • Morrow L.A
        • McGlinchey-Berroth R
        • Ahlquist M.M
        • Sarkarati M
        • et al.
        Comorbid illness is associated with survival and length of hospital stay in patients with chronic disability. A prospective comparison of three comorbidity indices.
        Med Care. 1996; 34: 1093-1101
        • Extermann M
        • Overcash J
        • Lyman G.H
        • Parr J
        • Balducci L
        Comorbidity and functional status are independent in older cancer patients.
        J Clin Oncol. 1998; 16: 1582-1587
        • Gabriel S.E
        • Crowson C.S
        • O'Fallon W.M
        A comparison of two comorbidity instruments in arthritis.
        J Clin Epidemiol. 1999; 52: 1137-1142
        • Kieszak S.M
        • Flanders W.D
        • Kosinski A.S
        • Shipp C.C
        • Karp H
        A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data.
        J Clin Epidemiol. 1999; 52: 137-142
        • West D.W
        • Satariano W.A
        • Ragland D.R
        • Hiatt R.A
        Comorbidity and breast cancer survival.
        Ann Epidemiol. 1996; 6: 413-419
        • Skiest D.J
        • Rubinstien E
        • Carley N
        • Gioiella L
        • Lyons R
        The importance of comorbidity in HIV-infected patients over 55.
        Am J Med. 1996; 101: 605-611
        • Poses R.M
        • McClish D.K
        • Smith W.R
        • Bekes C
        • Scott W.E
        Prediction of survival of critically ill patients by admission comorbidity.
        J Clin Epidemiol. 1996; 49: 743-747
        • Beddhu S
        • Bruns F.J
        • Saul M
        • Seddon P
        • Zeidel M.L
        A simple comorbidity scale predicts clinical outcomes and costs in dialysis patients.
        Am J Med. 2000; 108: 609-613
        • Linn B.S
        • Linn M.W
        • Gurel L
        Cumulative illness rating scale.
        J Am Geriatr Soc. 1968; 16: 622-626
        • Miller M.D
        • Paradis C.F
        • Houck P.R
        • Mazumdar S
        • Stack J.A
        • Rifai A.H
        • et al.
        Rating chronic medical illness burden in geropsychiatric practice and research.
        Psychiatry Res. 1992; 41: 237-248
        • Conwell Y
        • Forbes N.T
        • Cox C
        • Caine E.D
        Validation of a measure of physical illness burden at autopsy.
        J Am Geriatr Soc. 1993; 41: 38-41
        • Waldman E
        • Potter J.F
        A prospective evaluation of the Cumulative Illness Rating Scale.
        Aging. 1992; 4: 171-178
        • Parmelee P.A
        • Thuras P.D
        • Katz I.R
        • Lawton M.P
        Validation of the Cumulative Illness Rating Scale in a geriatric residential population.
        J Am Geriatr Soc. 1995; 43: 130-137
        • Cornoni-Huntley J.C
        • Foley D.J
        • Guralnik J.M
        Co-morbidity analysis.
        Int J Epidemiol. 1991; 20: S8-17
        • Page-Shafer K
        • Delorenze G.N
        • Satariano W.A
        • Winkelstein Jr, W
        Comorbidity and survival in HIV-infected men in the San Francisco Men's Health Survey.
        Ann Epidemiol. 1996; 6: 420-430
        • Elixhauser A
        • Steiner C
        • Harris D.R
        • Coffey R.M
        Comorbidity measures for use with administrative data.
        Med Care. 1998; 36: 8-27
        • Stineman M.G
        • Escarce J.J
        • Tassoni C.J
        • Goin J.E
        • Granger C.V
        • Williams S.V
        Diagnostic coding and medical rehabilitation length of stay.
        Arch Phys Med Rehabil. 1998; 79: 241-248
        • Gross P.A
        • Stein M.R
        • van Antwerpen C
        • DeMauro P.J
        • Boscamp J.R
        • Hess W
        • et al.
        Comparison of severity of illness indicators in an intensive care unit.
        Arch Intern Med. 1991; 151: 2201-2205
        • Parkerson Jr, G.R
        • Broadhead W.E
        • Tse C.K
        The Duke Severity of Illness Checklist (DUSOI) for measurement of severity and comorbidity.
        J Clin Epidemiol. 1993; 46: 379-393
        • Parkerson Jr, G.R
        • Broadhead W.E
        • Tse C.K
        Health status and severity of illness as predictors of outcomes in primary care.
        Med Care. 1995; 33: 53-66
        • Parkerson Jr, G.R
        • Bridges-Webb C
        • Gervas J
        • Hofmans O
        • Lamberts H
        • Froom J
        • et al.
        Classification of severity of health problems in family/general practice.
        Fam Pract. 1996; 13: 303-309
        • Hallstrom A.P
        • Cobb L.A
        • Yu B.H
        Influence of comorbidity on the outcome of patients treated for out-of-hospital ventricular fibrillation.
        Circulation. 1996; 93: 2019-2022
        • Hurwitz E.L
        • Morgenstern H
        The effects of comorbidity and other factors on medical versus chiropractic care for back problems.
        Spine. 1997; 22: 2254-2263
        • Greenfield S
        • Apolone G
        • McNeil B.J
        • Cleary P.D
        The importance of co-existent disease in the occurrence of postoperative complications and one-year recovery in patients undergoing total hip replacement. Comorbidity and outcomes after hip replacement.
        Med Care. 1993; 31: 141-154
        • Imamura K
        • Mckinnon M
        • Middleton R
        • Black N
        Reliability of a comorbidity measure.
        J Clin Epidemiol. 1997; 50: 1011-1016
        • Incalzi R.A
        • Capparella O
        • Gemma A
        • Landi F
        • Bruno E
        • Di Meo F
        • et al.
        The interaction between age and comorbidity contributes to predicting the mortality of geriatric patients in the acute-care hospital.
        J Intern Med. 1997; 242: 291-298
        • Piccirillo J.F
        Impact of comorbidity and symptoms on the prognosis of patients with oral carcinoma.
        Arch Otolaryngol Head Neck Surg. 2000; 126: 1086-1088
        • Piccirillo J.F
        Importance of comorbidity in head and neck cancer.
        Laryngoscope. 2000; 110: 593-602
        • Kaplan M.H
        • Feinstein A.R
        The importance of classifying initial co-morbidity in evaluating the outcome of diabetes mellitus.
        J Chronic Dis. 1974; 27: 387-404
        • Liu M
        • Tsuji T
        • Tsujiuchi K
        • Chino N
        Comorbidities in stroke patients as assessed with a newly developed comorbidity scale.
        Am J Phys Med Rehabil. 1999; 78: 416-424
        • Shwartz M
        • Iezzoni L.I
        • Moskowitz M.A
        • Ash A.S
        • Sawitz E
        The importance of comorbidities in explaining differences in patient costs.
        Med Care. 1996; 34: 767-782
        • Gijsen R
        • Hoeymans N
        • Schellevis F.G
        • Ruwaard D
        • Satariano W.A
        • van den Bos G.A
        Causes and consequences of comorbidity.
        J Clin Epidemiol. 2001; 54: 661-674
        • Guralnik J.M
        Assessing the impact of comorbidity in the older population.
        Ann Epidemiol. 1996; 6: 376-380
        • Extermann M
        Measurement and impact of comorbidity in older cancer patients.
        Crit Rev Oncol Hematol. 2000; 35: 181-200
        • Extermann M
        Measuring comorbidity in older cancer patients.
        Eur J Cancer. 2000; 36: 453-471
        • van den Akker M
        • Buntinx F
        • Metsemakers J.F
        • Roos S
        • Knottnerus J.A
        Multimorbidity in general practice.
        J Clin Epidemiol. 1998; 51: 367-375
        • Concato J
        • Horwitz R.I
        • Feinstein A.R
        • Elmore J.G
        • Schiff S.F
        Problems of comorbidity in mortality after prostatectomy.
        JAMA. 1992; 267: 1077-1082
        • Verbrugge L.M
        • Lepkowski J.M
        • Imanaka Y
        Comorbidity and its impact on disability.
        Milbank Q. 1989; 67: 450-484
        • Fried L.P
        • Bandeen-Roche K
        • Kasper J.D
        • Guralnik J.M
        Association of comorbidity with disability in older women.
        J Clin Epidemiol. 1999; 52: 27-37
        • Malenka D.J
        • McLerran D
        • Roos N
        • Fisher E.S
        • Wennberg J.E
        Using administrative data to describe casemix.
        J Clin Epidemiol. 1994; 47: 1027-1032
        • Iezzoni L.I
        • Foley S.M
        • Daley J
        • Hughes J
        • Fisher E.S
        • Heeren T
        Comorbidities, complications, and coding bias. Does the number of diagnosis codes matter in predicting in-hospital mortality?.
        JAMA. 1992; 267: 2197-2203
        • Iezzoni L.I
        • Ash A.S
        • Coffman G.A
        • Moskowitz M.A
        Predicting in-hospital mortality. A comparison of severity measurement approaches.
        Med Care. 1992; 30: 347-359
        • Wang P.S
        • Walker A
        • Tsuang M
        • Orav E.J
        • Levin R
        • Avorn J
        Strategies for improving comorbidity measures based on Medicare and Medicaid claims data.
        J Clin Epidemiol. 2000; 53: 571-578
        • Humphries K.H
        • Rankin J.M
        • Carere R.G
        • Buller C.E
        • Kiely F.M
        • Spinelli J.J
        Co-morbidity data in outcomes research.
        J Clin Epidemiol. 2000; 53: 343-349
        • Iezzoni L.I
        The risks of risk adjustment.
        JAMA. 1997; 278: 1600-1607