Original Article| Volume 79, P62-69, November 2016

New ICD-10 version of the Multipurpose Australian Comorbidity Scoring System outperformed Charlson and Elixhauser comorbidities in an older population

  • Barbara Toson
    Corresponding author. Tel.: +61-2-9399-1849; fax: +61-2-9399-1204.
    Falls, Balance and Injury Research Centre, Neuroscience Research Australia, Barker Street, Randwick, NSW 2031, Australia
    Search for articles by this author
  • Lara A. Harvey
    Falls, Balance and Injury Research Centre, Neuroscience Research Australia, Barker Street, Randwick, NSW 2031, Australia

    School of Public Health and Community Medicine, UNSW, Kensington, NSW 2033, Australia
    Search for articles by this author
  • Jacqueline C.T. Close
    Falls, Balance and Injury Research Centre, Neuroscience Research Australia, Barker Street, Randwick, NSW 2031, Australia

    Prince of Wales Clinical School, UNSW, Randwick, NSW 2052, Australia
    Search for articles by this author



      To translate, validate, and compare performance of an International Classification of Diseases, 10th revision (ICD-10) version of the Multipurpose Australian Comorbidity Scoring System (MACSS) against commonly used comorbidity measures in the prediction of short- and long-term mortality, 28-day all-cause readmission, and length of stay (LOS).

      Study Design and Setting

      Hospitalization and death data were linked for 25,374 New South Wales residents aged 65 years and older, admitted with a hip fracture between 2008 and 2012. Comorbidities were identified according to the MACSS, Charlson, and Elixhauser definitions using ICD-10 coding algorithms. Regression models were fitted and area under the curve (AUC) and Akaike Information Criterion assessed.


      The ICD-10 MACSS had excellent discriminating ability in predicting inhospital mortality (AUC = 0.81) and 30-day mortality (AUC = 0.80), acceptable prediction of 1-year mortality (AUC = 0.76) but poor discrimination for 28-day readmission and LOS. The MACSS algorithm provided better model fit than either Charlson or Elixhauser algorithm for all outcomes.


      This work presents a rigorous translation of the ICD-9 MACSS for use with ICD-10 coded data. The updated ICD-10 MACSS outperformed both Charlson and Elixhauser measures in an older population and is recommended for use with large administrative data sets in predicting mortality outcomes.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Charlson M.E.
        • Pompei P.
        • Ales K.L.
        • MacKenzie C.R.
        A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.
        J Chronic Dis. 1987; 40: 373-383
        • Elixhauser A.
        • Steiner C.
        • Harris R.D.
        • Coffey R.M.
        Comorbidity measures for use with administrative data.
        Med Care. 1998; 36: 8-27
        • Holman C.D.
        • Preen D.B.
        • Baynham N.J.
        • Finn J.C.
        • Semmens J.B.
        A multipurpose comorbidity scoring system performed better than the Charlson index.
        J Clin Epidemiol. 2005; 58: 1006-1014
        • Deyo R.A.
        • Cherkin D.C.
        • Ciol M.A.
        Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.
        J Clin Epidemiol. 1992; 45: 613-619
        • Quan H.
        • Li B.
        • Couris C.M.
        • Fushimi K.
        • Graham P.
        • Hider P.
        • et al.
        Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries.
        Am J Epidemiol. 2011; 173: 676-682
        • Quan H.
        • Sundararajan V.
        • Halfon P.
        • Fong A.
        • Burnand B.
        • Luthi J.-C.
        • et al.
        Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data.
        Med Care. 2005; 43: 1130-1139
        • Sundararajan V.
        • Henderson T.
        • Perry C.
        • Muggivan A.
        • Quan H.
        • Ghali W.A.
        New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality.
        J Clin Epidemiol. 2004; 57: 1288-1294
        • Sundararajan V.
        • Quan H.
        • Halfon P.
        • Fushimi K.
        • Luthi J.-C.
        • Burnand B.
        • et al.
        Cross-national comparative performance of three versions of the ICD-10 Charlson index.
        Med Care. 2007; 45: 1210-1215
        • Toson B.
        • Harvey L.A.
        • Close J.C.
        The ICD-10 Charlson Comorbidity Index predicted mortality but not resource utilization following hip fracture.
        J Clin Epidemiol. 2015; 68: 44-51
        • Southern D.A.
        • Quan H.
        • Ghali W.A.
        Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data.
        Med Care. 2004; 42: 355-360
        • Stukenborg G.J.
        • Wagner D.P.
        • Connors Jr., A.F.
        Comparison of the performance of two comorbidity measures, with and without information from prior hospitalizations.
        Med Care. 2001; 39: 727-739
        • Mnatzaganian G.
        • Ryan P.
        • Hiller J.E.
        Does Co-morbidity provide significant improvement on age adjustment when predicting medical outcomes?.
        Methods Inf Med. 2014; 53: 115-120
        • World Health Organization
        Classification Implementation Database.
        2015 ([cited 2015 21/6/2015]. Available at) (Accessed October 28, 2015)
        • CDC/National Center for Health Statistics
        International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM).
        Centers for Disease Control and Prevention, Atlanta2014 ([updated May 28, 2014; cited 2014 3 Sep 2014]. Available at) (Accessed October 28, 2015)
        • Ministry of Health New Zealand
        Mapping between ICD-10 and ICD-9.
        2000 ([updated 01 July 2000; cited 2014 3 Sep 2014]. Available at) (Accessed October 28, 2015)
        • Australian Institute of Health and Welfare
        People with dementia in hospitals in New South Wales 2006–07.
        AIHW: Australian Institute of Health and Welfare, Canberra2012
        • Australian Institute of Health and Welfare
        Phillips G. The impact of ICD coding changes for diabetes hospital morbidity data. AIHW, Canberra2003
        • Australian Bureau of Statistics
        3101.0 Australian Demographic Statistics: Estimated Resident Population By Single Year Of Age.
        (New South Wales) Australian Bureau of Statistics, Canberra2013
        • Australian Bureau of Statistics
        Estimated Resident Population By Single Year Of Age.
        (New South Wales) Australian Bureau of Statistics, Canberra2012 ([cited 2015 13/03/2015]. Available at) (Accessed October 28, 2015)
        • National Centre for Classification in Health
        The International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM).
        National Centre for Classification in Health, Faculty of Health Sciences, University of Sydney, Sydney2010
      1. Choicemaker Technologies. Open Source Choicemaker Technology [cited 2014]. Available at Accessed October 28, 2015.

        • Centre for Healh Record Linkage
        Master linkage key quality assurance report.
        • Kreisfeld R.
        • Newson R.
        Hip fracture injuries. Cat. no. INJCAT 93.
        AIHW, Canberra, Australia2006
        • Preen D.B.
        • Holman C.D.
        • Spilsbury K.
        • Semmens J.B.
        • Brameld K.J.
        Length of comorbidity lookback period affected regression model performance of administrative health data.
        J Clin Epidemiol. 2006; 59: 940-946
        • Zou K.H.
        • O'Malley A.J.
        • Mauri L.
        Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models.
        Circulation. 2007; 115: 654-657
        • Akaike H.
        Information theory and an extension of the maximum likelihood principle. Breakthroughs in statistics.
        Springer, New York1992: 610-624
        • Hosmer D.W.
        • Lemeshow S.
        • Sturdivant R.X.
        Applied Logistic Regression.
        Wiley, Hoboken2013
        • DeLong E.R.
        • DeLong D.M.
        • Clarke-Pearson D.L.
        Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.
        Biometrics. 1988; 44: 837-845
        • Field A.
        Discovering Statistics Using SPSS.
        SAGE Publications, London2009
        • Australian Health Performance Authority
        Hospital Performance: Length of stay in public hospitals in 2011-12.
        (Technical supplement)2013
        • Granger C.W.J.
        Extracting information from mega-panels and high-frequency data.
        Stat Neerl. 1998; 52: 258-272
        • SAS Institute
        SAS: statistical software 9.3.
        SAS Institute, Cary, North Carolina2012
        • Moorin R.E.
        • Heyworth J.S.
        • Forbes G.M.
        • Riley T.V.
        Long-term health risks for children and young adults after infective gastroenteritis.
        Emerg Infect Dis. 2010; 16: 1440-1447
        • Kansagara D.
        • Englander H.
        • Salanitro A.
        • Kagen D.
        • Theobald C.
        • Freeman M.
        • et al.
        Risk prediction models for hospital readmission: a systematic review.
        J Am Med Assoc. 2011; 306: 1688-1698
        • Jette N.
        • Quan H.
        • Hemmelgarn B.
        • Drosler S.
        • Maass C.
        • Moskal L.
        • et al.
        The development, evolution, and modifications of ICD-10: challenges to the international comparability of morbidity data.
        Med Care. 2010; 48: 1105-1110
        • Lix L.M.
        • Quail J.
        • Fadahunsi O.
        • Teare G.F.
        Predictive performance of comorbidity measures in administrative databases for diabetes cohorts.
        BMC Health Serv Res. 2013; 13: 340
        • Quail J.M.
        • Lix L.M.
        • Osman B.A.
        • Teare G.F.
        Comparing comorbidity measures for predicting mortality and hospitalization in three population-based cohorts.
        BMC Health Serv Res. 2011; 11: 146
        • Henderson T.
        • Shepheard J.
        • Sundararajan V.
        Quality of diagnosis and procedure coding in ICD-10 administrative data.
        Med Care. 2006; 44: 1011-1019