Advertisement
Original Article| Volume 74, P207-217, June 2016

Rasch analysis reveals comparative analyses of activities of daily living/instrumental activities of daily living summary scores from different residential settings is inappropriate

Published:November 17, 2015DOI:https://doi.org/10.1016/j.jclinepi.2015.11.006

      Abstract

      Objectives

      To internally validate a 15-item dichotomous activities of daily living (ADL) and instrumental activities of daily living (IADL) index.

      Study Design and Setting

      Data were extracted from The Older Persons and Informal Caregivers Survey Minimum DataSet (TOPICS-MDS). Using Rasch modeling, six aspects of the ADL/IADL scale were assessed: (1) overall fit, (2) internal consistency, (3) individual item and person fit, (4) local dependency, (5) targeting, and (6) differential item functioning (DIF) (RUMM 2030). All analyses were stratified by living situation [community-dwelling (n = 21,926) or residential care facility (n = 2,458)].

      Results

      In both settings, “eating” was the easiest activity on the scale and “performing household tasks” was the most difficult activity. However, based on the location on the logit scale, the level of difficulty for certain items varied between residential settings, suggesting summary scores are not equivalent between these settings. DIF by gender and age group was observed for several items, indicating potential measurement bias in the scale.

      Conclusion

      Unless adjustments are undertaken, ADL/IADL summary scores retrieved from older persons residing in the community or residential care facilities should not be directly compared. This 15-item scale is poorly targeted for a community-dwelling older population, underscoring the need for items with improved discriminative ability.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Streiner D.L.
        • Norman G.R.
        Health measure scales: a practical guide to their development and use.
        4th ed. Oxford University Press, New York2008
        • Tractenberg R.E.
        Classical and modern measurement theories, patient reports, and clinical outcomes.
        Contemp Clin trials. 2010; 31: 1-3
        • Belvedere S.L.
        • de Morton N.A.
        Application of Rasch analysis in health care is increasing and is applied for variable reasons in mobility instruments.
        J Clin Epidemiol. 2010; 63: 1287-1297
        • Tennant A.
        • Conaghan C.
        The Rasch measurement model in rheumatology: what is it and why use it? when should it be applied, and what should one look for in a Rasch paper?.
        Arthritis Rheum. 2007; 57: 1358-1362
        • Lim S.M.
        • Rodger S.
        • Brown T.
        Using Rasch analysis to establish the construct validity of rehabilitation assessment tools.
        Int J Ther Rehabil. 2009; 16: 251-260
        • Osterlind S.J.
        • Everson H.T.
        Differential item functioning.
        2nd ed. Sage Publications, Inc, USA2009
        • Krabbe P.F.
        A generalized measurement model to quantify health: the multi-attribute preference response model.
        PLoS One. 2013; 8: e79494
        • Fusco O.
        • Ferrini A.
        • Santoro M.
        • Lo Monaco M.R.
        • Gambassi G.
        • Cesari M.
        Physical function and perceived quality of life in older persons.
        Aging Clin Exp Res. 2012; 24: 68-73
        • Holroyd S.
        • Currie L.J.
        • Wooten G.F.
        Depression is associated with impairment of ADL, not motor function in Parkinson disease.
        Neurology. 2005; 64: 2134-2135
        • Laan W.
        • Zuithoff N.P.
        • Drubbel I.
        • Bleijenberg N.
        • Numans M.E.
        • De Wit N.J.
        • et al.
        Validity and reliability of the Katz-15 scale to measure unfavorable health outcomes in community-dwelling older people.
        J Nutr Health Aging. 2014; 18: 848-854
        • Buurman B.M.
        • van Munster B.C.
        • Korevaar J.C.
        • de Haan R.J.
        • de Rooij S.E.
        Variability in measuring (instrumental) activities of daily living functioning and functional decline in hospitalized older medical patients: a systematic review.
        J Clin Epidemiol. 2011; 64: 619-627
        • Ward G.
        • Jagger C.
        • Harper W.
        A review of instrumental ADL assessments for use with elderly people.
        Rev Clin Gerontol. 1998; 8: 65-71
        • Lindeboom R.
        • Vermeulen M.
        • Holman R.
        • De Haan R.J.
        Activities of daily living instruments:optimizing scales for neurologic assessments.
        Neurology. 2003; 60: 738-742
        • Gerrard P.
        The hierarchy of the activities of daily living in the Katz index in residents of skilled nursing facilities.
        J Geriatr Phys Ther. 2013; 36: 87-91
        • Kempen G.I.
        • Miedema I.
        • Ormel J.
        • Molenaar W.
        The assessment of disability with the Groningen Activity Restriction Scale. Conceptual framework and psychometric properties.
        Social Sci Med. 1996; 43: 1601-1610
        • Weinberger M.
        • Samsa G.P.
        • Schmader K.
        • Greenberg S.M.
        • Carr D.B.
        • Wildman D.S.
        Comparing proxy and patients' perceptions of patients' functional status: results from an outpatient geriatric clinic.
        J Am Geriatr Soc. 1992; 40: 585-588
        • Fieo R.A.
        • Austin E.J.
        • Starr J.M.
        • Deary I.J.
        Calibrating ADL-IADL scales to improve measurement accuracy and to extend the disability construct into the preclinical range: a systematic review.
        BMC Geriatr. 2011; 11: 42
        • das Nair R.
        • Moreton B.J.
        • Lincoln N.B.
        Rasch analysis of the Nottingham extended activities of daily living scale.
        J Rehabil Med. 2011; 43: 944-950
        • Lutomski J.E.
        • Baars M.A.
        • Schalk B.W.
        • Boter H.
        • Buurman B.M.
        • den Elzen W.P.
        • et al.
        The development of the Older Persons and Informal Caregivers Survey Minimum DataSet (TOPICS-MDS): a large-scale data sharing initiative.
        PLoS One. 2013; 8: e81673
        • LaPlante M.P.
        The classic measure of disability in activities of daily living is biased by age but an expanded IADL/ADL measure is not.
        J Gerontol Ser B Psychol Sci Soc Sci. 2010; 65: 720-732
        • Fleishman J.A.
        • Spector W.D.
        • Altman B.M.
        Impact of differential item functioning on age and gender differences in functional disability.
        J Gerontol Ser B Psychol Sci Soc Sci. 2002; 57: S275-S284
        • Spector W.D.
        • Fleishman J.A.
        Combining activities of daily living with instrumental activities of daily living to measure functional disability.
        J Gerontol Ser B Psychol Sci Soc Sci. 1998; 53: S46-S57
        • Zucca A.
        • Lambert S.D.
        • Boyes A.W.
        • Pallant J.F.
        Rasch analysis of the Mini-Mental Adjustment to Cancer Scale (mini-MAC) among a heterogeneous sample of long-term cancer survivors: a cross-sectional study.
        Health Qual Life Outcomes. 2012; 10: 55
        • van der Wal M.B.
        • Tuinebreijer W.E.
        • Lundgren-Nilsson A.
        • Middelkoop E.
        • van Zuijlen P.P.
        Differential item functioning in the Observer Scale of the POSAS for different scar types.
        Qual Life Res. 2014; 23: 2037-2045
        • Rosseel Y.
        Lavaan: an R package for structural equation modeling.
        J Stat Softw. 2012; 48: 1-36
        • Browne M.W.
        • Cudeck R.
        Alternative ways of assessing model fit.
        Sociol Methods Res. 1993; 21: 230-258
        • Bentler P.M.
        Comparative fit indexes in structural models.
        Psychol Bull. 1990; 107: 238-246
        • Hu L.
        • Bentler P.M.
        Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives.
        Struct Equ Modeling. 1999; 6: 1-55
        • Tennant A.
        • Pallant J.F.
        The root mean square error of approximation (RMSEA) as a supplementary statistic to determine fit to the Rasch model with large sample sizes.
        Rasch Meas Trans. 2012; 25: 1348-1349
        • Wright B.D.
        Logits?.
        Rasch Meas Trans. 1993; 7: 288
        • Shea T.L.
        • Tennant A.
        • Pallant J.F.
        Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS).
        BMC Psychiatry. 2009; 9: 21
        • Bruce B.
        • Fries J.F.
        • Ambrosini D.
        • Lingala B.
        • Gandek B.
        • Rose M.
        • et al.
        Better assessment of physical function: item improvement is neglected but essential.
        Arthritis Res Ther. 2009; 11: R191
        • Pallant J.F.
        • Miller R.L.
        • Tennant A.
        Evaluation of the Edinburgh Post Natal Depression Scale using Rasch analysis.
        BMC Psychiatry. 2006; 6: 28
        • Treas J.
        • Lui J.
        Studying housework across nations.
        J Fam Theor Rev. 2013; 5: 135-149
        • Paz S.H.
        • Spritzer K.L.
        • Morales L.S.
        • Hays R.D.
        Age-related differential item functioning for the patient-reported outcomes information system (PROMIS(R)) physical functioning items.
        Prim Health Care. 2013; 3
        • Engelhard Jr., G.
        Invariant measurement: using Rasch models in the social, behavioral, and health sciences.
        Routledge, New York, NY, USA2013
        • National Research Council
        Improving the measurement of late-life disability in population surveys: beyond ADLs and IADLs: summary of a workshop.
        The National Academies Press, Washington, DC, USA2009
        • Guralnick J.M.
        • Branch L.G.
        • Cummings S.R.
        • Curb J.D.
        Physical performance measures in aging research.
        J Gerontol. 1989; 44: M141-M146
        • Aletaha D.
        From the item to the outcome: the promising prospects of PROMIS.
        Arthritis Res Ther. 2010; 12: 104
        • Rose M.
        • Bjorner J.B.
        • Gandek B.
        • Bruce B.
        • Fries J.F.
        • Ware Jr., J.E.
        The PROMIS physical function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.
        J Clin Epidemiol. 2014; 67: 516-526
        • Cook K.F.
        • Kallen M.A.
        • Amtmann D.
        Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption.
        Qual Life Res. 2009; 18: 447-460
        • Martin P.
        • Lynn P.
        The effects of mixed mode survey designs on simple and complex analyses.
        (Centre for Comparative Social Surveys Working Paper Series: Paper no. 04) Centre for Comparative Social Surveys, City University London, 2011 (Available at: http://www.city.ac.uk/__data/assets/pdf_file/0017/125135/CCSS-Working-Paper-No-04.pdf. Accessed January 12, 2016)
        • Lutomski J.E.
        • Krabbe P.F.
        • Bleijenberg N.
        • Blom J.W.
        • Buurman B.M.
        • Kempen G.I.
        • et al.
        Survey Mode Biases Reporting of Activities of Daily Living and Instrumental Activities of Daily Living.
        J Am Geriatr Soc. 2015; 63: 2419-2421
        • van der Linden W.
        Sample independency in the Rasch model?.
        Rasch Meas Trans. 1993; 6: 247