Literacy affected ability to adequately discriminate among categories in multipoint Likert Scales

Abstract 

Objectives

To assess the effect of inability to read on a five-point Likert scale, using the WHOQOL-BREF response scale. It is hypothesized that inability to read is related to loss of discriminant power among the five-category response scale.

Study Design and Setting

In a cross-sectional design, nonreaders (n=141) and subjects educated at a graduate level (n−907) were assessed. Statistical analyses combined classic and modern psychometric approaches (Confirmatory factor analysis and Rasch analysis).

Results

There is a remarkable difference in the psychometric performance of items across the two subgroups. Fit indexes proved to be closer to the ideal for the graduate group, but not for the nonreader group. Reducing the number of response categories improved the model exclusively for the nonreader sample. Nonreaders do not interpret the scale as a true five-category scale, but exhibit a response pattern indicative that only three categories are in fact considered.

Conclusion

These results confirm the hypothesis that a multiple-category response scale is not suitable for nonreaders. They suggest that a simpler response scale should be adopted to achieve a more reliable and satisfactory psychometric performance in this population. This effect seems to be stronger when more abstract and subjective constructs are involved.

Keywords: Inability to read, Psychometrics, Likert, Rasch, Quality of life, Scale