The Guttman errors as a tool for response shift detection at subgroup and item levels
- 211 Downloads
Statistical methods for identifying response shift (RS) at the individual level could be of great practical value in interpreting change in PRO data. Guttman errors (GE) may help to identify discrepancies in respondent’s answers to items compared to an expected response pattern and to identify subgroups of patients that are more likely to present response shift. This study explores the benefits of using a GE-based method for RS detection at the subgroup and item levels.
The analysis was performed on the SatisQoL study. The number of GE was determined for each individual at each time of measurement (at baseline T0 and 6 months after discharge M6). Individuals showing discrepancies (with many GE) were suspected to interpret the items differently from the majority of the sample. Patients having a large number of GE at M6 only and not at T0 were assumed to present RS. Patients having a small number of GE at T0 and M6 were assumed to present no RS. The RespOnse Shift ALgorithm in Item response theory (ROSALI) was then applied on the whole sample and on both groups.
Different types of RS (non-uniform recalibration, reprioritization) were more prevalent in the group composed of patients assumed to present RS based on GE. On the opposite, no RS was detected on patients having few GE.
Guttman errors and item response theory models seem to be relevant tools to discriminate individuals affected by RS from the others at the item level.
KeywordsResponse shift Guttman errors Item response theory Item level Individual level
The authors gratefully acknowledge Frans J. Oort, Mirjam A. G. Sprangers and Mathilde G. E. Verdam for their comments on the manuscript. This study was supported by the Institut National du Cancer, under reference “INCA_6931.” The SatisQoL cohort project (Investigators: P Auquier, F Guillemin (PI), M Mercier) was supported by an IRESP (Institut de recherche en santé publique) grant from Inserm, and a PHRC (Programme Hospitalier de Recherche Clinique) national grant from French Ministry of Health, France.
Compliance with ethical standards
Authors declare that they have no conflict of interest. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. The SatisQoL study was approved by the national Institutional Review Board and the national committee for data protection (CCTIRS 07.212 and CNIL 1248560).
- 3.Guilleux, A., Blanchin, M., Vanier, A., Guillemin, F., Falissard, B., Hardouin, J. B., & Sébille, V. (2015). RespOnse shift algorithm in item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Quality of Life Research, 24(3), 553–564.CrossRefPubMedGoogle Scholar
- 5.Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (1st ed., Vol. 5). Thousand Oaks: Sage.Google Scholar
- 6.Kepka, S., Baumann, C., Anota, A., Buron, G., Spitz, E., Auquier, P., & Mercier, M. (2013). The relationship between traits optimism and anxiety and health-related quality of life in patients hospitalized for chronic diseases: Data from the SATISQOL study. Health and Quality of Life Outcomes, 11(1), 134. doi: 10.1186/1477-7525-11-134.CrossRefPubMedPubMedCentralGoogle Scholar
- 8.Leplège, A., Ecosse, E., Verdier, A. & Perneger, T. V. (1998). The French SF-36 health survey: Translation, cultural adaptation and preliminary psychometric evaluation. Journal of Clinical Epidemiology, 51(11), 1013–1023. doi: 10.1016/S0895-4356(98)00093-6.
- 9.Beller, J., & Kliem, S. (2013). GetR: Calculate Guttman error trees in R (version 0.1) [computer software]. Hannover, Germany. http://cran.r-project.org/web/packages/GetR/.
- 14.van Leeuwen, C. M. C., Post, M. W. M., van der Woude, L. H. V., de Groot, S., Smit, C., van Kuppevelt, D., & Lindeman, E. (2012). Changes in life satisfaction in persons with spinal cord injury during and after inpatient rehabilitation: Adaptation or measurement bias? Quality of Life Research, 21(9), 1499–1508.CrossRefPubMedPubMedCentralGoogle Scholar
- 23.Rapkin, B. D. & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(14). doi: 10.1186/1477-7525-2-14.
- 24.Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale: Erlbaum.Google Scholar