Scoping review of response shift methods: current reporting practices and recommendations
Response shift (RS) has been defined as a change in the meaning of an individual’s self-evaluation of his/her health status and quality of life. Several statistical model- and design-based methods have been developed to test for RS in longitudinal data. We reviewed the uptake of these methods in patient-reported outcomes (PRO) literature.
CINHAHL, EMBASE, Medline, ProQuest, PsycINFO, and Web of Science were searched to identify English-language articles about RS published until 2016. Data on year and country of publication, PRO measure adopted, RS detection method, type of RS detected, and testing of underlying model assumptions were extracted from the included articles.
Of the 1032 articles identified, 101 (9.8%) articles were included in the study. While 54.5 of the articles reported on the Then-test, 30.7% of the articles reported on Oort’s or Schmitt’s structural equation modeling (SEM) procedure. Newer RS detection methods, such as relative importance analysis and random forest regression, have been used less frequently. Less than 25% reported on testing the assumptions underlying the adopted RS detection method(s).
Despite rapid methodological advancements in RS research, this review highlights the need for further research about RS detection methods for complex longitudinal data and standardized reporting guidelines.
KeywordsResponse shift Systematic review Patient-reported outcomes
The Canadian Institutes of Health Research provided support (Grant # MOP-142404) to Drs Sajobi, Lix, Zumbo, and Sawatzky in this research. Dr. Sajobi is supported by the O’Brien Institute for Public Health; Dr. Lix is supported by the Manitoba Research Chair; and Dr. Sawatzky holds a Canada Research Chair in Patient-Reported Outcomes at Trinity Western University, Langley, British Columbia. We are grateful for the support in conducting literature searches provided by Duncan Dixon, health sciences librarian at Trinity Western University. This research was initiated during Dr. Sajobi’s visit to Trinity Western University in 2014.
- 8.Taminiau-Bloem, E. F., van Zuuren, F. J., Visser, M. R. M., Tishelman, C., Schwartz, C. E., Koeneman, M. A., et al. (2011) Opening the black box of cancer patients’ quality-of-life change assessments: a think-aloud study examining the cognitive processes underlying responses to transition items. Psychol Health, 26(11), 1414–1428.CrossRefPubMedGoogle Scholar
- 9.Schwartz, C. E., Andresen, E. M., Nosek, M. A., & Krahn, G. L. & RRCT Expert Panel on Health Status Measurement. (2007). Response shift theory: Important implications for measuring quality of life in people with disability. Archives of Physical Medicine and Rehabilitation, 88(4), 529–536.CrossRefPubMedGoogle Scholar
- 13.Sawatzky, R., Sajobi, T. T., Brahmbhatt, R., Chan, E. K. H., Lix, L. M., & Zumbo, B. D. (2017). Longitudinal change in response processes: A response shift perspective. In B. D. Zumbo & A. M. Hubley (Eds.), Understanding and investigating response processes in validation research (pp. 251–276). New York: Springer.CrossRefGoogle Scholar
- 16.Vanier, A., Falissard, B., Sébille, V., & Hardouin, J. B. (2017). The complexity of interpreting changes observed over time in health-related quality of life: A short overview of 15 years of research on response shift theory. In F. Guillemin, A. Leplège, S. Briançon, E. Spitz & J. Coste (Eds.), Perceived health and adaptation in chronic disease. Stakes and future challenge (pp. 202–230). New York, NY: CRC Press.Google Scholar
- 21.Anota, A., Bascoul-Mollevi, C., Conroy, T., Guillemin, F., Velten, M., Jolly, D., et al. (2014). Item response theory and factor analysis as a mean to characterize occurrence of response shift in a longitudinal quality of life study in breast cancer patients. Health Qual Life Outcomes, 12, 32.CrossRefPubMedPubMedCentralGoogle Scholar
- 22.Guilleux, A., Blanchin, M., Vanier, A., Guillemin, F., Falissard, B., Schwartz, C. E., et al. (2015). RespOnse Shift ALgorithm in Item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Quality of Life Research, 24(3), 553–564.CrossRefPubMedGoogle Scholar
- 27.Boucekine, M., Loundou, A., Baumstarck, K., Minaya-Flores, P., Pelletier, J., Ghattas, B., et al. (2013). Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study. BMC Medical Research Methodology, 13, 20.CrossRefPubMedPubMedCentralGoogle Scholar
- 31.Joyce, C. R. B., O’Boyle, C., & McGee, H. (1999). Individual quality of life: Approaches to conceptualization and assessment. Amsterdam: Harwood Academic Publishers.Google Scholar
- 34.Ahmed, S., Mayo, N. E., Wood-Dauphinee, S., Hanley, J. A., & Cohen, S. R. (2005). The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. Journal of Clinical Epidemiology, 58(11), 1125–1133.CrossRefPubMedGoogle Scholar
- 39.Ware, J. E. Jr., Kosinski, M., & Keller, S. D. (1994). SF-36 physical and mental scales: A user’s manual. Boston: The Health Institute, New England Medical Center.Google Scholar
- 55.Zumbo, B. D., & Chan, E. K. H. (2014). Reflections on validation practices in the social, behavioral, and health sciences. In B. D. Zumbo & E. K. H. Chan (Eds.), Validity and validation in social, behavioral, and health sciences (Vol. 54, pp. 321–327). New York: Springer International Publishing.Google Scholar
- 56.von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P., STROBE Initiative. (2008). The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Journal of Clinical Epidemiology, 61(4), 344–349.CrossRefGoogle Scholar
- 58.StataCorp. (2015). Stata Statistical Software: Release 14. College Station, TX: StataCorp LP.Google Scholar
- 59.SAS Institute Inc. (2014). SAS/STAT version 9.4. Cary, NC: AS Institute Inc.Google Scholar
- 60.R Core Team. (2012). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.Google Scholar
- 61.Muthén, L. K., & Muthén, B. O. (2011). Mplus user’s guide (6th Edn.). Los Angeles, CA: Muthén & Muthén.Google Scholar