Abstract
More emphasis has been placed on the inclusion of patients’ perspectives in the assessment of outcomes and treatment effects in medicine and health care via the use of psychometric patient-reported outcome (PRO) instruments. In this study, we examined the reporting of the validity evidence for the SF-36 and the World Health Organization Quality of Life (WHOQoL) Assessment, two commonly used psychometric PRO instruments. Searches were conducted on PubMed, PsycINFO, CINAHL, and EMBASE in January 2013. Thirty randomly selected empirical articles (15 each for the SF-36 and WHOQoL) were included in the present analysis. We found that researchers conducting validation studies on the SF-36 and WHOQoL report a wide variety of validity evidence and are not relying on only one source of validity evidence at the exclusion of all others. Although the SF-36 and WHOQoL both possess evidence to support their score inferences, certain sources of evidence that are emerging as central to the validity claim (e.g., response processes, consequences) have yet to be examined.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
References marked with an asterisk indicate studies included in the review.
References
References marked with an asterisk indicate studies included in the review.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
Auewarakul, C., Downing, S. M., Jaturatamrong, U., & Praditsuwan, R. (2005). Sources of validity evidence for an internal medicine student evaluation system: An evaluative study of assessment methods. Medical Education, 39, 276–283.
*Augustovski, F. A., Lewin, G., Elorrio, E. G., & Rubinstein, A. (2008). The Argentine-Spanish SF-36 Health Survey was successfully validated for local outcome research. Journal of Clinical Epidemiology, 61, 1279–1284.
*Berlim, M. T., Pavanello, D. P., Caldieraro, M. A. K., & Fleck, M. P. A. (2005). Reliability and validity of the WHOQOL BREF in a sample of Brazilian outpatients with major depression. Quality of Life Research, 14, 561–564.
*Bonomi, A. E., Patrick, D. L., Bushnell, D. M., & Martin, M. (2000). Validation of the United States’ version of the World Health Organization Quality of Life (WHOQOL) instrument. Journal of Clinical Epidemiology, 53, 1–12.
Brundage, M., Blazeby, J., Revicki, D., Bass, B., de Vet, H., Duffy, H., et al. (2013). Patient-reported outcomes in randomized clinical trials: Development of ISOQOL reporting standards. Quality of Life Research, 22, 1161–1175.
Calvert, M., Blazeby, J., Altma, D. G., Revicki, D. A., Moher, D., & Brundage, M. D., for the CONSORT PRO Group. (2013). Reporting of patient-reported outcomes in randomized trials: The CONSORT PRO extension. Journal of the American Medical Association, 309, 814–822.
*Chien, C.-W., Wang, J.-D., Yao, G., Sheu, C.-F., & Hsieh, C.-L. (2007). Development and validation of a WHOQOL-BREF Taiwanese audio player-assisted interview version for the elderly who use a spoken dialect. Quality of Life Research, 16, 1375–1381.
Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412.
Cizek, G. J., Bowen, D., & Church, K. (2010). Sources of validity evidence for educational and psychological tests: A follow-up study. Educational and Psychological Measurement, 70, 732–743.
*Colbourn, T., Masache, G., & Skordis-Worrall, J. (2012). Development, reliability and validity of the Chichewa WHOQOL-BREF in adults in Lilongwe, Malawi. BioMed Central Research Notes, 5, 346.
*Dallmeijer, A. J., de Groot, V., Roorda, L. D., Schepers, V. P. M., Lindeman, E., van den Berg, L. H., Beelen, A., & Dekker, J. (2007). Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: A study using Rasch analysis. Journal of Rehabilitation Medicine, 39, 163–169.
*Edgar, D., Dawson, A., Hankey, G., Phillips, M., & Wood, F. (2010). Demonstration of the validity of the SF-36 for measurement of the temporal recovery of quality of life outcomes in burns survivors. Burns, 36, 1013–1020.
Fayers, P., & Machin, D. (2007). Quality of life: The assessment, analysis and interpretation of patient-reported outcomes (2nd ed.). Chichester: Wiley.
Food and Drug Administration. (2009). Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims. Rockville: Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research.
*Garcia-Rea, E. A., & LePage, J. P. (2010). Reliability and validity of the World Health Organization Quality of Life: Brief version (WHOQOL-BREF) in a homeless substance dependent veteran population. Social Indicators Research, 99, 333–340.
*Hsiung, P. C., Fang, C. T., Wu, C. H., Sheng, W. H., Chen, S. C., Wang, J. D., & Yao, G. (2011). Validation of the WHOQOL-HIV BREF among HIV-infected patients in Taiwan. AIDS Care, 23, 1035–1042.
Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103, 219–230.
Hubley, A. M., & Zumbo, B. D. (2013). Psychometric characteristics of assessment procedures: An overview. In K. F. Geisinger (Ed.), APA handbook of testing and assessment in psychology (Vol. 1, pp. 3–19). Washington, DC: American Psychological Association Press.
*Jahanlou, A. S., & Karami, N. A. (2011). WHO quality of life-BREF 26 questionnaire: Reliability and validity of the Persian version and compare it with Iranian diabetics quality of life questionnaire in diabetic patients. Primary Care Diabetes, 5, 103–107.
*Keller, S. D., Ware, J. E., Jr., Hatoum, H. T., & Kong, S. X. (1999). The SF-36 Arthritis-Specific Health Index (ASHI): II. Tests of validity in four clinical trials. Medical Care, 37, 51–60.
Kopec, J. A., & Willison, K. D. (2003). A comparative review of four preference-weighted measures of health-related quality of life. Journal of Clinical Epidemiology, 56, 317–325.
*Lam, C. L., Tse, E. Y., Gandek, B., & Fong, D. Y. (2005). The SF-36 summary scales were valid, reliable, and equivalent in a Chinese population. Journal of Clinical Epidemiology, 58, 815–822.
*Lera, L., Fuentes-García, A., Sánchez, H., & Albala, C. (2013). Validity and reliability of the sf-36 in Chilean older adults: The ALEXANDROS study. European Journal of Ageing, 10, 127–134.
*Lucas-Carrasco, R., Skevington, S. M., Gómez-Benito, J., Rejas, J., & March, J. (2011). Using the WHOQOL-BREF in persons with dementia: A validation study. Alzheimer Disease and Associated Disorders, 25, 345–351.
*Masthoff, E. D., Trompenaars, F. J., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2005). Validation of the WHO Quality of Life assessment instrument (WHOQOL-100) in a population of Dutch adult psychiatric outpatients. European Psychiatry, 20, 465–473.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education and Macmillan.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
*Montazeri, A., Goshtasebi, A., Vahdaninia, M., & Gandek, B. (2005). The Short Form Health Survey (SF-36): Translation and validation study of the Iranian version. Quality of Life Research, 14, 875–882.
*Osborne, R. H., Hawthorne, G., Lew, E. A., & Gray, L. C. (2003). Quality of life assessment in the community-dwelling elderly: Validation of the Assessment of Quality of Life (AQoL) instrument and comparison with the SF-36. Journal of Clinical Epidemiology, 56, 138–147.
Richardson, C. G., & Zumbo, B. D. (2000). A statistical examination of the Health Utility Index-Mark III as a summary measure of health. Social Indicators Research, 51, 171–191.
*Rotstein, Z., Barak, Y., Noy, S., & Achiron, A. (2000). Quality of life in multiple sclerosis: Development and validation of the ‘RAYS’ scale and comparison with the SF-36. International Journal for Quality in Health Care, 12, 511–517.
*Saddki, N., Noor, M. M., Norbanee, T. H., Rusli, M. A., Norzila, Z., Zaharah, S., Sarimah, A., Norsarwany, M., Asrenee, A. R., & Zarina, Z. A. (2009). Validity and reliability of the Malay version of WHOQOL-HIV BREF in patients with HIV infection. AIDS Care, 21, 1271–1278.
*Scott, K. M., Sarfati, D., Tobias, M. I., & Haslett, S. J. (2000). A challenge to the cross-cultural validity of the SF-36 health survey: Factor structure in Māori, Pacific and New Zealand European ethnic groups. Social Science & Medicine, 51, 1655–1664.
*Seymour, D. G., Ball, A. E., Russell, E. M., Primrose, W. R., Garratt, A. M., & Crawford, J. R. (2001). Problems in using health survey questionnaires in older patients with physical disabilities. The reliability and validity of the SF-36 and the effect of cognitive impairment. Journal of Evaluation in Clinical Practice, 7, 411–418.
*Skevington, S. M., & Wright, A. (2001). Changes in the quality of life of patients receiving antidepressant medication in primary care: Validation of the WHOQOL-100. British Journal of Psychiatry, 178, 261–267.
*SooHoo, N. F., McDonald, A. P., Seiler, I. J. G., & McGillivary, G. R. (2002). Evaluation of the construct validity of the DASH questionnaire by correlation to the SF-36. Journal of Hand Surgery, 27, 537–541.
*Takeshita, K., Maruyama, T., Matsudaira, K., Murakami, M., Higashikawa, A., & Nakamura, K. (2006). Validity and reliability of SRSI and SF-36 in Japanese patients with scoliosis. Studies in Health Technology and Informatics, 123, 337–342.
The WHOQoL Group. (1994). The development of the World Health Organization Quality of Life Assessment Instrument (the WHOQoL). In J. Orley & W. Kuyken (Eds.), Quality of life assessment: International perspectives. Heidelberg: Springer.
*Trompenaars, F. J., Masthoff, E. D., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2005). Content validity, construct validity, and reliability of the WHOQOL-Bref in a population of Dutch adult psychiatric outpatients. Quality of Life Research, 14, 151–160.
*Tsutsumi, A., Izutsu, T., Kato, S., Islam, M. A., Yamada, H. S., Kato, H., & Wakai, S. (2006). Reliability and validity of the Bangla version of WHOQOL-BREF in an adult population in Dhaka, Bangladesh. Psychiatry and Clinical Neurosciences, 60, 493–498.
*Van Leeuwen, C. M. C., Van Der Woude, L. H. V., & Post, M. W. M. (2012). Validity of the mental health subscale of the SF-36 in persons with spinal cord injury. Spinal Cord, 50, 707–710.
Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). SF-36 health survey manual and interpretation guide. Boston: New England Medical Center, The Health Institute.
Ware, J. E., Kosinski, M., & Keller, S. K. (1994). SF-36 physical and mental health summary scales: A user’s manual. Boston: The Health Institute.
Ware, J. E., Keller, S. D., Gandek, B., Brazier, J. E., & Sullivan, M. (1995). Evaluating translations of health status questionnaires: Methods from the IQOLA project. International Journal of Technology Assessment in Health Care, 11, 525–551.
*Webster, J., Nicholas, C., Valacott, C., Cridland, N., & Fawcett, L. (2010). Validation of the WHOQOL-BREF among women following childbirth. The Australian & New Zealand Journal of Obstetrics & Gynaecology, 50, 132–137.
*Wyss, K., Wagner, A. K., Whiting, D., Mtasiwa, D. M., Tanner, M., Gandek, B., & Kilima, P. M. (1999). Validation of the Kiswahili version of the SF-36 Health Survey in a representative sample of an urban population in Tanzania. Quality of Life Research, 8, 111–120.
*Yao, G., Wu, C.-h., & Yang, C.-t. (2008). Examining the content validity of the WHOQOL-BREF from respondents’ perspective by quantitative methods. Social Indicators Research, 85, 483–498.
Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Psychometrics (Handbook of statistics, Vol. 26, pp. 45–79). Amsterdam/Boston: Elsevier Science B.V.
Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte: Information Age Publishing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Chan, E.K.H., Zumbo, B.D., Zhang, W., Chen, M.Y., Darmawanti, I., Mulyana, O.P. (2014). Medical Outcomes Study Short Form-36 (SF-36) and the World Health Organization Quality of Life (WHOQoL) Assessment: Reporting of Psychometric Validity Evidence. In: Zumbo, B., Chan, E. (eds) Validity and Validation in Social, Behavioral, and Health Sciences. Social Indicators Research Series, vol 54. Springer, Cham. https://doi.org/10.1007/978-3-319-07794-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-07794-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07793-2
Online ISBN: 978-3-319-07794-9
eBook Packages: Humanities, Social Sciences and LawSocial Sciences (R0)