Skip to main content

Medical Outcomes Study Short Form-36 (SF-36) and the World Health Organization Quality of Life (WHOQoL) Assessment: Reporting of Psychometric Validity Evidence

  • Chapter
  • First Online:
Validity and Validation in Social, Behavioral, and Health Sciences

Abstract

More emphasis has been placed on the inclusion of patients’ perspectives in the assessment of outcomes and treatment effects in medicine and health care via the use of psychometric patient-reported outcome (PRO) instruments. In this study, we examined the reporting of the validity evidence for the SF-36 and the World Health Organization Quality of Life (WHOQoL) Assessment, two commonly used psychometric PRO instruments. Searches were conducted on PubMed, PsycINFO, CINAHL, and EMBASE in January 2013. Thirty randomly selected empirical articles (15 each for the SF-36 and WHOQoL) were included in the present analysis. We found that researchers conducting validation studies on the SF-36 and WHOQoL report a wide variety of validity evidence and are not relying on only one source of validity evidence at the exclusion of all others. Although the SF-36 and WHOQoL both possess evidence to support their score inferences, certain sources of evidence that are emerging as central to the validity claim (e.g., response processes, consequences) have yet to be examined.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    References marked with an asterisk indicate studies included in the review.

References

References marked with an asterisk indicate studies included in the review.

  • American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    Google Scholar 

  • Auewarakul, C., Downing, S. M., Jaturatamrong, U., & Praditsuwan, R. (2005). Sources of validity evidence for an internal medicine student evaluation system: An evaluative study of assessment methods. Medical Education, 39, 276–283.

    Article  Google Scholar 

  • *Augustovski, F. A., Lewin, G., Elorrio, E. G., & Rubinstein, A. (2008). The Argentine-Spanish SF-36 Health Survey was successfully validated for local outcome research. Journal of Clinical Epidemiology, 61, 1279–1284.

    Article  Google Scholar 

  • *Berlim, M. T., Pavanello, D. P., Caldieraro, M. A. K., & Fleck, M. P. A. (2005). Reliability and validity of the WHOQOL BREF in a sample of Brazilian outpatients with major depression. Quality of Life Research, 14, 561–564.

    Article  Google Scholar 

  • *Bonomi, A. E., Patrick, D. L., Bushnell, D. M., & Martin, M. (2000). Validation of the United States’ version of the World Health Organization Quality of Life (WHOQOL) instrument. Journal of Clinical Epidemiology, 53, 1–12.

    Article  Google Scholar 

  • Brundage, M., Blazeby, J., Revicki, D., Bass, B., de Vet, H., Duffy, H., et al. (2013). Patient-reported outcomes in randomized clinical trials: Development of ISOQOL reporting standards. Quality of Life Research, 22, 1161–1175.

    Article  Google Scholar 

  • Calvert, M., Blazeby, J., Altma, D. G., Revicki, D. A., Moher, D., & Brundage, M. D., for the CONSORT PRO Group. (2013). Reporting of patient-reported outcomes in randomized trials: The CONSORT PRO extension. Journal of the American Medical Association, 309, 814–822.

    Google Scholar 

  • *Chien, C.-W., Wang, J.-D., Yao, G., Sheu, C.-F., & Hsieh, C.-L. (2007). Development and validation of a WHOQOL-BREF Taiwanese audio player-assisted interview version for the elderly who use a spoken dialect. Quality of Life Research, 16, 1375–1381.

    Article  Google Scholar 

  • Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412.

    Article  Google Scholar 

  • Cizek, G. J., Bowen, D., & Church, K. (2010). Sources of validity evidence for educational and psychological tests: A follow-up study. Educational and Psychological Measurement, 70, 732–743.

    Article  Google Scholar 

  • *Colbourn, T., Masache, G., & Skordis-Worrall, J. (2012). Development, reliability and validity of the Chichewa WHOQOL-BREF in adults in Lilongwe, Malawi. BioMed Central Research Notes, 5, 346.

    Google Scholar 

  • *Dallmeijer, A. J., de Groot, V., Roorda, L. D., Schepers, V. P. M., Lindeman, E., van den Berg, L. H., Beelen, A., & Dekker, J. (2007). Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: A study using Rasch analysis. Journal of Rehabilitation Medicine, 39, 163–169.

    Article  Google Scholar 

  • *Edgar, D., Dawson, A., Hankey, G., Phillips, M., & Wood, F. (2010). Demonstration of the validity of the SF-36 for measurement of the temporal recovery of quality of life outcomes in burns survivors. Burns, 36, 1013–1020.

    Article  Google Scholar 

  • Fayers, P., & Machin, D. (2007). Quality of life: The assessment, analysis and interpretation of patient-reported outcomes (2nd ed.). Chichester: Wiley.

    Book  Google Scholar 

  • Food and Drug Administration. (2009). Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims. Rockville: Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research.

    Google Scholar 

  • *Garcia-Rea, E. A., & LePage, J. P. (2010). Reliability and validity of the World Health Organization Quality of Life: Brief version (WHOQOL-BREF) in a homeless substance dependent veteran population. Social Indicators Research, 99, 333–340.

    Article  Google Scholar 

  • *Hsiung, P. C., Fang, C. T., Wu, C. H., Sheng, W. H., Chen, S. C., Wang, J. D., & Yao, G. (2011). Validation of the WHOQOL-HIV BREF among HIV-infected patients in Taiwan. AIDS Care, 23, 1035–1042.

    Article  Google Scholar 

  • Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103, 219–230.

    Article  Google Scholar 

  • Hubley, A. M., & Zumbo, B. D. (2013). Psychometric characteristics of assessment procedures: An overview. In K. F. Geisinger (Ed.), APA handbook of testing and assessment in psychology (Vol. 1, pp. 3–19). Washington, DC: American Psychological Association Press.

    Google Scholar 

  • *Jahanlou, A. S., & Karami, N. A. (2011). WHO quality of life-BREF 26 questionnaire: Reliability and validity of the Persian version and compare it with Iranian diabetics quality of life questionnaire in diabetic patients. Primary Care Diabetes, 5, 103–107.

    Article  Google Scholar 

  • *Keller, S. D., Ware, J. E., Jr., Hatoum, H. T., & Kong, S. X. (1999). The SF-36 Arthritis-Specific Health Index (ASHI): II. Tests of validity in four clinical trials. Medical Care, 37, 51–60.

    Google Scholar 

  • Kopec, J. A., & Willison, K. D. (2003). A comparative review of four preference-weighted measures of health-related quality of life. Journal of Clinical Epidemiology, 56, 317–325.

    Article  Google Scholar 

  • *Lam, C. L., Tse, E. Y., Gandek, B., & Fong, D. Y. (2005). The SF-36 summary scales were valid, reliable, and equivalent in a Chinese population. Journal of Clinical Epidemiology, 58, 815–822.

    Article  Google Scholar 

  • *Lera, L., Fuentes-García, A., Sánchez, H., & Albala, C. (2013). Validity and reliability of the sf-36 in Chilean older adults: The ALEXANDROS study. European Journal of Ageing, 10, 127–134.

    Article  Google Scholar 

  • *Lucas-Carrasco, R., Skevington, S. M., Gómez-Benito, J., Rejas, J., & March, J. (2011). Using the WHOQOL-BREF in persons with dementia: A validation study. Alzheimer Disease and Associated Disorders, 25, 345–351.

    Article  Google Scholar 

  • *Masthoff, E. D., Trompenaars, F. J., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2005). Validation of the WHO Quality of Life assessment instrument (WHOQOL-100) in a population of Dutch adult psychiatric outpatients. European Psychiatry, 20, 465–473.

    Article  Google Scholar 

  • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education and Macmillan.

    Google Scholar 

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.

    Article  Google Scholar 

  • *Montazeri, A., Goshtasebi, A., Vahdaninia, M., & Gandek, B. (2005). The Short Form Health Survey (SF-36): Translation and validation study of the Iranian version. Quality of Life Research, 14, 875–882.

    Article  Google Scholar 

  • *Osborne, R. H., Hawthorne, G., Lew, E. A., & Gray, L. C. (2003). Quality of life assessment in the community-dwelling elderly: Validation of the Assessment of Quality of Life (AQoL) instrument and comparison with the SF-36. Journal of Clinical Epidemiology, 56, 138–147.

    Article  Google Scholar 

  • Richardson, C. G., & Zumbo, B. D. (2000). A statistical examination of the Health Utility Index-Mark III as a summary measure of health. Social Indicators Research, 51, 171–191.

    Article  Google Scholar 

  • *Rotstein, Z., Barak, Y., Noy, S., & Achiron, A. (2000). Quality of life in multiple sclerosis: Development and validation of the ‘RAYS’ scale and comparison with the SF-36. International Journal for Quality in Health Care, 12, 511–517.

    Article  Google Scholar 

  • *Saddki, N., Noor, M. M., Norbanee, T. H., Rusli, M. A., Norzila, Z., Zaharah, S., Sarimah, A., Norsarwany, M., Asrenee, A. R., & Zarina, Z. A. (2009). Validity and reliability of the Malay version of WHOQOL-HIV BREF in patients with HIV infection. AIDS Care, 21, 1271–1278.

    Article  Google Scholar 

  • *Scott, K. M., Sarfati, D., Tobias, M. I., & Haslett, S. J. (2000). A challenge to the cross-cultural validity of the SF-36 health survey: Factor structure in Māori, Pacific and New Zealand European ethnic groups. Social Science & Medicine, 51, 1655–1664.

    Article  Google Scholar 

  • *Seymour, D. G., Ball, A. E., Russell, E. M., Primrose, W. R., Garratt, A. M., & Crawford, J. R. (2001). Problems in using health survey questionnaires in older patients with physical disabilities. The reliability and validity of the SF-36 and the effect of cognitive impairment. Journal of Evaluation in Clinical Practice, 7, 411–418.

    Article  Google Scholar 

  • *Skevington, S. M., & Wright, A. (2001). Changes in the quality of life of patients receiving antidepressant medication in primary care: Validation of the WHOQOL-100. British Journal of Psychiatry, 178, 261–267.

    Article  Google Scholar 

  • *SooHoo, N. F., McDonald, A. P., Seiler, I. J. G., & McGillivary, G. R. (2002). Evaluation of the construct validity of the DASH questionnaire by correlation to the SF-36. Journal of Hand Surgery, 27, 537–541.

    Article  Google Scholar 

  • *Takeshita, K., Maruyama, T., Matsudaira, K., Murakami, M., Higashikawa, A., & Nakamura, K. (2006). Validity and reliability of SRSI and SF-36 in Japanese patients with scoliosis. Studies in Health Technology and Informatics, 123, 337–342.

    Google Scholar 

  • The WHOQoL Group. (1994). The development of the World Health Organization Quality of Life Assessment Instrument (the WHOQoL). In J. Orley & W. Kuyken (Eds.), Quality of life assessment: International perspectives. Heidelberg: Springer.

    Google Scholar 

  • *Trompenaars, F. J., Masthoff, E. D., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2005). Content validity, construct validity, and reliability of the WHOQOL-Bref in a population of Dutch adult psychiatric outpatients. Quality of Life Research, 14, 151–160.

    Article  Google Scholar 

  • *Tsutsumi, A., Izutsu, T., Kato, S., Islam, M. A., Yamada, H. S., Kato, H., & Wakai, S. (2006). Reliability and validity of the Bangla version of WHOQOL-BREF in an adult population in Dhaka, Bangladesh. Psychiatry and Clinical Neurosciences, 60, 493–498.

    Article  Google Scholar 

  • *Van Leeuwen, C. M. C., Van Der Woude, L. H. V., & Post, M. W. M. (2012). Validity of the mental health subscale of the SF-36 in persons with spinal cord injury. Spinal Cord, 50, 707–710.

    Article  Google Scholar 

  • Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). SF-36 health survey manual and interpretation guide. Boston: New England Medical Center, The Health Institute.

    Google Scholar 

  • Ware, J. E., Kosinski, M., & Keller, S. K. (1994). SF-36 physical and mental health summary scales: A user’s manual. Boston: The Health Institute.

    Google Scholar 

  • Ware, J. E., Keller, S. D., Gandek, B., Brazier, J. E., & Sullivan, M. (1995). Evaluating translations of health status questionnaires: Methods from the IQOLA project. International Journal of Technology Assessment in Health Care, 11, 525–551.

    Article  Google Scholar 

  • *Webster, J., Nicholas, C., Valacott, C., Cridland, N., & Fawcett, L. (2010). Validation of the WHOQOL-BREF among women following childbirth. The Australian & New Zealand Journal of Obstetrics & Gynaecology, 50, 132–137.

    Article  Google Scholar 

  • *Wyss, K., Wagner, A. K., Whiting, D., Mtasiwa, D. M., Tanner, M., Gandek, B., & Kilima, P. M. (1999). Validation of the Kiswahili version of the SF-36 Health Survey in a representative sample of an urban population in Tanzania. Quality of Life Research, 8, 111–120.

    Article  Google Scholar 

  • *Yao, G., Wu, C.-h., & Yang, C.-t. (2008). Examining the content validity of the WHOQOL-BREF from respondents’ perspective by quantitative methods. Social Indicators Research, 85, 483–498.

    Google Scholar 

  • Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Psychometrics (Handbook of statistics, Vol. 26, pp. 45–79). Amsterdam/Boston: Elsevier Science B.V.

    Chapter  Google Scholar 

  • Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte: Information Age Publishing.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eric K. H. Chan Ph.D. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Chan, E.K.H., Zumbo, B.D., Zhang, W., Chen, M.Y., Darmawanti, I., Mulyana, O.P. (2014). Medical Outcomes Study Short Form-36 (SF-36) and the World Health Organization Quality of Life (WHOQoL) Assessment: Reporting of Psychometric Validity Evidence. In: Zumbo, B., Chan, E. (eds) Validity and Validation in Social, Behavioral, and Health Sciences. Social Indicators Research Series, vol 54. Springer, Cham. https://doi.org/10.1007/978-3-319-07794-9_14

Download citation

Publish with us

Policies and ethics