Advertisement

The Construct Validity of the Utrecht Work Engagement Scale: Multisample and Longitudinal Evidence

  • Piia Seppälä
  • Saija Mauno
  • Taru Feldt
  • Jari Hakanen
  • Ulla Kinnunen
  • Asko Tolvanen
  • Wilmar Schaufeli
Article

Abstract

This study investigated the factor structure and factorial group and time invariance of the 17-item and 9-item versions of the Utrecht Work Engagement Scale (UWES; Schaufeli et al. (2002b) Journal of Happiness Studies 3:71–92). Furthermore, the study explored the rank-order stability of work engagement. The data were drawn from five different studies (N = 9,404), including a three-year longitudinal study (n = 2,555), utilizing five divergent occupational samples. Confirmatory factor analysis supported the hypothesized correlated three-factor structure—vigor, dedication, absorption—of both UWES scales. However, while the structure of the UWES-17 did not remain the same across the samples and time, the structure of the UWES-9 remained relatively unchanged. Thus, the UWES-9 has good construct validity and use of the 9-item version can be recommended in future research. Moreover, as hypothesized, Structural Equation Modeling showed high rank-order stabilities for the work engagement factors (between 0.82 and 0.86). Accordingly, work engagement seems to be a highly stable indicator of occupational well-being.

Keywords

Work engagement Utrecht Work Engagement Scale Construct validity Factor structure Factorial group and time invariance Rank-order stability 

Notes

Acknowledgements

This study was supported by Yrjö Jahnsson foundation (Grant No.: 5459), Emil Aaltonen foundation, and The Finnish Work Environment Fund (Grant No.: 107200; Project No.: 104129, 105325, 105363).

References

  1. Bakker, A. B., Hakanen, J. J., Demerouti, E., & Xanthopoulou, D. (2007). Job resources boost work engagement, particularly when job demands are high. Journal of Educational Psychology, 99, 274–284. doi: 10.1037/0022-0663.99.2.274.CrossRefGoogle Scholar
  2. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606. doi: 10.1037/0033-2909.88.3.588.CrossRefGoogle Scholar
  3. Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley & Sons, Inc.Google Scholar
  4. Bollen, K. A., & Long, J. S. (1993). Introduction. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 1–9). Newbury Park, CA: Sage, cop.Google Scholar
  5. Boomsma, A. (2000). Reporting analyses of covariance structures. Structural Equation Modeling, 7, 461–483. doi: 10.1207/S15328007SEM0703_6.CrossRefGoogle Scholar
  6. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage, cop.Google Scholar
  7. Gray, E. K., & Watson, D. (2001). Emotion, mood, and temperament: Similarities, differences, and a synthesis. In R. L. Payne & C. L. Cooper (Eds.), Emotions at work: Theory, research and applications for management (pp. 21–43). Chichester: Wiley, cop.Google Scholar
  8. Hakanen, J. (2002). Työuupumuksesta työn imuun—positiivisen työhyvinvointikäsitteen arviointimenetelmän suomalaisen version validointi opetusalan organisaatiossa [From burnout to work engagement—validation of the Finnish version of an instrument for measuring work engagement (UWES) in an educational organization]. Työ ja ihminen, 16, 42–58.Google Scholar
  9. Hakanen, J. J., Bakker, A. B., & Demerouti, E. (2005). How dentists cope with their job demands and stay engaged: The moderating role of job resources. European Journal of Oral Sciences, 113, 479–487. doi: 10.1111/j.1600-0722.2005.00250.x.CrossRefGoogle Scholar
  10. Hakanen, J. J., Bakker, A. B., & Schaufeli, W. B. (2006). Burnout and work engagement among teachers. Journal of School Psychology, 43, 495–513. doi: 10.1016/j.jsp.2005.11.001.CrossRefGoogle Scholar
  11. Hallberg, U. E., & Schaufeli, W. B. (2006). “Same same” but different? Can work engagement be discriminated from job involvement and organizational commitment? European Psychologist, 11, 119–127. doi: 10.1027/1016-9040.11.2.119.CrossRefGoogle Scholar
  12. Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and application. Thousand Oaks, CA: Sage, cop.Google Scholar
  13. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRefGoogle Scholar
  14. Jöreskog, K. G. (2005). Structural equation modeling with ordinal variables using LISREL (2nd ed.). Retrieved February 28, 2008, from http://www.ssicentral.com/lisrel/techdocs/ordinal.pdf.
  15. Jöreskog, K., & Sörbom, D. (1996a). LISREL 8: User’s reference guide. Chicago: Scientific Software International, Inc.Google Scholar
  16. Jöreskog, K., & Sörbom, D. (1996b). PRELIS 2: User’s reference guide. Chicago: Scientific Software International, Inc.Google Scholar
  17. Kinnunen, U., Feldt, T., & Mäkikangas, A. (2008). Testing the effort-reward imbalance model among Finnish managers: The role of perceived organizational support. Journal of Occupational Health Psychology, 13, 114–127.CrossRefGoogle Scholar
  18. Langelaan, S., Bakker, A. B., Van Doornen, L. J. P., & Schaufeli, W. B. (2006). Burnout and work engagement: Do individual differences make a difference? Personality and Individual Differences, 40, 521–532. doi: 10.1016/j.paid.2005.07.009.CrossRefGoogle Scholar
  19. Laursen, B., & Hoff, E. (2006). Person-centered and variable-centered approaches to longitudinal data. Merrill-Palmer Quarterly, 52, 377–389. doi: 10.1353/mpq.2006.0029.CrossRefGoogle Scholar
  20. Llorens, S., Schaufeli, W., Bakker, A., & Salanova, M. (2007). Does a positive gain spiral of resources, efficacy beliefs and engagement exist? Computers in Human Behavior, 23, 825–841. doi: 10.1016/j.chb.2004.11.012.CrossRefGoogle Scholar
  21. Magnusson, D. (1998). The logic and implications of a person-oriented approach. In R. B. Cairns, L. R. Bergman, & J. Kagan (Eds.), Methods and models for studying the individual: Essays in honour of Marian Radke-Yarrow (pp. 33–64). Thousands Oaks, CA: Sage, cop.Google Scholar
  22. Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). MBI: Maslach Burnout InventoryManual (3rd Rev. ed.). Palo Alto, CA: Consulting Psychologists Press.Google Scholar
  23. Maslach, C., & Leiter, M. P. (1997). The truth about burnout: How organizations cause personal stress and what to do about it. San Francisco: Jossey-Bass, Inc.Google Scholar
  24. Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout. Annual Review of Psychology, 52, 397–422. doi: 10.1146/annurev.psych.52.1.397.CrossRefGoogle Scholar
  25. Mauno, S., Kinnunen, U., Mäkikangas, A., & Nätti, J. (2005). Psychological consequences of fixed-term employment and perceived job insecurity among health care staff. European Journal of Work and Organizational Psychology, 14, 209–237.Google Scholar
  26. Mauno, S., Kinnunen, U., & Ruokolainen, M. (2007). Job demands and resources as antecedents of work engagement: A longitudinal study. Journal of Vocational Behavior, 70, 149–171. doi: 10.1016/j.jvb.2006.09.002.CrossRefGoogle Scholar
  27. Meredith, W. (1964). Notes on factorial invariance. Psychometrika, 29, 177–185. doi: 10.1007/BF02289699.CrossRefGoogle Scholar
  28. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. doi: 10.1007/BF02294825.CrossRefGoogle Scholar
  29. Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. doi: 10.1007/BF02296192.CrossRefGoogle Scholar
  30. Schaufeli, W. B. (2007a). Literature list engagement. Retrieved February 28, 2008, from http://www.Schaufeli.com.
  31. Schaufeli, W. B. (2007b). Tests. Retrieved February, 28, 2008, from http://www.Schaufeli.com.
  32. Schaufeli, W., & Bakker, A. (2003). UWES Utrecht Work Engagement Scale. Preliminary Manual [Version 1, November 2003]. Utrecht University: Occupational Health Psychology Unit.Google Scholar
  33. Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006). The measurement of work engagement with a short questionnaire. A cross-national study. Educational and Psychological Measurement, 66, 701–716. doi: 10.1177/0013164405282471.CrossRefGoogle Scholar
  34. Schaufeli, W., & Enzmann, D. (1998). The burnout companion to study and practice: A critical analysis. London: Taylor & Francis, cop.Google Scholar
  35. Schaufeli, W. B., Martínez, I. M., Pinto, A. M., Salanova, M., & Bakker, A. B. (2002a). Burnout and engagement in university students: A cross-national study. Journal of Cross-Cultural Psychology, 33, 464–481. doi: 10.1177/0022022102033005003.CrossRefGoogle Scholar
  36. Schaufeli, W., & Salanova, M. (2007). Work engagement: An emerging psychological concept and its implications for organizations. In S. W. Gilliland, D. D. Steiner, & D. P. Skarlicki (Eds.), Research in social issues in management (Volume 5): Managing social and ethical issues in organizations (pp. 135–177). Greenwich, CT: Information Age Publishers.Google Scholar
  37. Schaufeli, W. B., Salanova, M., González-Romá, V., & Bakker, A. B. (2002b). The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. Journal of Happiness Studies, 3, 71–92. doi: 10.1023/A:1015630930326.CrossRefGoogle Scholar
  38. Seligman, M. E. P. (2002). Positive psychology, positive prevention, and positive therapy. In C. R. Snyder & S. J. Lopez (Eds.), Handbook of positive psychology (pp. 3–9). New York: Oxford University Press.Google Scholar
  39. Seligman, M. E. P. (2003). Positive psychology: Fundamental assumptions. The Psychologist, 16, 126–127.Google Scholar
  40. Seligman, M. E. P., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55, 5–14. doi: 10.1037/0003-066X.55.1.5.CrossRefGoogle Scholar
  41. Turner, N., Barling, J., & Zacharatos, A. (2002). Positive psychology at work. In C. R. Snyder & S. J. Lopez (Eds.), Handbook of positive psychology (pp. 715–728). New York: Oxford University Press.Google Scholar
  42. Warr, P. (1990). The measurement of well-being and other aspects of mental health. Journal of Occupational Psychology, 63, 193–210.Google Scholar
  43. Xanthopoulou, D., Bakker, A. B., Kantas, A., & Demerouti, E. (in press). The measurement of burnout and work engagement: A comparison of Greece and The Netherlands. New Review of Social Psychology.Google Scholar
  44. Yu, C.–Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Retrieved February 28, 2008, from http://www.statmodel.com/download/Yudissertation.

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Piia Seppälä
    • 1
  • Saija Mauno
    • 1
  • Taru Feldt
    • 1
  • Jari Hakanen
    • 2
  • Ulla Kinnunen
    • 3
  • Asko Tolvanen
    • 1
  • Wilmar Schaufeli
    • 4
  1. 1.Department of PsychologyUniversity of JyväskyläJyväskyläFinland
  2. 2.Department of PsychologyFinnish Institute of Occupational HealthHelsinkiFinland
  3. 3.Department of PsychologyUniversity of TampereTampereFinland
  4. 4.Department of PsychologyUtrecht UniversityUtrechtThe Netherlands

Personalised recommendations