Engagement in a Virtual Reality Game with Gesture Hand Interface. An Empirical Evaluation of User Engagement Scale (UES)

  • Irma C. Landa-AvilaEmail author
  • Maria-Luisa CruzEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10289)


The combination of virtual environments and gesture control interface has increased in the past years. It is believed that these technologies could increase user engagement and the user experience. However, there is still no standard scale to measure user engagement in those systems. The User Engagement Scale UES, proposed by O’Brien is a multidimensional scale for engagement measurement. It had been tested in different conditions and systems, such as web pages and social networks, keeping consistency in its result. We apply the UES to a virtual reality game with gesture hand control, to evaluate its viability in this kind of system. A sample of 164 individuals, who attended a huge technology trend and information event, completed a questionnaire after playing the game. The game includes puzzle solving using hand gesture interface. The questionnaire was adapted from the original proposed by O’Brien, to fit the videogame application. The UES scale is composed of six aspects or subscales: Perceived Usability (PU), Aesthetics (AE), Novelty (NO), Felt Involvement (FI), Focused Attention (FA), and Endurability (EN). The analysis results indicated that the scale had good reliability for all the aspects or sub-scales included. As a result of applying the principal component analysis, we found that the FA and AE components retained all its items. Meanwhile, the PU sub-scale is divided into three different components, and the NO, FI and EN subscales are combined in a new component. We establish a discussion of the characteristics and usability of virtual reality systems and gesture hand control that could cause these variations in the UES components. Also, we discuss the context as a potential key factor to influence engagement and user experience.


User engagement User Engagement Scale Virtual Reality User Experience 



The authors want to thank the developers of the Fixer virtual reality game, Arturo Jafet Rodríguez M.Sc., and Enrique Alberto Rosales M.Sc., from UP-Medialab, for providing access to the game. Also, we thank Allen Galaviz Gerardo for the help of database capturing.


  1. 1.
    Bachmann, D., Weichert, F., Rinkenauer, G.: Evaluation of the leap motion controller as a new contact-free pointing device. Sensors (Basel, Switzerland) 15(1), 214–233 (2015). doi: 10.3390/s150100214 CrossRefGoogle Scholar
  2. 2.
    Banhawi, F., Ali, N.M.: Measuring user engagement attributes in a social networking application. In: 2011 International Conference on Semantic Technology and Information Retrieval, STAIR 2011, pp. 297–301 (2011). doi: 10.1109/STAIR.2011.5995805
  3. 3.
    Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD - plucking at thin air? Procedia Technol. 20(1), 149–154 (2015)CrossRefGoogle Scholar
  4. 4.
    Bodker, S.: Second wave hci meets third wave challenges. In: NordCHI 2006 Extended Abstracts on Human Factors in Computing Systems, NrodiCHI 2006, pp. 1– 8. ACM (2006). doi: 10.1145/1182475.1182476.1
  5. 5.
    Boyle, E.A., Connolly, T.M., Hainey, T., Boyle, J.M.: Engagement in digital entertainment games: a systematic review. Comput. Hum. Behav. 28(1), 771–780 (2012)CrossRefGoogle Scholar
  6. 6.
    Boyle, E., Connolly, T.M., Hainey, T.: The role of psychology in understanding the impact of computer games. Entertain. Comput. 2(2), 69–74 (2011). doi: 10.1016/j.entcom.2010.12.002 CrossRefGoogle Scholar
  7. 7.
    Ebert, L.C., Flach, P.M., Thali, M.J., Ross, S.: Out of touch – a plugin for controlling OsiriX with gestures using the leap controller. J. Forensic Radiol. Imaging 2, 126–128 (2014)CrossRefGoogle Scholar
  8. 8.
    DeVellis, R.: Scale Development, Theory and Applications, p. 121. Sage Publications, Chapel Hill (1991)Google Scholar
  9. 9.
    Kelly, D., Harper, D.J., Landau, B.: Questionnaire mode effects in interactive information retrieval experiments. Inf. Process. Manage. 44(1), 122–141 (2008)CrossRefGoogle Scholar
  10. 10.
    Lalmas, M., O’Brien, H., Yom-Tov, E.: Measuring User Engagement. Morgan & Claypool Publishers, San Rafael (2015)Google Scholar
  11. 11.
    Levesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, D.J., Colgate, J.E., Peshkin, M.: Frictional widgets: Enhancing touch interfaces with programmable friction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing, pp. 1153–1158 (2011)Google Scholar
  12. 12.
    O’Brien, H.L.: The influence of hedonic and utilitarian motivations on user engagement: the case of online shopping experiences. Interact. Comput. 22(1), 344–352 (2010)CrossRefGoogle Scholar
  13. 13.
    O’Brien, H.L., Cairns, P.: An empirical evaluation of the User Engagement Scale (UES) in online news environments. Inf. Process. Manage. 51(1), 413–427 (2015)CrossRefGoogle Scholar
  14. 14.
    O’Brien, H.L., Lebow, M.: Mixed-methods approach to measuring user experience in online news interactions. J. Am. Soc. Inform. Sci. Technol. 64(8), 1543–1556 (2013). doi: 10.1002/asi.22871.20,84 CrossRefGoogle Scholar
  15. 15.
    O’Brien, H.L., Toms, E.G.: What is user engagement? A conceptual framework for defining user engagement with techonology. J. Am. Soc. Inform. Sci. Technol. 59(6), 938–955 (2008)CrossRefGoogle Scholar
  16. 16.
    O’Brien, H.L., Toms, E.G.: The development and evaluation of a survey to measure user engagement. J. Am. Soc. Inform. Sci. Technol. 61(1), 50–69 (2010)CrossRefGoogle Scholar
  17. 17.
    O’Brien, H.L., Toms, E.G.: Measuring interactive information retrieval: the case of user engagement scale. In: Proceedings of the 2010 Conference of Information Interaction in Context, pp. 335–340 (2010b)Google Scholar
  18. 18.
    O’Brien, H.L., Toms, E.G.: Examining the generalizability of the User Engagement Scale (UES) in exploratory search. Inf. Process. Manage. 49(1), 1092–1107 (2013)CrossRefGoogle Scholar
  19. 19.
    UP-Media Lab: FIXER (Version 1.0), Zapopan, Jalisco, Mexico (2016)Google Scholar
  20. 20.
    Riftinfo: Oculus Rift Specs DK1 vs DK2 comparison (2016). Accessed 8 Feb 2017
  21. 21.
    Sweetser, P., Wyeth, P.: GameFlow: a model for evaluationg player enjoyment games. Comput. Entertain. 3(3), 1–24 (2005)CrossRefGoogle Scholar
  22. 22.
    Wiebe, E.N., Lamb, A., Hardy, M., Sharek, D.: Measuring engagement in video game-based environments: investigation of the user engagement scale. Comput. Hum. Behav. 32(1), 123–132 (2015)Google Scholar
  23. 23.
    Yannakis, G.N., Hallam, J.: Towards optimizing entertainment in computer games. Appl. Artif. Intell. 21, 933–971 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Facultad de IngenieríaUniversidad Panamericana campus GuadalajaraZapopanMexico

Personalised recommendations