Engagement in a Virtual Reality Game with Gesture Hand Interface. An Empirical Evaluation of User Engagement Scale (UES)
The combination of virtual environments and gesture control interface has increased in the past years. It is believed that these technologies could increase user engagement and the user experience. However, there is still no standard scale to measure user engagement in those systems. The User Engagement Scale UES, proposed by O’Brien is a multidimensional scale for engagement measurement. It had been tested in different conditions and systems, such as web pages and social networks, keeping consistency in its result. We apply the UES to a virtual reality game with gesture hand control, to evaluate its viability in this kind of system. A sample of 164 individuals, who attended a huge technology trend and information event, completed a questionnaire after playing the game. The game includes puzzle solving using hand gesture interface. The questionnaire was adapted from the original proposed by O’Brien, to fit the videogame application. The UES scale is composed of six aspects or subscales: Perceived Usability (PU), Aesthetics (AE), Novelty (NO), Felt Involvement (FI), Focused Attention (FA), and Endurability (EN). The analysis results indicated that the scale had good reliability for all the aspects or sub-scales included. As a result of applying the principal component analysis, we found that the FA and AE components retained all its items. Meanwhile, the PU sub-scale is divided into three different components, and the NO, FI and EN subscales are combined in a new component. We establish a discussion of the characteristics and usability of virtual reality systems and gesture hand control that could cause these variations in the UES components. Also, we discuss the context as a potential key factor to influence engagement and user experience.
KeywordsUser engagement User Engagement Scale Virtual Reality User Experience
The authors want to thank the developers of the Fixer virtual reality game, Arturo Jafet Rodríguez M.Sc., and Enrique Alberto Rosales M.Sc., from UP-Medialab, for providing access to the game. Also, we thank Allen Galaviz Gerardo for the help of database capturing.
- 2.Banhawi, F., Ali, N.M.: Measuring user engagement attributes in a social networking application. In: 2011 International Conference on Semantic Technology and Information Retrieval, STAIR 2011, pp. 297–301 (2011). doi: 10.1109/STAIR.2011.5995805
- 4.Bodker, S.: Second wave hci meets third wave challenges. In: NordCHI 2006 Extended Abstracts on Human Factors in Computing Systems, NrodiCHI 2006, pp. 1– 8. ACM (2006). doi: 10.1145/1182475.1182476.1
- 8.DeVellis, R.: Scale Development, Theory and Applications, p. 121. Sage Publications, Chapel Hill (1991)Google Scholar
- 10.Lalmas, M., O’Brien, H., Yom-Tov, E.: Measuring User Engagement. Morgan & Claypool Publishers, San Rafael (2015)Google Scholar
- 11.Levesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, D.J., Colgate, J.E., Peshkin, M.: Frictional widgets: Enhancing touch interfaces with programmable friction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing, pp. 1153–1158 (2011)Google Scholar
- 17.O’Brien, H.L., Toms, E.G.: Measuring interactive information retrieval: the case of user engagement scale. In: Proceedings of the 2010 Conference of Information Interaction in Context, pp. 335–340 (2010b)Google Scholar
- 19.UP-Media Lab: FIXER (Version 1.0), Zapopan, Jalisco, Mexico (2016)Google Scholar
- 20.Riftinfo: Oculus Rift Specs DK1 vs DK2 comparison (2016). http://riftinfo.com/oculus-rift-specs-dk1-vs-dk2-comparison. Accessed 8 Feb 2017
- 22.Wiebe, E.N., Lamb, A., Hardy, M., Sharek, D.: Measuring engagement in video game-based environments: investigation of the user engagement scale. Comput. Hum. Behav. 32(1), 123–132 (2015)Google Scholar