Abstract
This paper presents a research work on gesture recognition and feedback to reduce the learning time of new gestures and to augment user performance in a game application. A Wiimote controlled space shooter game, GeStar Wars, has been developed. The player controls a spaceship through the buttons in the controller, while forearm gestures can be used to perform special actions. Gesture strokes are mapped in a 3x3 grid and are differentiated according to the path of the covered grid cells. In-game visual feedback displays to the user the current gesture path and which cells were covered after the gesture is performed. The novelty of this research resides in the correlated gesture recognition methodology and feedback which helps the user to learn and correct the gestures. The evaluation, conducted with 12 users, showed that the users performed significantly better if feedback was provided.
Chapter PDF
Similar content being viewed by others
References
Subrahmanyam, K., Greenfield, P.M.: Effect of video game practice on spatial skills in girls and boys. J. Appl. Dev. Psychol. 15, 13–32 (1994)
Kela, J., Korpipää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L., Marca, S.: Di: Accelerometer-based gesture control for a design environment. Pers. Ubiquitous Comput. 10, 285–299 (2005)
Kratz, S., Rohs, M.: A $3 gesture recognizer. In: Proceedings of the 15th International Conference on Intelligent User Interfaces, IUI 2010, p. 341. ACM Press, New York (2010)
Liu, J., Zhong, L., Wickramasuriya, J., Vasudevan, V.: uWave: Accelerometer-based personalized gesture recognition and its applications. Pervasive Mob. Comput. 5, 657–675 (2009)
Rehm, M., Bee, N., André, E.: Wave Like an Egyptian — Accelerometer Based Gesture Recognition for Culture Specific Interactions
Bau, O., Mackay, W.E.: OctoPocus: A Dynamic Guide for Learning Gesture-Based Command Sets. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST 2008, p. 37. ACM Press, New York (2008)
Bragdon, A., Uguray, A., Wigdor, D., Anagnostopoulos, S., Zeleznik, R., Feman, R.: Gesture play. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, p. 39. ACM Press, New York (2010)
Bragdon, A., Zeleznik, R., Williamson, B., Miller, T., LaViola, J.J.: GestureBar. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, p. 2269. ACM Press, New York (2009)
Li, P., Bouillon, M., Anquetil, E., Richard, G.: User and System Cross-Learning of Gesture Commands on Pen-Based Devices. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part II. LNCS, vol. 8118, pp. 337–355. Springer, Heidelberg (2013)
Freeman, D., Benko, H., Morris, M.R., Wigdor, D.: ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS 2009, p. 165. ACM Press, New York (2009)
Schlömer, T., Poppinga, B., Henze, N., Boll, S.: Gesture recognition with a Wii controller. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, TEI 2008, p. 11. ACM Press, New York (2008)
Wu, J., Pan, G., Zhang, D., Qi, G., Li, S.: Gesture Recognition with a 3-D Accelerometer, pp. 25–38 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Schwaller, M., Kühni, J., Angelini, L., Lalanne, D. (2014). Improving In-game Gesture Learning with Visual Feedback. In: Kurosu, M. (eds) Human-Computer Interaction. Applications and Services. HCI 2014. Lecture Notes in Computer Science, vol 8512. Springer, Cham. https://doi.org/10.1007/978-3-319-07227-2_61
Download citation
DOI: https://doi.org/10.1007/978-3-319-07227-2_61
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07226-5
Online ISBN: 978-3-319-07227-2
eBook Packages: Computer ScienceComputer Science (R0)