Abstract
We propose a novel approach on using static and dynamic gesture recognition in VR games to represent interactive objects in games, such as equipment system, weapons and handy-tools. We examine various applications of gesture recognition in games, learning, medicine and VR, including how developers currently use the bundles of HDM devices paired with hand tracking sensors. The proposed approach provides game developers with a control over recording gestures and binding them to in-game intractable objects and equipment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
VR – Leap Motion Gallery: Gallery.leapmotion.com (2017). https://gallery.leapmotion.com/category/vr/. Accessed 6 Apr 2017
VR Setup: Leap Motion Developer (2017). https://developer.leapmotion.com/vr-setup/. Accessed 11 Apr 2017
Unreal: Leap Motion Developer (2017). https://developer.leapmotion.com/unreal#103. Accessed 11 Apr 2017
Unity: Leap Motion Developer (2017). https://developer.leapmotion.com/unity. Accessed 11 Apr 2017
Chen, Y., Ding, Z., Chen, Y., Wu, X.: Rapid recognition of dynamic hand gestures using leap motion. In: 2015 IEEE International Conference on Information and Automation (2015). doi:10.1109/icinfa.2015.7279509
Cheng, H., Yang, L., Liu, Z.: Survey on 3D hand gesture recognition. IEEE Trans. Circ. Syst. Video Technol. 26, 1659–1673 (2016). doi:10.1109/tcsvt.2015.2469551
Cristianini, N., Shawe Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, Cambridge (2000)
Ling, H., Rui, L.: VR glasses and leap motion trends in education. In: 2016 11th International Conference on Computer Science and Education (ICCSE) (2016). doi:10.1109/iccse.2016.7581705
Lu, W., Tong, Z., Chu, J.: Dynamic hand gesture recognition with leap motion controller. IEEE Sig. Process. Lett. 23, 1188–1192 (2016). doi:10.1109/lsp.2016.2590470
Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with leap motion and kinect devices. In: 2014 IEEE International Conference on Image Processing (ICIP) (2014). doi:10.1109/icip.2014.7025313
Mentzelopoulos, M., Tarpini, F., Emanuele, A., Protopsaltis, A.: Hardware interfaces for VR applications: evaluation on prototypes. In: 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing (2015). doi:10.1109/cit/iucc/dasc/picom.2015.237
Naglot, D., Kulkarni, M.: Real time sign language recognition using the leap motion controller. In: 2016 International Conference on Inventive Computation Technologies (ICICT) (2016). doi:10.1109/inventive.2016.7830097
Rautaray, S., Agrawal, A.: Interaction with virtual game through hand gesture recognition. In: 2011 International Conference on Multimedia, Signal Processing and Communication Technologies (2011). doi:10.1109/mspct.2011.6150485
Sharma, J., Gupta, R., Pathak, V.: Numeral gesture recognition using leap motion sensor. In: 2015 International Conference on Computational Intelligence and Communication Networks (CICN) (2015). doi:10.1109/cicn.2015.86
Sonkusare, J., Chopade, N., Sor, R., Tade, S.: A review on hand gesture recognition system. In: 2015 International Conference on Computing Communication Control and Automation (2015). doi:10.1109/iccubea.2015.158
Spanogianopoulos, S., Sirlantzis, K., Mentzelopoulos, M., Protopsaltis, A.: Human computer interaction using gestures for mobile devices and serious games: a review. In: 2014 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL 2014) (2014). doi:10.1109/imctl.2014.7011154
Acknowledgement
This paper is partially supported by the project – Virtual Visualization System for Culture Communications (2015BAK04B05) funded under the theme – National Science and Technology Supporting Project, China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Savosin, D., Prakoonwit, S., Tian, F., Liang, J., Pan, Z. (2017). Representation of Intractable Objects and Action Sequences in VR Using Hand Gesture Recognition. In: Tian, F., Gatzidis, C., El Rhalibi, A., Tang, W., Charles, F. (eds) E-Learning and Games. Edutainment 2017. Lecture Notes in Computer Science(), vol 10345. Springer, Cham. https://doi.org/10.1007/978-3-319-65849-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-65849-0_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-65848-3
Online ISBN: 978-3-319-65849-0
eBook Packages: Computer ScienceComputer Science (R0)