Abstract
The existing Kinect somatosensory games and other human–computer interaction are lack of natural interaction experience. We made research on a natural immersive closed-loop interaction method for human–robot “rock–paper–scissors” game. Kinect was used to make somatosensory dynamic recognition. Mechanical arm was used to make gestures to interact with human and to show the result of the game. System through the development of Modbus master and Modbus slave based on Arduino to control the mechanical arm, and used the multithread concurrent to achieve a better real-time experience. The PC was programmed to determine the outcome and record the result. The natural immersive closed-loop interaction method has the advantages of natural interaction, fast response, and strong expansibility.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Papadopoulos, G.T., Axenopoulos, A., Daras, P.: Real-time skeleton-tracking-based human action recognition using kinect data. In: International Conference on Multimedia Modeling, pp. 473–483 (2014)
Huber, M.E., Seitz, A.L., Leeser, M., Sternad, D.: Validity and reliability of Kinect skeleton for measuring shoulder joint angles: a feasibility study. Physiotherapy 101, 389–393 (2015)
Ren, Z., Yuan, J., Meng, J., Zhang, Z.: Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimedia 15(5), 1110–1120 (2013)
Qian, K., Yang, H., Niu, J.: Developing a gesture based remote human-robot interaction system using kinect. Int. J. Smart Home 7(4), 203–208 (2013)
Chou, C.H., Tsai, C.Y., Fang, S.J., Hsiao, Y.C., Chen, H.L.: A home rehabilitation system combined with somatosensory games for stroke patients. ICIC Express Lett., 73(B), 1005–1010 (2013)
Pan, M.-S., Hsu, W.-C., Liu, C.-H., Huang, K.-C., Cheng, C.-F.: InstantGaming: playing somatosensory games using smartwatches and portable devices. In: IEEE International Conference on Applied System Innovation, pp. 1072–1074 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yuan, X., Dai, S., Fang, Y. (2020). A Natural Immersive Closed-Loop Interaction Method for Human–Robot “Rock–Paper–Scissors” Game. In: Jain, V., Patnaik, S., Popențiu Vlădicescu, F., Sethi, I. (eds) Recent Trends in Intelligent Computing, Communication and Devices. Advances in Intelligent Systems and Computing, vol 1006. Springer, Singapore. https://doi.org/10.1007/978-981-13-9406-5_14
Download citation
DOI: https://doi.org/10.1007/978-981-13-9406-5_14
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9405-8
Online ISBN: 978-981-13-9406-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)