Abstract
Human-Robot Interaction (HRI) is one of the most important aspects of development in social service robots. Interacting with social robots via non-verbal cues allows for natural and efficient communication with humans. This paper presents on going work in developing service robots that provide assisted-care to the elderly. The major goal of this system is to recognize natural calling gestures from people in an interaction scenario where the robot continuously observes the behavior of a humans. In our approach, firstly, the robot moves amongst people. At that time, when the person calls the robot by a hand gesture, the robot detects the person who is calling the robot from among the crowd. While approaching to the potential caller, the robot observes whether the person is actual calling the robot or not. We tested the proposed system at a real elderly care center. Experiment results validate the practicality and effectiveness of the system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Breazeal, C., Takanishi, A., Kobayashi, T.: Social robots that interact with people. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-30301-5_59
Chen, W.: Gesture-based applications for elderly people. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8007, pp. 186–195. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39330-3_20
Cruz, L., Lucio, F., Velho, L.: Kinect and RGBD images: challenges and applications. In: XXV SIBGRAPI IEEE Conference and Graphics, Patterns and Image Tutorials (2012)
Di Paola, D., Milella, A., Cicirelli, G., Distante, A.: An autonomous mobile robotic system for surveillance of indoor environments. Int. J. Adv. Robot. Syst. 7(1), 8 (2010)
D’Orazio, T., Guaragnella, C.: A graph-based signature generation for people re-identification in a multi-camera surveillance system. In: International Conference on Computer Vision Theory and Applications (VISAPP), Rome, Italy, pp. 414–417, February 2012
D’Orazio, T., Cicirelli, G.: People re-identification and tracking from multiple cameras: a review. In: IEEE International Conference on Image Processing (ICIP 2012), Orlando, Florida, September 2012
Fasola, J., Mataric, M.J.: Using socially assistive human-robot interaction to motivate physical exercise for older adults. Proc. IEEE 100(8), 2512–2526 (2012)
Fujii, T., Lee, J.H., Okamoto, S.: Gesture recognition system for human-robot interaction and its application to robotic service task. In: Proceedings of the International Multi-Conference of Engineers and Computer Scientists (IMECS), Hong Kong, vol. 1, March 2014
Goodrich, M.A., Schultz, A.C.: Human-robot interaction: a survey. Found. Trends Hum.-Comput. Inter. 1(3), 203–275 (2007)
Gu, Y., Do, H., Ou, Y., Sheng, W.: Human gesture recognition through a kinect sensor. In: IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1379–1384 (2012)
Hachaj, T., Ogiela, M.R.: Rule-based approach to recognizing human body poses and gestures in real time. Multimedia Syst. 20, 81–99 (2013)
Itauma, I.I., Kivrak, H., Kose, H.: Gesture imitation using machine learning techniques. In: Proceedings of 20th IEEE Signal Processing and Communications Applications Conference, Mugla, Turkey, April 2012
Jacob, M.G., Wachs, J.P.: Context-based hand gesture recognition for the operating room. Pattern Recogn. Lett. 36, 196–203 (2014)
Lai, K., Konrad, J., Ishwar, P.: A gesture-driven computer interface using kinect. In: IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), pp. 185–188 (2012)
Miranda, L., Vieira, T., Martinez, D., Lewiner, T., Vieira, A.W., Campos, M.F.M.: Real-time gesture recognition from depth data through key poses learning and decision forests. In: 25th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 268–275 (2012)
Oh, J., Kim, T., Hong, H.: Using binary decision tree and multiclass SVM for human gesture recognition. In: International Conference on Information Science and Applications (ICISA), pp. 1–4 (2013)
Kun, Q., Jie, N., Hong, Y.: Developing a gesture based remote human-robot interaction system using kinect. Int. J. Smart Home 7(4), 203–208 (2013)
Sigalas, M., Baltzakis, H., Trahanias, P.: Gesture recognition based on arm tracking for human-robot interaction. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, October 2010
Miyauchi, D., Sakurai, A., Nakamurai, A., Kuno, Y.: Bidirectional eye contact for human-robot communication. IEICE Trans. Inf. Syst. E88-D(11), 2509–2516 (2005)
Yamazaki, K., et al.: Prior-to-request and request behaviors within elderly day care: implications for developing service robots for use in multiparty settings. In: Bannon, L.J., Wagner, I., Gutwin, C., Harper, R.H.R., Schmidt, K. (eds.) ECSCW 2007, pp. 61–78. Springer, London (2007). https://doi.org/10.1007/978-1-84800-031-5_4
Quan, W., Niwa, H., Ishikawa, N., Kobayashi, Y., Kuno, Y.: Assisted-care robot based on sociological interaction analysis. In: Proceedings of the ICIC 2009 (2009)
Phyo, A.S., Fukuda, H., Lam, A., Kobayashi, Y., Kuno, Y.: Natural calling gesture recognition in crowded environments. In: Huang, D.-S., Bevilacqua, V., Premaratne, P., Gupta, P. (eds.) ICIC 2018. LNCS, vol. 10954, pp. 8–14. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95930-6_2
Hidalgo, G., Cao, Z., Simon, T., Wei, S.-E., Joo, H., Sheik, Y.: Openpose. https://github.com/CMU-Perceptual-Computing-Lab/openpose
Acknowledgement
This work was supported by JSPS KAKENHI Grant Number JP26240038.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Phyo, A.S., Fukuda, H., Lam, A., Kobayashi, Y., Kuno, Y. (2019). A Human-Robot Interaction System Based on Calling Hand Gestures. In: Huang, DS., Huang, ZK., Hussain, A. (eds) Intelligent Computing Methodologies. ICIC 2019. Lecture Notes in Computer Science(), vol 11645. Springer, Cham. https://doi.org/10.1007/978-3-030-26766-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-26766-7_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-26765-0
Online ISBN: 978-3-030-26766-7
eBook Packages: Computer ScienceComputer Science (R0)