Abstract
This paper proposes a vision-based human-robot interaction system for mobile robot platform. A mobile robot first finds an interested person who wants to interact with it. Once it finds a subject, the robot stops in the front of him or her and finally interprets her or his upper body gestures. We represent each gesture as a sequence of body poses and the robot recognizes four upper body gestures: “Idle”, “I love you”, “Hello left”, and “Hello right”. A key posebased particle filter determines the pose sequence and key poses are sparsely collected from the pose space. Pictorial Structure-based upper body model represents key poses and these key poses are used to build an efficient proposal distribution for the particle filtering. Thus, the particles are drawn from key pose-based proposal distribution for the effective prediction of upper body pose. The Viterbi algorithm estimates the gesture probabilities with a hidden Markov model. The experimental results show the robustness of our upper body tracking and gesture recognition system.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Thurau, C., Halavac, V.: Pose Primitive based Human Action Recognition in Videos or Still Images. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2008)
Felzenszwalb, P., Huttenlocher, D.: Pictorial Structures for Object Recognition. International Journal of Computer Vision 61(1), 55–79 (2005)
Oh, C.M., Islam, M.Z., Lee, C.W.: A Gesture Recognition Interface with Upper Body Model-based Pose Tracking. In: International Conference on Computer Engineering and Technology, vol. 7, pp. 531–534 (2010)
Andriluka, M., Roth, S., Schilele, B.: Pictorial Structures Revisited:People Detection and Articulated Pose Estimation. In: International Conference on Computer Vision and Pattern Recognition, pp. 1014–1021 (2009)
Barker, A.L., Brown, D.E., Martin, W.N.: Bayesian Estimation and the Kalman Filter. Computer & Mathematics with Applications 30(10), 55–77 (1995)
Weng, S.K., Kuo, C.M., Tu, S.K.: Video Object Tracking using Adaptive Kalman Filter. Journal of Visual Communication and Image Representation 17(6), 1190–1208 (2006)
Merwe, R.A., Freitas, N.D., Wan, E.: The Unscented Particle Filter. In: Advances in Neural Information Processing Systems, vol. 13 (2001)
Islam, M.Z., Oh, C.M., Lee, C.W.: Real Time Moving Object Tracking by Particle Filter. In: International Symposium on Computer Science and Its Application, pp. 347–352 (2008)
Oh, C.M., Islam, M.Z., Lee, C.W.: Pictorial Structures-based Upper Body Tracking and Gesture Recognition. In: Korea-Japan Joint Workshop on Frontiers of Computer Vision (2011)
RedOne Technology (February 2011), http://urc.kr/
MS Kinect (February 2011), http://www.xbox.com/en-US/kinect
Dollar, P., Wojek, C., Schiele, B., Perona, P.: Pedestrian Detection: A Benchmark. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2009)
Oh, C.M., Setiawan, N.A., Aurahman, D., Lee, C.W., Yoon, S.: Detection of Moving Objects by Optical Flow Matching in Mobile Robots using an Omnidirectional Camera. In: The 4th International Conference on ubiquitous Robots and Ambient Intelligence (2007)
Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric Correspondence and Chamfer Matching: Two New Technique for Image Matching. In: The 5th International Joint Conference on Artificial Intelligence, pp. 1175–1177 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oh, CM., Islam, M.Z., Lee, JS., Lee, CW., Kweon, IS. (2011). Upper Body Gesture Recognition for Human-Robot Interaction. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Techniques and Environments. HCI 2011. Lecture Notes in Computer Science, vol 6762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21605-3_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-21605-3_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21604-6
Online ISBN: 978-3-642-21605-3
eBook Packages: Computer ScienceComputer Science (R0)