Abstract
In this paper, we present part of a human-robot interaction system that recognizes meaningful gestures composed of continuous hand motions in real time based on hidden Markov models. This system acting as an interface is used for humans making various kinds of hand gestures to issue specific commands for conducting robots. To accomplish this, we define four basic types of directive gestures made by a single hand, which are moving upward, downward, leftward, and rightward individually. They serve as fundamental conducting gestures. Thus, if another hand is incorporated to making gestures, there are at most twenty-four kinds of compound gestures by the combination of the directive gestures using both hands. At present, we prescribe eight kinds of compound gestures employed in our developed human-robot interaction system, each of which is assigned a motion or functional control command, including moving forward, moving backward, turning left, turning right, stop, robot following, robot waiting, and ready, so that users can easily operate an autonomous robot. Experimental results reveal that our system can achieve an average gesture recognition rate of 96% at least. It is very satisfactory and encouraged.
Chapter PDF
Similar content being viewed by others
Keywords
References
Soontranon, N., Aramith, S., Chalidabhongse, T.H.: Improved face and hand tracking for sign language recognition. In: Proc. of the Int. Conf. on Information Technology: Coding and Computing, Bangkok, Thailand, vol. 2, pp. 141–146 (2005)
Zhu, X., Yang, J., Waibel, A.: Segmenting hands of arbitrary color. In: Proc. of the IEEE Int. Conf. on Automatic Face & Gesture Recognition, Pittsburgh, Pennsylvania, pp. 446–453 (2000)
Mitra, S., Acharya, T.: Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics—Part C: Applications and Reviews 37(3), 311–324 (2007)
Kim, K.K., Kwak, K.C., Chi, S.Y.: Gesture analysis for human-robot interaction. In: Proc. of the Int. Congress on Anti Cancer Treatment, Phoenix, Arizona, pp. 20–22 (2006)
Fahn, C.S., Chu, K.Y.: Real-time hand detection and tracking techniques for human-robot interaction. In: Proc. of the IADIS Interfaces & Human Computer Interaction Conference, Freiburg, Germany, pp. 179–186 (2010)
Liu, N., Lovell, B.C., Kootsookos, P.J., Davis, R.I.A.: Model structure selection and training algorithm for an HMM gesture recognition system. In: Proc. of the Int. Workshop in Frontiers of Handwriting Recognition, Brisbane, Australia, pp. 100–106 (2004)
Yoon, H., Soh, J., Bae, Y.J., Yang, H.S.: Hand gesture recognition using combined features of location, angle and velocity. Pattern Recognition 34(70), 1491–1501 (2001)
Korgh, A., Brown, M., Mian, I.S., Sjolander, K., Haussler, D.: Hidden Markov models in computational biology: Applications to protein modeling. Journal of Molecular Biology 235(5), 1501–1531 (1994)
Mohamed, M.A., Gader, P.D.: Handwritten word recognition using segmentation-free hidden Markov modeling and segmentation-based dynamic programming techniques. IEEE Transactions on Pattern Analysis & Machine Intelligence 18(5), 548–554 (1996)
Lawrence, R.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. of the IEEE 77(2), 257–286 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fahn, CS., Chu, KY. (2011). Hidden-Markov-Model-Based Hand Gesture Recognition Techniques Used for a Human-Robot Interaction System. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Techniques and Environments. HCI 2011. Lecture Notes in Computer Science, vol 6762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21605-3_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-21605-3_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21604-6
Online ISBN: 978-3-642-21605-3
eBook Packages: Computer ScienceComputer Science (R0)