Abstract
Hand gesture recognition is an important aspect in Human-Computer interaction, and can be used in various applications, such as virtual reality and computer games. In this paper, we propose a real time hand gesture recognition system. It includes three major procedures: detection, tracking and recognition. In hand detection stage, an open hand is detected by the histograms of oriented gradient and AdaBoost method. The hand detector is trained by the AdaBoost algorithm with HOG features. A contour based tracker is applied in combining condensation and partitioned sampling. After a hand is detected in the image, the tracker can track the hand contour in real time. During the tracking, the trajectory is saved to perform hand gesture recognition in the last stage. Recognition of the hand moving trajectory is implemented by hidden Markov models. Several HMMs are trained in advance, and the results from the tracking stage are then recognized using the trained HMMs. Experiments have been conducted to validate the performance of the proposed system. Under normal webcam it can recognize the predefined gestures quickly and precisely. As it is easy to develop other hand gestures, the proposed system has good potential in many applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jones, M.J., Rehg, J.M.: Statistical Color Models with Application to Skin Detection. Int. Journal of Computer Vision 46(1), 81–96 (2002)
Cootes, T.F., Taylor, C.J.: Active Shape Models: Smart Snakes. In: Proceedings of the British Machine Vision Conference, pp. 9–18. Springer, Heidelberg (1992)
Jones, M., Viola, P.: Fast Multi-view Face Detection. Technical Report TR2003-96, MERL (2003)
Kolsch, M., Turk, M.: Robust Hand Detection. In: Proc. IEEE Intl. Conference on Automatic Face and Geature Recognition (2004)
Fukunaga, K.: Introduction to Statistical Pattern Recognition. Academic Press, Boston (1990)
Liu, N., Lovell, B., Kootsookos, P.: Evaluation of hmm training algorithms for letter hand gesture recognition. In: IEEE International Symposium on Signal Processing and Information Technology (2003)
Welch, G., Bishop, G.: An introduction to the Kalmal Filter. In: SIGGRAPH 2001, Course 8 (2001)
Isard, M., Blake, A.: CONDENSATION-Conditional density propagation for visual tracking. International Journal of Computer Vision 29(1), 5–28 (1998)
Shan, C., Wei, Y., Tan, T., Ojardias, F.: Real Time Hand Tracking by Combining Particle Filtering and Mean Shift. In: Automatic Face and Gesture Recognition, pp. 669–674 (2004)
Baltzakis, H., Argyros, A., Lourakis, M., Trahanias, P.: Tracking of Human Hands and Faces through Probabilistic Fusion of Multiple Visual Cues. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 33–42. Springer, Heidelberg (2008)
Yuan, M., Farbiz, F., Manders, C.M., Tang, K.Y.: Robust hand tracking using a simple color classification technique. In: VRCAI 2008, Singapore, December 8-9 (2008)
Corradini, A.: Dynamic Time Warping for Off-Line Recognition of a Small Gesture Vocabulary. In: Proceedings of the IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems RATFG-RTS 2001, p. 82 (2001)
Keskin, C., Akarun, L.: Sign tracking and recognition system using input-output HMMs. Pattern Recognition Letters 30(12), 1086–1095 (2009)
Huang, D.-Y., Hu, W.-C., Chang, S.-H.: Vision-Based Hand Gesture Recognition Using PCA+Gabor Filters and SVM. In: 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 1–4 (2009)
Dalai, N., Triggs, B., Rhone-Alps, I., Montbonnot, F.: Histograms of Oriented Gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, vol. 1 (2005)
Lee, H., Kim, J.: An HMM-based threshold model approach for gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(10), 961–973 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shi, L., Wang, Y., Li, J. (2010). A Real Time Vision-Based Hand Gestures Recognition System. In: Cai, Z., Hu, C., Kang, Z., Liu, Y. (eds) Advances in Computation and Intelligence. ISICA 2010. Lecture Notes in Computer Science, vol 6382. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16493-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-16493-4_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16492-7
Online ISBN: 978-3-642-16493-4
eBook Packages: Computer ScienceComputer Science (R0)