Abstract
This paper proposes a robust approach to recognize hand gesture which involves face parts like chin, cheeks, eyes and head in the context of sign language recognition and also attacks the problem of interference between face and hand. ICondensation algorithm is used to track the face, skin color segmentation is applied on face to eliminate eyes, and simple four quadrant multi clue information of face is obtained. Simultaneously two hands are tracked by another ICondensation module and BRIEF feature descriptors are extracted from hand. The multi clue information from four quadrants of face is identified whenever intersection of two tracking modules occurs. This intersection information provides which part of the face is being referred by the hand. Along with BRIEF feature descriptor, face position is used as feature for the gesture recognition. SVM multi-class classifier is used for continuous hand gestures classification. Experimentation is carried out with Indian Sign Language and found that the proposed approach outperforms the other existing methods with the recognition rate of 93.21%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Murthy, G.R.S., Jadon, R.S.: A Review of vision based hand gestures recognition. International Journal of Information Technology and Knowledge Management 2, 405–410 (2009)
Utsumi, A., Ohya, J.: Multiple-Hand-Gesture Tracking using Multiple Cameras. In: IEEE International Conference on Computer Vision and Pattern Recognition, June 23-25, vol. 1, p. 478 (1999)
Yuan, Q., Sclarof, S., Athitsos, V.: Automatic 2D Hand Tracking in Video Sequences. In: 7th IEEE Workshops on Application of Computer Vision, WACV, January 5-7, vol. 1, pp. 250–256 (2005)
Kato, M., Chen, Y.W., Xu, G.: Articulated Hand Tracking by PCA-ICA Approach. In: 7th IEEE International Conference on Automatic Face and Gesture Recognition AFGR, April 2-6, pp. 329–334 (2006)
Awad, G., Han, J., Sutherland, A.: A Unified system for Segmentation and Tracking of Face and Hands in Sign Language Recognition. In: 18th IEEE International Conference on Pattern Recognition ICPR, vol. 1, pp. 239–242 (2006)
Bao, P., Binh, N.T., Khoa, T.D.: A New Approach to Hand Tracking and Gesture Recognition by a New Feature Type and HMM. In: 6th International Conference on Fuzzy Systems and Knowledge Discovery (2009)
Pan, Z., Li, Y., Zhang, M., Sun, C., Guo, K., Tang, X., Zhou, S.Z.: A Real Time Multicue Hand Tracking Algorithm Based on Computer Vision. In: IEEE International Conference on Virtual Reality VR, March 20-24, pp. 219–222 (2010)
Oh, C., Islam, Z., Lee, C.: Articulated Hand Tracking using key poses driven Particle Filtering. In: 2nd IEEE International Conference on Computer Engineering and Technology ICCET, April 16-18, vol. 7, pp. 535–538 (2010)
Asaari, M., Suandi, S.Z.: Hand Gesture Tracking System using Adaptive Kalman filter. In: 10th IEEE International Conference on Intelligent Systems Design and Applications ISDA, pp. 166–171 (2010)
Krnoul, Z., Hruz, M., Campr, P.: Correlation Analysis of Facial features and Sign Gestures. In: 10th IEEE International Conference on Signal Processing ICSP, pp. 732–735 (2010)
Cameron, C.R., DiValentin, L.W., Manaltala, R., McElhaney, A.C., Nostrand, C.H., Quinlan, O.J., Sharpe, L.N., Slagle, A.C., Wood, C.D., Zheng, Y.Y., Gerling, G.J.: Hand Tracking and Visualization in a Virtual Reality Simulation. In: IEEE Symposium on Systems and Information Engineering Design SIEDS, pp. 127–132 (2011)
Nandy, A., Mondal, S., Prasad, J.S., Chakraborty, P., Nandi, G.C.: Recognizing & interpreting Indian Sign Language gesture for Human Robot Interaction. In: IEEE International Conference on Computer and Communication Technology (ICCCT), pp. 712–717 (2010)
Rajam, P.S., Balakrishnan, G.: Indian sign language recognition system to aid deaf-dumb people. In: IEEE International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 1–9 (2010)
Anuja, K., Suryapriya, S., Idicula, S.M.: Design And Development Of A Frame Based Mt System For English-To-Isl. In: IEEE World Congress On Nature & Biologically Inspired Computing Nabic, Cochin, India, pp. 1382–1387 (2009)
Lekhashri, B., Pratap, A.A.: Use of motion-print in sign language recognition. In: IEEE National Conference on Innovations in Emerging Technology (NCOIET), Trichy, India, pp. 99–102 (2011)
Futane, R.P., Dharaskar, R.V.: Hasta Mudra: An interpretation of Indian sign hand gestures. In: 3rd International Conference on Electronics Computer Technology (ICECT), Kanyakumari, India, vol. 2, pp. 377–380 (2011)
Isard, M., Blake, A.: Condensation: Conditional Density Propagation for Visual Tracking. International Journal of Computer Vision 29(1), 5–28 (1998)
Isard, M., Blake, A.: ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 893–908. Springer, Heidelberg (1998)
Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: Binary Robust Independent Elementary Features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010)
Boswell, D.: Introduction to Support Vector Machines, http://www.work.caltech.edu/boswell/IntroToSVM.pdf
Noida Deaf Society, http://www.noidadeafsociety.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rekha, J., Bhattacharya, J., Majumder, S. (2012). Improved Hand Tracking and Isolation from Face by ICondensation Multi Clue Algorithm for Continuous Indian Sign Language Recognition. In: Thilagam, P.S., Pais, A.R., Chandrasekaran, K., Balakrishnan, N. (eds) Advanced Computing, Networking and Security. ADCONS 2011. Lecture Notes in Computer Science, vol 7135. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29280-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-29280-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29279-8
Online ISBN: 978-3-642-29280-4
eBook Packages: Computer ScienceComputer Science (R0)