Abstract
The objective of the research presented in this chapter is to enable communication between people with hearing impairment and those with visual impairment. Computer recognition of sign language snapshots is one of the most challenging research problems in this area. This chapter presents an efficient and fast algorithm for identification of the number of fingers opened in a gesture representing an alphabet of the American Sign Language. Finger detection is accomplished based on the concept of boundary tracing and finger tip detection. A significant feature of the solution is that it does not require the hand to be perfectly aligned to the camera or use any special markers or input gloves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Canny, J. (Nov 1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8, 679–714.
Shimada, N. et al. (1998). Hand gesture estimation and model refinement using monocular camera – Ambiguity limitation by inequality constraints. In Proceedings of the 3rd Conference on Face and Gesture Recognition, pp. 268–273.
Sonka, M., Hlavac, V., & Boyle, R. (1999). Image processing, analysis, and machine vision. Pacific Grove, CA: Brooks/Cole Publishing Company.
Starner, T., & Pentland, A. (21–23 Nov 1995) Real-time American sign language recognition from video using hidden Markov models. In Proceedings of International Symposium on Computer Vision, pp. 265–270.
Lee, J., & Kunii, T. (Sept 1995) Model-based analysis of hand posture. IEEE Computer Graphics Applications, 15(5), 77–86.
Fillbrandt, H., Akyol, S., & Kraiss, K.F. (Oct 2003). Extraction of 3D hand shape and posture from image sequences for sign language recognition. IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 17, 181–186.
Starner, T., Pentland, A., & Weaver, J. (Dec 1998) Real-time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12), 1371–1375.
Imagawa, K., Lu, S., & Igi, S. (14–16 Apr 1998) Color-based hands tracking system for sign language recognition. In Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 462–467.
Teh, C.H., & Chin, R.T. (Jul 1988) On image analysis by the methods of moments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4), 496–513.
Kang, S.K., Nam, M.Y., & Rhee, P.K. (Aug 2008) Color based hand and finger detection technology for user interaction. International Conference on Convergence and Hybrid Information Technology.
Shirai, Y., Tanibata, N., & Shimada, N. (2002). Extraction of hand features for recognition of sign language words. VI’2002, Computer-Controlled Mechanical Systems. Graduate School of Engineering, Osaka University.
Hamada, Y., Shimada, N., & Shirai, Y. (May 2004) Hand shape estimation under complex backgrounds for sign language recognition. In Proceedings of the 6th International Conference on Automatic Face and Gesture Recognition, pp. 589–594.
Ravikiran, J., Mahesh, K., Mahishi, S., Dheeraj, R., Sudheender, S., & Pujari, N.V. (2009). Finger detection for sign language recognition, ICCS2009. In Proceedings of the International Conference on Computer Science, International Multi-Conference of Engineers and Computer Scientists – IMECS 2009, March 2009, Hong Kong.
Acknowledgements
The authors would like to acknowledge the contribution of Bharadvaj J., Ganesh S., Ravindra K., Vinod D. towards the development of one part of the solution presented in this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science+Business Media B.V.
About this chapter
Cite this chapter
Ravikiran, J., Mahesh, K., Mahishi, S., Dheeraj, R., Sudheender, S., Pujari, N.V. (2009). Automatic Recognition of Sign Language Images. In: Huang, X., Ao, SI., Castillo, O. (eds) Intelligent Automation and Computer Engineering. Lecture Notes in Electrical Engineering, vol 52. Springer, Dordrecht. https://doi.org/10.1007/978-90-481-3517-2_25
Download citation
DOI: https://doi.org/10.1007/978-90-481-3517-2_25
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-3516-5
Online ISBN: 978-90-481-3517-2
eBook Packages: EngineeringEngineering (R0)