Abstract
The use of computer vision along with machine learning techniques resulted in a breakthrough in medical and social fields. One such intervention is the sign language detection, enabling communication for differently-abled people. Hand gestures are the common method used for this. This paper deals with using image processing techniques like RGB to binary image conversion, skin detection, edge detection to extract the important features of the gesture and provide them as inputs to Convolution Neural Networks (CNN) to improve the accuracy in predicting American Sign Language alphabets (ASL). Using the preprocessed image data set of the hand gesture in our proposed mechanism has predicted the alphabets with higher accuracy up to 99% as compared to the model trained with original data set of images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
https://society6.com/product/asl-american-sign-language1722170_poster
Neethu PS, Suguna R, Divya Sathish (2018) Real time hand gesture recognition system. TAGA J 14:782–792
Strezoski G, Stojanovski D, Dimitrovski I, Madjarov G (2016) Hand gesture recognition using deep convolutional neural networks. In: ICT innovations (2016)
Kour KP, Lini Mathew (2018) Sign language recognition using image processing. Int J Adv Res Comput Sci Softw Eng 7(8)
Hussain S, Saxena R, Han X, Khan JA, Shin H (2017) Hand gesture recognition using deep learning. In: International SoC design conference (ISOCC)
Patil O, Vijay Gaikwad (2018) Hand gesture recognition using Haar-like features and cascade classifier. Int J Adv Res Comput Sci Manage Stud 6(2)
Garcia B, Viesca SA (2016) Real-time American sign language recognition with convolutional neural networks. In: Convolutional neural networks for visual recognition at Stanford University
Zengeler N, Kopinski T, Ha U (2018) Hand gesture recognition in automotive human-machine interaction using depth cameras. Sensors 19:59
Pramada S, Pranita DSN, Samiksha N, Vaidya AS (2013) Intelligent sign language recognition using image processing. IOSR J Eng (IOSRJEN) 3(2):45–51
Divyashree BA, Manjushree K (2019) Image processing techniques for hand gesture and sign recognition. Int Res J Eng Technol (IRJET) 6(1)
Shivashankara S, Srinath S (2018) American sign language recognition system: an optimal approach. Int J Image Graph Signal Process 10
Rai P, Alva A, Mahale GK, Shetty JS, Manjushree AN (2018) Gesture recognition system. Int J Comput Sci Mob Comput 7(5):164–175
Ravikiran J, Mahesh K, Mahishi S, Dheeraj R, Sudheender S, Pujari NV (2009) Finger detection for sign language recognition. In: Proceedings of the international multi conference of engineers and computer scientists, vol 1
Sahoo JP, SamitAri I, Ghosh DK (2017) Hand gesture recognition using DWT and F-ratio based feature descriptor, vol 12. The Institute of Engineering and Technology (IET)
Neelam GK, Ingle M (2014) Real time detection and recognition of Indian and American sign language using sift. Int J Electron Commun Eng Technol (IJECET) 5(5)
Gautam AK, Kaushik A (2017) American sign language recognition system using image processing method. Int J Comput Sci Eng 9
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Saraswathi, S., Kumar, K.A. (2021). Predicting American Sign Language from Hand Gestures Using Image Processing and Deep Learning. In: Tripathy, A., Sarkar, M., Sahoo, J., Li, KC., Chinara, S. (eds) Advances in Distributed Computing and Machine Learning. Lecture Notes in Networks and Systems, vol 127. Springer, Singapore. https://doi.org/10.1007/978-981-15-4218-3_41
Download citation
DOI: https://doi.org/10.1007/978-981-15-4218-3_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4217-6
Online ISBN: 978-981-15-4218-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)