Recognition of Hand Gestures and Conversion of Voice for Betterment of Deaf and Mute People
Around 5% of people across the globe have difficulty in speaking or are unable to speak. So, to overcome this difficulty, sign language came into the picture. It is a method of non-verbal communication which is usually used by deaf and mute people. Another problem that arises with sign language is that people without hearing or speaking problems do not learn this language. This problem is severe as it creates a barrier between them. To resolve this issue, this paper makes use of computer vision and machine learning along with Convolutional Neural Network. The objective of this paper is to facilitate communication among deaf and mute and other people. For achieving this objective, a system is built to convert hand gestures to voice with gesture understanding and motion capture. This system will be helpful for deaf and mute people as it will increase their communication with other people.
KeywordsSign language Gesture recognition Computer vision Image processing Convolutional Neural Network
- 1.Bhat, S., Amruthesh, M., Ashik, Das, C., Sujith: Translating Indian sign language to text and voice messages using flex sensors. Int. J. Adv. Res. Comput. Commun. Eng. (4), 430–434 (2015)Google Scholar
- 7.Morris, T.: Computer Vision and Image Processing, pp. 1–320. Palgrave Macmillan. Springer (2014)Google Scholar
- 8.Garg, P., Aggarwal, N., Sofat, S.: Vision based hand gesture recognition. World Acad. Sci. Eng. Technol. Int. J. Comput. Electr. Autom. Control Inf. Eng. 3(1), 186–191 (2009)Google Scholar
- 11.Quek, F.: Towards a vision based hand gesture interface. In: Proceedings of Virtual Reality Software and Technology, pp. 17–31. ACM (1994)Google Scholar
- 12.Wikipedia: Markov model (2018). https://en.wikipedia.org/w/index.php?
- 20.Johnston, L.: What are webcam frame rates? (2018). https://www.lifewire.com/webcam-framerates
- 21.Shinde, S.S., Autee, R.M., Bhosale, V.K.: Real time two way communication approach for hearing impaired and dumb person based on image processing. In: IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–5. IEEE (2016)Google Scholar
- 27.Gaur, R., Chouhan, V.S.: Classifiers in Image processing. Int. J. Future Revolut. Comput. Sci. Commun. Eng. 3(6), 22–24 (2017)Google Scholar
- 28.Rehm, M., Bee, N., André, E.: Wave like an egyptian – accelerometer based gesture recognition for culture specific interactions. Br. Comput. Soc. 1, 13–22 (2008)Google Scholar