Hand Talk System for Deaf and Dumb Person

  • Vikash KumarEmail author
  • Sanjeev Kumar Raghuwanshi
  • Ankit Kumar
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 308)


This project is a prototype of data glove which has ability to convert the movement of figure into visual display and audible sound of predefined language. I have seen many people who find it difficult to communicate with other due to language problem or due to problem in vocal chord. In a diverse country like INDIA where various types of mother tongues is spoken. People form one region of country when travelled to other region find it difficult to convey their message, which make it tedious to survive them in other region. So this data glove can convert the speaker language into the listener language which make it possible to easy communication between different language speaker. There is approximately 70 million people in world who are deaf and dumb. These people use sign language to communicate with each other. But the person with no disability in vocal chord does not learn sign language, this means that not everyone can understand sign language. So it will be a tedious task for deaf or dumb person to communicate with other person having no knowledge of sign language. This data glove can be used to replace code language which is used during war. A particular command can be converted into a gesture and the commanding officer have to make particular gesture using his hand and the command is displayed on the command receiving personnel. Data glove consists of flex sensor. In this prototype I have used 3 flex sensor which produce 8 output result. You can increase no of flex sensor up to 5 on one glove which can produce 32 output. The output produce by combination of flex sensor on data glove is in analog form which is feeded to ADC channel of Arduino microcontroller. Analog to digital converter of microcontroller convert the analog input into digital form. This digital pattern is compared with stored data and then according to comparing result a particular sentence or word is displayed on a 16 * 2 LCD and same word or sentence is played on an 8 O speaker. Speaker and LCD output is for dumb people communication while only LCD is only sufficient for deaf person. This model consists of SD card which make it possible for storing as much audio as required means there will be no limitation of memory.


Arduino microcontroller Flex sensor Sign language Ultrasonic sensor 


  1. 1.
    Otiniano, R., Amara, C.: Finger spelling recognition from RGB-D information using kernel descriptor. IEEE Trans. Neural Syst. Rehabil. Eng. 28(8), 124–184 (2006)Google Scholar
  2. 2.
    Zhengmao, Z., Prashan, R., Monaragala, N., Malin, P.: Dynamic hand gesture recognition system using moment invariants. IEEE Trans. Neural Netw. Comput. 21(1), 1034–1320 (2010)Google Scholar
  3. 3.
    Preetham, C., Ramakrishnan, G., Kumar, S., Tamse, A., Krishnapura, N.: Hand talk-implementation of a gesture recognizing gloveGoogle Scholar
  4. 4.
    Anetha, K., Rejina P.J.: Hand talk-a sign language recognition based on accelerometer and SEMG dataGoogle Scholar
  5. 5.
    Ong, S.C.W., Ranganath, S.: Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27(6), 873–891 (2005)CrossRefGoogle Scholar
  6. 6.
    Mayura, S.K., Prasad R.K.: Gesture controlled robotic hand using flex sensor. IJSRD—Int. J. Sci. Res. Dev. 3(7), 2321–0613 (2015) ISSN (online)Google Scholar
  7. 7.
    Saggio, G., Riillo, F., Sbernini, L., Quitadamo, L.R.: Resistive flex sensors: a survey. Smart Mat. Struct. 25(1), 013001 (2015)CrossRefGoogle Scholar
  8. 8.
    Kekre, M., Vaishali, K.: Speaker identification by using vector quantization. IEEE Trans. Mechatronics 15(1), 1034–1620 (2010)Google Scholar
  9. 9.
    Elleuch, H., Wali, A., Samet, A. Alimi, A.M., 2015, December. A static hand gesture recognition system for real time mobile device monitoring. In: 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA), IEEE, pp. 195–200 (December 2015)Google Scholar
  10. 10.
    Lopes, N.V., Pinto, F., Furtado, P. Silva, J.: IoT architecture proposal for disabled people. In 2014 IEEE 10th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), IEEE, pp. 152–158 (October 2014)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Vikash Kumar
    • 1
    Email author
  • Sanjeev Kumar Raghuwanshi
    • 2
  • Ankit Kumar
    • 3
  1. 1.GLA UniversityMathuraIndia
  2. 2.IIT(ISM) DhanbadDhanbadIndia
  3. 3.GLA UniversityMathuraIndia

Personalised recommendations