Abstract
Sign language translator device is an assistive device that helps hearing impaired and normal people communicate with each other. The device can be either a camera vision-based or wearable glove-based system that translates hand gestures into text or voice. However, vision-based devices are susceptible to low light conditions and expensive. In contrast, glove-based devices are popular and low cost, but many designs utilized cable system that limits hand motions. The main focus of this work is to develop a wireless wearable sign language translator device, so that free-hand motions can be achieved. An Android-based smartphone application (app) has been developed to receive and display translated gestures from the wearable device in text form. The usage of smartphone app significantly reduces development cost, simplifies the design and improves the ease-of-use for hearing impaired communities. In this article, the developed hardware, circuit diagrams, app development as well as experimental results are presented.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Acute shortage of sign language interpreters in M’sia. Retrieved from https://www.malaysiakini.com/news/376165
Mohid SZ, Zin NAM (2011) Accessible courseware for kids with hearing impaired (MudahKiu): a preliminary analysis. In: Proceedings of 2011 international conference on pattern analysis and intelligent robotics ICPAIR 2011, vol 2, pp 197–202
Igari S, Fukumura N (2016) Recognition of Japanese sign language words represented by both arms using multi-stream HMMs. In: Proceedings of IMCIC-ICSIT, pp 157–162
Dong C, Yin Z, Leu MC (2015) American sign language alphabet recognition using microsoft kinect. In: IEEE conference on computer vision and pattern recognition workshops, pp 44–52
Hai PT et al (2018) Automatic feature extraction for Vietnamese sign language recognition using support vector machine. In: 2018 2nd international conference on recent advances in signal processing telecommunications and computing (SigTelCom), pp 146–151
Rishikanth C et al (2014) Low-cost intelligent gesture recognition engine for audio-vocally impaired individuals. In: 2014 IEEE global humanitarian technology conference (GHTC), pp 628–634
Gałka J et al (2016) Inertial motion sensing glove for sign language gesture acquisition and recognition. IEEE Sens J 16(16):6310–6316
Ambar R et al (2018) Preliminary design of a dual-sensor based sign language translator device. In: Ghazali R, Deris M, Nawi N, Abawajy J (eds) Recent advances on soft computing and data mining. SCDM 2018. Advances in intelligent systems and computing, vol 700. Springer, Cham
Acknowledgements
The authors would like to thank the Research Management Center (RMC), UTHM and Ministry of Higher Education for sponsoring the research under Tier 1 Research Grant (H161).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Ethical Approval. All procedures performed in studies involving human participants were in accordance with the ethical standards of the Human Research Ethics Committee of Universiti Tun Hussein Onn Malaysia (UTHM).
Informed Consent. Informed consent was obtained from all individual participants included in the study.
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Phing, T.C., Ambar, R., Choon, C.C., Wahab, M.H.A. (2019). Wireless Wearable for Sign Language Translator Device with Android-Based App. In: Piuri, V., Balas, V., Borah, S., Syed Ahmad, S. (eds) Intelligent and Interactive Computing. Lecture Notes in Networks and Systems, vol 67. Springer, Singapore. https://doi.org/10.1007/978-981-13-6031-2_27
Download citation
DOI: https://doi.org/10.1007/978-981-13-6031-2_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-6030-5
Online ISBN: 978-981-13-6031-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)