Abstract
In this research, we propose a novel system for displaying captions of conversation content on smart glasses. We propose natural communication using smart glasses that is more like a conversation between hearing people than conventional communication methods such as sign language or handwriting. The system translates spoken words into text and displays them on the screen of the smart glasses. It equips four microphones, localizes the direction of the sound source, and distinguishes the angular direction of the sound source. Using signals from four microphones, the system can enhance voices. The voice enhancement technique is required to improve the automatic speech recognition rate in noisy environments. Experimental results showed that the system can estimate the angular direction of a voice and recognize more than 90% of words that are spoken. The subject experiment showed that the proposed system had a similarity score close to an existing smartphone application.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Suemitsu, K., Zenpo, K., Mizutani, K., Wakatsuki, N.: Captioning of conversational information on single channel microphone array. In: IEICE HCG Symposium, A-4-5, pp. 322–326 (2016). (in Japanese)
Alarm Glasses for Deaf. http://www.sparkawards.com/galleries/index.cfm?entry=7572B7F4-5056-A832-A2B0A52EDD972027. Accessed 31 Jan 2018
KoeTra App Support Page. http://www.koetra.jp/en/index.html. Accessed 31 Jan 2018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Watanabe, D., Takeuchi, Y., Matsumoto, T., Kudo, H., Ohnishi, N. (2018). Communication Support System of Smart Glasses for the Hearing Impaired. In: Miesenberger, K., Kouroupetroglou, G. (eds) Computers Helping People with Special Needs. ICCHP 2018. Lecture Notes in Computer Science(), vol 10896. Springer, Cham. https://doi.org/10.1007/978-3-319-94277-3_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-94277-3_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94276-6
Online ISBN: 978-3-319-94277-3
eBook Packages: Computer ScienceComputer Science (R0)