Communication Support System of Smart Glasses for the Hearing Impaired
In this research, we propose a novel system for displaying captions of conversation content on smart glasses. We propose natural communication using smart glasses that is more like a conversation between hearing people than conventional communication methods such as sign language or handwriting. The system translates spoken words into text and displays them on the screen of the smart glasses. It equips four microphones, localizes the direction of the sound source, and distinguishes the angular direction of the sound source. Using signals from four microphones, the system can enhance voices. The voice enhancement technique is required to improve the automatic speech recognition rate in noisy environments. Experimental results showed that the system can estimate the angular direction of a voice and recognize more than 90% of words that are spoken. The subject experiment showed that the proposed system had a similarity score close to an existing smartphone application.
KeywordsSmart glasses Automatic speech recognition Sound localization Voice enhancement Hearing impaired
- 1.Suemitsu, K., Zenpo, K., Mizutani, K., Wakatsuki, N.: Captioning of conversational information on single channel microphone array. In: IEICE HCG Symposium, A-4-5, pp. 322–326 (2016). (in Japanese)Google Scholar
- 2.Alarm Glasses for Deaf. http://www.sparkawards.com/galleries/index.cfm?entry=7572B7F4-5056-A832-A2B0A52EDD972027. Accessed 31 Jan 2018
- 3.KoeTra App Support Page. http://www.koetra.jp/en/index.html. Accessed 31 Jan 2018