A Preliminary Observation on the Effect of Visual Information in Learning Environmental Sounds for Deaf and Hard of Hearing People

  • Yuu Kato
  • Rumi HiragaEmail author
  • Daisuke Wakatsuki
  • Keiichi Yasu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10896)


Environmental sounds (ES) give us fundamental information about the world around us and are essential to our safety as well as our perception of everyday life. With improvements in noise reduction techniques, hearing aids and cochlear implants show better performance in the understanding of speech by deaf and hard of hearing (DHH) people. On the other hand, DHH children have little chance to learn ES. We are developing an ES learning system with visual information so that those with severely handicapped children could enjoy learning ES. In this paper, we describe a preliminary observation of including visual information as well as sound in learning ES.


Environmental sound Visual information Hearing-impaired people 



This work was supported by JSPS KAKENHI Nrs. JP2628001, JP15K01056, JP15K1614, and the Sasakawa Scientific Research Grant from the Japan Science Society.


  1. 1.
    Shafiro, V., Gygi, G., Cheng, M.Y., Vachhani, J., Mulvey, M.: Perception of environmental sounds by experienced cochlear implant patients. Ear Hear. 32(4), 511–523 (2011)CrossRefGoogle Scholar
  2. 2.
    Looi, V., Arnephy, J.: Environmental sound perception of cochlear implant users. Cochlear Implants Int. 11(4), 203–227 (2010)Google Scholar
  3. 3.
    Hiraga, R., Kato, Y., Matsubara, M., Terasawa, H., Tabaru, K.: A learning system for environmental sounds on tablets: toward a teaching resource for deaf and hard of hearing children. In: Proceedings of the Conference on Universal Language Design, pp. 310–314 (2016)Google Scholar
  4. 4.
    Shafiro, V.: Development of a large item environmental sound test and the effects of short-term training with spectrally degraded stimuli. Ear Hear. 29(5), 775–790 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Yuu Kato
    • 1
  • Rumi Hiraga
    • 1
    Email author
  • Daisuke Wakatsuki
    • 1
  • Keiichi Yasu
    • 1
  1. 1.Tsukuba University of TechnologyTsukubaJapan

Personalised recommendations