The Research of Visual Characteristics for the Deaf Wearing AR Glasses

  • Zhelin LiEmail author
  • Xiaohui Mo
  • Chengchuan Shi
  • Shanxiao Jiang
  • Lijun Jiang
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 973)


In order to design AR (Augmented Reality) glasses for the deaf, this paper studies the virtual display interface of AR glasses. It is found that 89.8% of the deaf have willingness to use AR glasses based on questionnaires of 1900 deaf people. An experiment with 10 deaf subjects and 10 hearing subjects was done to calculate times of completing specific tasks. The results show that: (1) 80% of the deaf subjects have 3 to 5 zones in the interface with significant differences on cognitive efficiency, compared with the 6 to 7 zones from 80% of the hearing subjects. (2) The heat maps of the cognitive efficiency distribution shows that there is an obvious difference on the distribution patterns of regional sensitivity between the two groups. (3) The significant difference on cognitive efficiency of the deaf shown in different display zones is less than that of hearing people.


AR glasses Visual interface Cognitive efficiency The deaf 



This research is supported by the Fundamental Research Funds for Central Universities (2017ZX013).


  1. 1.
  2. 2.
    Mi, K.: A review of the research on communication mode of hearing impaired. Modern Spec. Educ. 08, 72–76 (2016)Google Scholar
  3. 3.
    McCormack, A., Fortnum, H.: Why do people fitted with hearing aids not wear them? Int. J. Audiol. 52(5), 360–368 (2013)CrossRefGoogle Scholar
  4. 4.
    Schweizer, H.: Smart glasses: technology and applications Student report Ubiquitous computing seminar FS (2014)Google Scholar
  5. 5.
    Sony. Sony Access Glasses.
  6. 6.
    Jain, D., Findlater, L., et al.: Head-mounted display visualizations to support sound awareness for the deaf and hard of hearing. The CHI, 241–250 (2015)Google Scholar
  7. 7.
    Levine, A., Billawa, S., Bridge, L., et al.: FMRI correlates of visual motion processing in hearing and deaf adults. J. Vis. 14(10), 297 (2014)CrossRefGoogle Scholar
  8. 8.
    Bavelier, D., Dye, M.W.C., Hauser, P.C.: Do deaf individuals see better? Trends Cognit. Sci. 10(11), 512–518 (2006)CrossRefGoogle Scholar
  9. 9.
    Lu, X., Pas, E.I.: Socio-demographics. activity participation and travel behavior. Department of Civil and Environmental Engineering, pp. 3–4Google Scholar
  10. 10.
    Timmermans, H., et al.: Analyzing space-time behaviour: new approaches to old problems. Progress Hum. Geogr. 26(2), 175–190 (2002)CrossRefGoogle Scholar
  11. 11.
    Shao, J.: Research on the information encoding method of helmet mounted display system interface based on visual perception theory. Southeast Univ. 77, 113–118 (2016)Google Scholar
  12. 12.
  13. 13.
    Ruch Theodore, C., Fulton, J.F.: Medical physiology and biophysics (1960)Google Scholar
  14. 14.
    Ding, Y.: Ergonomics. Beijing Institute of Technology Press (04), 39–41 (2011)Google Scholar
  15. 15.
    Matthews, T., Carter, S., et al.: Scribe4Me: Evaluating a Mobile Sound Transcription Tool for the Deaf. Technical Report No. UCB/EECS 9, 159–176 (2006)Google Scholar
  16. 16.
    Matthews, T., Fong, J., et al.: Evaluating non-speech sound visualizations for the deaf. Behav. Inf. Technol. 25(2), 333–351 (2007)Google Scholar
  17. 17.
    Stevens, C.: Neuroplasticity as a double-edged sword: deaf enhancements and dyslexic deficits in motion processing. J. Cognit. Neurosci. 18(5), 701–714 (2006)CrossRefGoogle Scholar
  18. 18.
    Loke, W.H., Song, S.: Central and peripheral visual processing in hearing and non hearing individuals. Bull. Psychon. Soc. 29(5), 437–440 (1991)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Zhelin Li
    • 1
    • 2
    Email author
  • Xiaohui Mo
    • 1
  • Chengchuan Shi
    • 3
  • Shanxiao Jiang
    • 1
  • Lijun Jiang
    • 1
    • 2
  1. 1.School of DesignSouth China University of TechnologyGuangzhouChina
  2. 2.Guangdong Human-Computer Interaction Design Engineering Technology Research CenterGuangzhouChina
  3. 3.Guangzhou Voibook Technology Co., LtdGuangzhouChina

Personalised recommendations