Assessing the Effectiveness of an Augmented Reality Application for the Literacy Development of Arabic Children with Hearing Impairments

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10912)


Word and Sign is a mobile AR application that was developed to support the literacy development of Arabic children who are deaf or hard of hearing. The utilization of AR is intended to support reading, particularly the process of mapping a printed word to its corresponding ArSL. In this paper, the performances of elementary grade children who are deaf or hard of hearing are assessed after they are taught thirteen new words using two methods: AR using Word and Sign and a traditional teaching approach using ArSL, fingerspelling and pictures. The assessment is conducted as a series of tasks in which participants are asked to associate a printed word with its corresponding picture and ArSL. The findings show that participants who were taught via the AR application completed significantly more tasks successfully and with significantly fewer errors compared to participants who were taught the new words via a traditional approach. These findings encourage the utilization of AR inside and outside the classroom to support the literacy development of children with hearing impairments.


Augmented reality (AR) Deaf Hard of hearing Mobile augmented reality Reading Literacy 



This work was supported by the Deanship of Scientific Research at King Saud University. We thank the students, educators, and directors of Al-Amal Institute and public elementary school 300 for their encouragement and cooperation throughout the assessment.


  1. 1.
    Allen, T.E.: ASL skills, fingerspelling ability, home communication context and early alphabetic knowledge of preschool-aged deaf children. Sign Lang. Stud. 15(3), 233–265 (2015)CrossRefGoogle Scholar
  2. 2.
    Almutairi, A., Al-Megren, S.: Preliminary investigations on augmented reality for the literacy development of deaf children. In: Badioze Zaman, H., et al. (eds.) IVIC 2017. LNCS, vol. 10645, pp. 412–422. Springer, Cham (2017). Scholar
  3. 3.
    Alnafjan, A., Aljumaah, A., Alaskar, H., Alshraihi, R.: Designing ‘Najeeb’: technology-enhanced learning for children with impaired hearing using Arabic sign-language ArSL applications. In: 2017 International Conference on Computer and Applications, ICCA 2017, pp. 238–273. IEEE (2017)Google Scholar
  4. 4.
    Alyami, H., Soer, M., Swanepoel, A., Pottas, L.: Deaf or hard of hearing children in Saudi Arabia: status of early intervention services. Int. J. Pediatr. Otorhinolaryngol. 86, 142–149 (2016)CrossRefGoogle Scholar
  5. 5.
    Cadeñanes, J., Arrieta, A.G.: Development of sign language communication skill on children through augmented reality and the MuCy model. In: Mascio, T.D., Gennari, R., Vitorini, P., Vicari, R., de la Prieta, F. (eds.) Methodologies and Intelligent Systems for Technology Enhanced Learning. AISC, vol. 292, pp. 45–52. Springer, Cham (2014). Scholar
  6. 6.
    Cadeñanes, J., González Arrieta, M.A.: Augmented reality: an observational study considering the MuCy model to develop communication skills on deaf children. In: Polycarpou, M., de Carvalho, A.C.P.L.F., Pan, J.-S., Woźniak, M., Quintian, H., Corchado, E. (eds.) HAIS 2014. LNCS (LNAI), vol. 8480, pp. 233–240. Springer, Cham (2014). Scholar
  7. 7.
    Cano, S., Collazos, C.A., Flórez Aristizábal, L., Moreira, F.: Augmentative and alternative communication in the literacy teaching for deaf children. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2017. LNCS, vol. 10296, pp. 123–133. Springer, Cham (2017). Scholar
  8. 8.
    Cihak, D.F., Moore, E.J., Wright, R.E., McMahon, D.D., Gibbons, M.M., Smith, C.: Evaluating augmented reality to complete a chain task for elementary students with autism. J. Spec. Educ. Technol. 31(2), 99–108 (2016)CrossRefGoogle Scholar
  9. 9.
    Clark, M.D., Hauser, P.C., Miller, P., Kargin, T., Rathmann, C., Guldenoglu, B., Kubus, O., Spurgeon, E., Israel, E.: The importance of early sign language acquisition for deaf readers. Read. Writ. Q. 32(2), 127–151 (2016)CrossRefGoogle Scholar
  10. 10.
    Craig, A.B.: Mobile augmented reality (Chap. 7 ). In: Understanding Augmented Reality (2013)CrossRefGoogle Scholar
  11. 11.
    Diegmann, P., Schmidt-Kraepelin, M., Eynden, S.V.D., Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. Wirtschaftsinformatik 3(6), 1542–1556 (2015)Google Scholar
  12. 12.
    Goldin-Meadow, S., Mayberry, R.I., Read, T.O.: How do profoundly deaf children learn to read? Learn. Disabil. Res. Pract. 16(4), 222–229 (2001)CrossRefGoogle Scholar
  13. 13.
    Hanafi, A.: The reality of support services for students with disabilities and their families audio and satisfaction in the light of some of the variables from the viewpoint of teachers and parents. In: Conference of Special Education, pp. 189–260 (2007)Google Scholar
  14. 14.
    Haptonstall-Nykaza, T.S., Schick, B.: The transition from fingerspelling to english print: facilitating english decoding. J. Deaf Stud. Deaf Educ. 12(2), 172–183 (2007)CrossRefGoogle Scholar
  15. 15.
    Herrera-Fernández, V., Puente-Ferreras, A., Alvarado-Izquierdo, J.: Visual learning strategies to promote literacy skills in prelingually deaf readers. Revista Mexicana de Psicologia 31(1), 1–10 (2014)Google Scholar
  16. 16.
    Jones, M., Bench, N., Ferons, S.: Vocabulary acquisition for deaf readers using augmented technology. In: 2014 2nd Workshop on Virtual and Augmented Assistive Technology, VAAT 2014; Co-located with the 2014 Virtual Reality Conference - Proceedings, pp. 13–15. IEEE (2014)Google Scholar
  17. 17.
    Kingdom of Saudi Arabia General Authority of Statistic: Demographic Survey (2016).
  18. 18.
    Kipper, G., Rampolla, J.: Augmented Reality. Elsevier, New York (2013)CrossRefGoogle Scholar
  19. 19.
    Kožuh, I., Hauptman, S., Kosec, P., Debevc, M.: Assessing the efficiency of using augmented reality for learning sign language. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9176, pp. 404–415. Springer, Cham (2015). Scholar
  20. 20.
    McMahon, D.D., Cihak, D.F., Wright, R.E., Bell, S.M.: Augmented reality for teaching science vocabulary to postsecondary education students with intellectual disabilities and autism. J. Res. Technol. Educ. 48(1), 38–56 (2016)CrossRefGoogle Scholar
  21. 21.
    Zainuddin, N.M.M., Badioze Zaman, H., Ahmad, A.: Learning science using AR book: a preliminary study on visual needs of deaf learners. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 844–855. Springer, Heidelberg (2009). Scholar
  22. 22.
    Mellon, N.K., Niparko, J.K., Rathmann, C., Mathur, G., Humphries, T., Jo Napoli, D., Handley, T., Scambler, S., Lantos, J.D.: Should all deaf children learn sign language? Pediatrics 136(1), 170–176 (2015)CrossRefGoogle Scholar
  23. 23.
    Oka Sudana, A.A.K., Aristamy, I.G.A.A.M., Wirdiani, N.K.A.: Augmented reality application of sign language for deaf people in Android based on smartphone. Int. J. Softw. Eng. Appl. 10(8), 139–150 (2016)CrossRefGoogle Scholar
  24. 24.
    Singh, M., Singh, M.P.: Augmented reality interfaces. In: IEEE Internet Computing (2013)CrossRefGoogle Scholar
  25. 25.
    Smith, C.C., Cihak, D.F., Kim, B., McMahon, D.D., Wright, R.: Examining augmented reality to improve navigation skills in postsecondary students with intellectual disability. J. Spec. Educ. Technol. 32(1), 3–11 (2017)CrossRefGoogle Scholar
  26. 26.
    Stone, A., Kartheiser, G., Hauser, P.C., Petitto, L.A., Allen, T.E.: Fingerspelling as a novel gateway into reading fluency in deaf bilinguals. PLoS ONE 10(10), e0139610 (2015)CrossRefGoogle Scholar
  27. 27.
    Torgesen, J.K., Hudson, R.F.: Reading fluency: critical issues for struggling readers. In: What Research Has to Say About Fluency Instruction, pp. 130–158 (2006)Google Scholar
  28. 28.
    Wellner, P., Mackay, W., Gold, R.: Computer-augmented environments: back to the real world. Commun. ACM 36(7), 24–27 (1993)CrossRefGoogle Scholar
  29. 29.
    Wu, H.K., Lee, S.W.Y., Chang, H.Y., Liang, J.C.: Current status, opportunities and challenges of augmented reality in education. Comput. Educ. 62, 41–49 (2013)CrossRefGoogle Scholar
  30. 30.
    Zainuddin, N.M.M., Zaman, H.B., Ahmad, A.: Heuristic evaluation on augmented reality courseware for the deaf. In: International Conference on User Science and Engineering, pp. 183–188 (2011)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Information Technology DepartmentKing Saud UniversityRiyadhSaudi Arabia

Personalised recommendations