Assessing the Effectiveness of an Augmented Reality Application for the Literacy Development of Arabic Children with Hearing Impairments
Word and Sign is a mobile AR application that was developed to support the literacy development of Arabic children who are deaf or hard of hearing. The utilization of AR is intended to support reading, particularly the process of mapping a printed word to its corresponding ArSL. In this paper, the performances of elementary grade children who are deaf or hard of hearing are assessed after they are taught thirteen new words using two methods: AR using Word and Sign and a traditional teaching approach using ArSL, fingerspelling and pictures. The assessment is conducted as a series of tasks in which participants are asked to associate a printed word with its corresponding picture and ArSL. The findings show that participants who were taught via the AR application completed significantly more tasks successfully and with significantly fewer errors compared to participants who were taught the new words via a traditional approach. These findings encourage the utilization of AR inside and outside the classroom to support the literacy development of children with hearing impairments.
KeywordsAugmented reality (AR) Deaf Hard of hearing Mobile augmented reality Reading Literacy
This work was supported by the Deanship of Scientific Research at King Saud University. We thank the students, educators, and directors of Al-Amal Institute and public elementary school 300 for their encouragement and cooperation throughout the assessment.
- 3.Alnafjan, A., Aljumaah, A., Alaskar, H., Alshraihi, R.: Designing ‘Najeeb’: technology-enhanced learning for children with impaired hearing using Arabic sign-language ArSL applications. In: 2017 International Conference on Computer and Applications, ICCA 2017, pp. 238–273. IEEE (2017)Google Scholar
- 5.Cadeñanes, J., Arrieta, A.G.: Development of sign language communication skill on children through augmented reality and the MuCy model. In: Mascio, T.D., Gennari, R., Vitorini, P., Vicari, R., de la Prieta, F. (eds.) Methodologies and Intelligent Systems for Technology Enhanced Learning. AISC, vol. 292, pp. 45–52. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07698-0_6CrossRefGoogle Scholar
- 6.Cadeñanes, J., González Arrieta, M.A.: Augmented reality: an observational study considering the MuCy model to develop communication skills on deaf children. In: Polycarpou, M., de Carvalho, A.C.P.L.F., Pan, J.-S., Woźniak, M., Quintian, H., Corchado, E. (eds.) HAIS 2014. LNCS (LNAI), vol. 8480, pp. 233–240. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07617-1_21CrossRefGoogle Scholar
- 7.Cano, S., Collazos, C.A., Flórez Aristizábal, L., Moreira, F.: Augmentative and alternative communication in the literacy teaching for deaf children. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2017. LNCS, vol. 10296, pp. 123–133. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58515-4_10CrossRefGoogle Scholar
- 11.Diegmann, P., Schmidt-Kraepelin, M., Eynden, S.V.D., Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. Wirtschaftsinformatik 3(6), 1542–1556 (2015)Google Scholar
- 13.Hanafi, A.: The reality of support services for students with disabilities and their families audio and satisfaction in the light of some of the variables from the viewpoint of teachers and parents. In: Conference of Special Education, pp. 189–260 (2007)Google Scholar
- 15.Herrera-Fernández, V., Puente-Ferreras, A., Alvarado-Izquierdo, J.: Visual learning strategies to promote literacy skills in prelingually deaf readers. Revista Mexicana de Psicologia 31(1), 1–10 (2014)Google Scholar
- 16.Jones, M., Bench, N., Ferons, S.: Vocabulary acquisition for deaf readers using augmented technology. In: 2014 2nd Workshop on Virtual and Augmented Assistive Technology, VAAT 2014; Co-located with the 2014 Virtual Reality Conference - Proceedings, pp. 13–15. IEEE (2014)Google Scholar
- 17.Kingdom of Saudi Arabia General Authority of Statistic: Demographic Survey (2016). https://www.stats.gov.sa/en/852
- 21.Zainuddin, N.M.M., Badioze Zaman, H., Ahmad, A.: Learning science using AR book: a preliminary study on visual needs of deaf learners. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 844–855. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-05036-7_80CrossRefGoogle Scholar
- 27.Torgesen, J.K., Hudson, R.F.: Reading fluency: critical issues for struggling readers. In: What Research Has to Say About Fluency Instruction, pp. 130–158 (2006)Google Scholar
- 30.Zainuddin, N.M.M., Zaman, H.B., Ahmad, A.: Heuristic evaluation on augmented reality courseware for the deaf. In: International Conference on User Science and Engineering, pp. 183–188 (2011)Google Scholar