Large-Scale Interactive Environments for Mobility Training and Experience Sharing of Blind Children

  • Marcella Mandanici
  • Antonio Rodà
Part of the EAI/Springer Innovations in Communication and Computing book series (EAISICC)


This book chapter provides a framework for the design and implementation of large-scale interactive environments for orientation and mobility training of blind children. Large-scale interactive environments are physical spaces under the range of a camera hanging from the ceiling and linked to a computer vision system that provides the tracking of a person inside the active area. This allows the coupling of the blind child’s position to the audio output, which can change depending on the child’s movements. Relying on such features, we present “Following the Cuckoo Sound”, an application designed to train children to avoid veering. Previous assessment results show a general decrease of veering from pre- to post-test. Here the same results are analyzed and discussed in the light of four indicators of children’s behavior. Finally, a more advanced interactive soundscape navigation system is proposed as an efficient tool to improve sensory integration of blind children.


Orientation and mobility training Anti-veering systems Large-scale interactive environments Sensory integration Soundscape navigation 


  1. Allain, K., Dado, B., Van Gelderen, M., Hokke, O., Oliveira, M., Bidarra, R., … Kybartas, B. (2015, March). An audio game for training navigation skills of blind children. In 2015 IEEE Second VR Workshop on Sonic Interactions for Virtual Environments (SIVE) (pp. 1–4). Washington, DC: IEEE.Google Scholar
  2. American Foundation for the Blind. (2018). The expanded core curriculum for blind and visually impaired children and youths. Retrieved July 29, 2018, from
  3. Amico, L. (2012). La Stanza Logo-Motoria. Un Ambiente multimodale interattivo per l’insegnamento a bambini in situazione di multi-disabilità (Master’s thesis). Dipartimento di Ingegneria dell’Informazione, Università di Padova.Google Scholar
  4. Ayres, A. J., & Robbins, J. (2005). Sensory integration and the child: Understanding hidden sensory challenges. Torrance, CA: Western Psychological Services.Google Scholar
  5. Balan, O., Moldoveanu, A., Moldoveanu, F., Nagy, H., Wersenyi, G., & Unnporsson, R. (2017). Improving the audio game-playing performances of people with visual impairments through multimodal training. Journal of Visual Impairment & Blindness, 111(2), 148–164.CrossRefGoogle Scholar
  6. Bergsland, A., & Wechsler, R. (2016). Turning movement into music: Issues and applications of the MotionComposer, a therapeutic device for persons with different abilities. SoundEffects – An Interdisciplinary Journal of Sound and Sound Experience, 6(1), 23–47.CrossRefGoogle Scholar
  7. Boyadjian, A., Marin, L., & Danion, F. (1999). Veering in human locomotion: The role of the effectors. Neuroscience Letters, 265(1), 21–24.CrossRefGoogle Scholar
  8. Buaud, A., Svensson, H., Archambault, D., & Burger, D. (2002, July). Multimedia games for visually impaired children. In International Conference on Computers for Handicapped Persons (pp. 173–180). Berlin, Heidelberg: Springer.Google Scholar
  9. Caillois, R. (2001). Man, play, and games. Champaign, IL: University of Illinois Press.Google Scholar
  10. Carvalho, J., Guerreiro, T., Duarte, L., & Carriço, L. (2012, July). Audio-based puzzle gaming for blind people. In Proceedings of the Mobile Accessibility Workshop at MobileHCI (MOBACC).Google Scholar
  11. Celeste, M., & Grum, D. K. (2010). Social integration of children with visual impairment: A developmental model. İlköğretim Online, 9(1), 11–22.Google Scholar
  12. Chung, J. C., Lai, C. K., Chung, P. M., & French, H. P. (2002). Snoezelen for dementia. Cochrane Database of Systematic Reviews, (4), CD003152.Google Scholar
  13. Connors, E. C., Yazzolino, L. A., Sánchez, J., & Merabet, L. B. (2013). Development of an audio-based virtual gaming environment to assist with navigation skills in the blind. Journal of Visualized Experiments: JoVE, (73).
  14. Coroama, V., & Röthenbacher, F. (2003, October). The chatty environment—Providing everyday independence to the visually impaired. In Workshop on Ubiquitous Computing for Pervasive Healthcare Applications at UbiComp.Google Scholar
  15. Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011, September). From game design elements to gamefulness: Defining gamification. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp. 9–15). New York, NY: ACM.CrossRefGoogle Scholar
  16. Djaouti, D., Alvarez, J., & Jessel, J. P. (2011). Classifying serious games: The G/P/S model. In Handbook of research on improving learning and motivation through educational games: Multidisciplinary approaches (pp. 118–136). IGI Global.CrossRefGoogle Scholar
  17. Freeman, E., Wilson, G., Brewster, S., Baud-Bovy, G., Magnusson, C., & Caltenco, H. (2017, May). Audible beacons and wearables in schools: Helping young visually impaired children play and move independently. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 4146–4157). New York, NY: ACM.CrossRefGoogle Scholar
  18. Gaver, W. W. (1993). What in the world do we hear?: An ecological approach to auditory event perception. Ecological Psychology, 5(1), 1–29.CrossRefGoogle Scholar
  19. Georgetown University Medical Center. (2010, October 10). People blind from birth use visual brain area to improve other senses: Can hear and feel with greater acuity. ScienceDaily. Retrieved June 20, 2018, from
  20. Ghisio, S., Coletta, P., Piana, S., Alborno, P., Volpe, G., Camurri, A., … Bergamaschi, V. (2015, June). An open platform for full body interactive sonification exergames. In 2015 Seventh International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN) (pp. 168–175). Washington, DC: IEEE.Google Scholar
  21. Giudice, N. A., & Legge, G. E. (2008). Blind navigation and the role of technology. In The engineering handbook of smart technology for aging, disability, and independence (pp. 479–500). New York, NY: John Wiley & Sons.CrossRefGoogle Scholar
  22. Gori, M. (2015). Multisensory integration and calibration in children and adults with and without sensory and motor disabilities. Multisensory Research, 28(1–2), 71–99.CrossRefGoogle Scholar
  23. Guth, D., & LaDuke, R. (1994). The veering tendency of blind pedestrians: An analysis of the problem and literature review. Journal of Visual Impairment & Blindness, 88, 391–400.Google Scholar
  24. Juul, J. (2011). Half-real: Video games between real rules and fictional worlds. Cambridge, MA: MIT Press.Google Scholar
  25. Kallie, C. S., Schrater, P. R., & Legge, G. E. (2007). Variability in stepping direction explains the veering behavior of blind walkers. Journal of Experimental Psychology: Human Perception and Performance, 33(1), 183.Google Scholar
  26. Lee, H. P., Huang, Y. H., & Sheu, T. F. (2013). An interactive training game using 3D sound for visually impaired people. International Association for Development of the Information Society.Google Scholar
  27. Lionello, M., Mandanici, M., Canazza, S., & Micheloni, E. (2017). Interactive soundscapes: Developing a physical space augmented through dynamic sound rendering and granular synthesis. In Proceedings of the 14th Sound and Music Computing Conference.Google Scholar
  28. Loomis, J. M., Klatzky, R. L., Golledge, R. G., & Philbeck, J. W. (1999). Human navigation by path integration. In Wayfinding behavior: Cognitive mapping and other spatial processes (pp. 125–151). Baltimore, MD: Johns Hopkins University Press.Google Scholar
  29. Magnusson, C., Rydeman, B., Finocchietti, S., Cappagli, G., Porquis, L. B., Baud-Bovy, G., & Gori, M. (2015, August). Co-located games created by children with visual impairments. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (pp. 1157–1162). New York, NY: ACM.Google Scholar
  30. Mandanici, M., Altieri, F., Rodà, A., & Canazza, S. (2018). Inclusive sound and music serious games in a large-scale responsive environment. British Journal of Educational Technology, 49, 620–635. CrossRefGoogle Scholar
  31. Mandanici, M., Rodà, A., Canazza, S., & Cavagnoli, G. (2017, November). Following the cuckoo sound: A responsive floor to train blind children to avoid veering. In International Conference on Smart Objects and Technologies for Social Good (pp. 11–20). Cham: Springer.Google Scholar
  32. Merabet, L., & Sánchez, J. (2009). Audio-based navigation using virtual environments: Combining technology and neuroscience. AER Journal: Research and Practice in Visual Impairment and Blindness, 2(3), 128–137.Google Scholar
  33. Michael, D. R., & Chen, S. L. (2005). Serious games: Games that educate, train, and inform. New York, NY: Muska & Lipman/Premier-Trade.Google Scholar
  34. Morelli, T., Foley, J., Columna, L., Lieberman, L., & Folmer, E. (2010, June). VI-Tennis: A vibrotactile/audio exergame for players who are visually impaired. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (pp. 147–154). New York, NY: ACM.Google Scholar
  35. Nazemi, M. M. (2014). Affective soundscape composition for evoking sonic immersion. Journal of Sonic Studies, 7. Retrieved June 17, 2018, from
  36. Ricketts, L. (2008, Fall). OTR, Texas School for the Blind and Visually Impaired. Texas Sense Abilities. Retrieved July 29, 2018, from
  37. Sánchez, J., & Sáenz, M. (2006). 3D sound interactive environments for blind children problem solving skills. Behaviour & Information Technology, 25(4), 367–378.CrossRefGoogle Scholar
  38. Sánchez, J., Sáenz, M., & Garrido, J. M. (2010). Usability of a multimodal video game to improve navigation skills for blind children. ACM Transactions on Accessible Computing (TACCESS), 3(2), 7.Google Scholar
  39. Souman, J. L., Frissen, I., Sreenivasa, M. N., & Ernst, M. O. (2009). Walking straight into circles. Current Biology, 19(18), 1538–1542.CrossRefGoogle Scholar
  40. Spagnol, S., Wersényi, G., Bujacz, M., Bălan, O., Herrera Martínez, M., Moldoveanu, A., & Unnthorsson, R. (2018). Current use and future perspectives of spatial audio technologies in electronic travel aids. Wireless Communications and Mobile Computing, 2018, 3918284.Google Scholar
  41. Tröster, H., & Brambring, M. (1994). The play behavior and play materials of blind and sighted infants and preschoolers. Journal of Visual Impairment & Blindness, 88(5), 421–432.Google Scholar
  42. Truax, B. (2001). Acoustic communication (Vol. 1). Westport, CT: Greenwood Publishing Group.Google Scholar
  43. Viega, M. (n.d.). Listening in the ambient mode: Implications for music therapy practice and theory. Retrieved from
  44. Wii Remote. (2018, December). Retrieved December 18, 2018, from

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Marcella Mandanici
    • 1
    • 2
  • Antonio Rodà
    • 3
  1. 1.Department of Information EngineeringUniversity of PadovaPadovaItaly
  2. 2.Department of Music EducationMusic Conservatory “L. Marenzio”BresciaItaly
  3. 3.Department of Information EngineeringUniversity of PadovaPadovaItaly

Personalised recommendations