Large-Scale Interactive Environments for Mobility Training and Experience Sharing of Blind Children
This book chapter provides a framework for the design and implementation of large-scale interactive environments for orientation and mobility training of blind children. Large-scale interactive environments are physical spaces under the range of a camera hanging from the ceiling and linked to a computer vision system that provides the tracking of a person inside the active area. This allows the coupling of the blind child’s position to the audio output, which can change depending on the child’s movements. Relying on such features, we present “Following the Cuckoo Sound”, an application designed to train children to avoid veering. Previous assessment results show a general decrease of veering from pre- to post-test. Here the same results are analyzed and discussed in the light of four indicators of children’s behavior. Finally, a more advanced interactive soundscape navigation system is proposed as an efficient tool to improve sensory integration of blind children.
KeywordsOrientation and mobility training Anti-veering systems Large-scale interactive environments Sensory integration Soundscape navigation
- Allain, K., Dado, B., Van Gelderen, M., Hokke, O., Oliveira, M., Bidarra, R., … Kybartas, B. (2015, March). An audio game for training navigation skills of blind children. In 2015 IEEE Second VR Workshop on Sonic Interactions for Virtual Environments (SIVE) (pp. 1–4). Washington, DC: IEEE.Google Scholar
- American Foundation for the Blind. (2018). The expanded core curriculum for blind and visually impaired children and youths. Retrieved July 29, 2018, from http://www.afb.org/info/programs-and-services/professional-development/education/expanded-core-curriculum/the-expanded-core-curriculum/12345.
- Amico, L. (2012). La Stanza Logo-Motoria. Un Ambiente multimodale interattivo per l’insegnamento a bambini in situazione di multi-disabilità (Master’s thesis). Dipartimento di Ingegneria dell’Informazione, Università di Padova.Google Scholar
- Ayres, A. J., & Robbins, J. (2005). Sensory integration and the child: Understanding hidden sensory challenges. Torrance, CA: Western Psychological Services.Google Scholar
- Buaud, A., Svensson, H., Archambault, D., & Burger, D. (2002, July). Multimedia games for visually impaired children. In International Conference on Computers for Handicapped Persons (pp. 173–180). Berlin, Heidelberg: Springer.Google Scholar
- Caillois, R. (2001). Man, play, and games. Champaign, IL: University of Illinois Press.Google Scholar
- Carvalho, J., Guerreiro, T., Duarte, L., & Carriço, L. (2012, July). Audio-based puzzle gaming for blind people. In Proceedings of the Mobile Accessibility Workshop at MobileHCI (MOBACC).Google Scholar
- Celeste, M., & Grum, D. K. (2010). Social integration of children with visual impairment: A developmental model. İlköğretim Online, 9(1), 11–22.Google Scholar
- Chung, J. C., Lai, C. K., Chung, P. M., & French, H. P. (2002). Snoezelen for dementia. Cochrane Database of Systematic Reviews, (4), CD003152.Google Scholar
- Connors, E. C., Yazzolino, L. A., Sánchez, J., & Merabet, L. B. (2013). Development of an audio-based virtual gaming environment to assist with navigation skills in the blind. Journal of Visualized Experiments: JoVE, (73). https://doi.org/10.3791/50272.
- Coroama, V., & Röthenbacher, F. (2003, October). The chatty environment—Providing everyday independence to the visually impaired. In Workshop on Ubiquitous Computing for Pervasive Healthcare Applications at UbiComp.Google Scholar
- Freeman, E., Wilson, G., Brewster, S., Baud-Bovy, G., Magnusson, C., & Caltenco, H. (2017, May). Audible beacons and wearables in schools: Helping young visually impaired children play and move independently. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 4146–4157). New York, NY: ACM.CrossRefGoogle Scholar
- Georgetown University Medical Center. (2010, October 10). People blind from birth use visual brain area to improve other senses: Can hear and feel with greater acuity. ScienceDaily. Retrieved June 20, 2018, from www.sciencedaily.com/releases/2010/10/101006131203.htm.
- Ghisio, S., Coletta, P., Piana, S., Alborno, P., Volpe, G., Camurri, A., … Bergamaschi, V. (2015, June). An open platform for full body interactive sonification exergames. In 2015 Seventh International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN) (pp. 168–175). Washington, DC: IEEE.Google Scholar
- Guth, D., & LaDuke, R. (1994). The veering tendency of blind pedestrians: An analysis of the problem and literature review. Journal of Visual Impairment & Blindness, 88, 391–400.Google Scholar
- Juul, J. (2011). Half-real: Video games between real rules and fictional worlds. Cambridge, MA: MIT Press.Google Scholar
- Kallie, C. S., Schrater, P. R., & Legge, G. E. (2007). Variability in stepping direction explains the veering behavior of blind walkers. Journal of Experimental Psychology: Human Perception and Performance, 33(1), 183.Google Scholar
- Lee, H. P., Huang, Y. H., & Sheu, T. F. (2013). An interactive training game using 3D sound for visually impaired people. International Association for Development of the Information Society.Google Scholar
- Lionello, M., Mandanici, M., Canazza, S., & Micheloni, E. (2017). Interactive soundscapes: Developing a physical space augmented through dynamic sound rendering and granular synthesis. In Proceedings of the 14th Sound and Music Computing Conference.Google Scholar
- Loomis, J. M., Klatzky, R. L., Golledge, R. G., & Philbeck, J. W. (1999). Human navigation by path integration. In Wayfinding behavior: Cognitive mapping and other spatial processes (pp. 125–151). Baltimore, MD: Johns Hopkins University Press.Google Scholar
- Magnusson, C., Rydeman, B., Finocchietti, S., Cappagli, G., Porquis, L. B., Baud-Bovy, G., & Gori, M. (2015, August). Co-located games created by children with visual impairments. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (pp. 1157–1162). New York, NY: ACM.Google Scholar
- Mandanici, M., Rodà, A., Canazza, S., & Cavagnoli, G. (2017, November). Following the cuckoo sound: A responsive floor to train blind children to avoid veering. In International Conference on Smart Objects and Technologies for Social Good (pp. 11–20). Cham: Springer.Google Scholar
- Merabet, L., & Sánchez, J. (2009). Audio-based navigation using virtual environments: Combining technology and neuroscience. AER Journal: Research and Practice in Visual Impairment and Blindness, 2(3), 128–137.Google Scholar
- Michael, D. R., & Chen, S. L. (2005). Serious games: Games that educate, train, and inform. New York, NY: Muska & Lipman/Premier-Trade.Google Scholar
- Morelli, T., Foley, J., Columna, L., Lieberman, L., & Folmer, E. (2010, June). VI-Tennis: A vibrotactile/audio exergame for players who are visually impaired. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (pp. 147–154). New York, NY: ACM.Google Scholar
- Nazemi, M. M. (2014). Affective soundscape composition for evoking sonic immersion. Journal of Sonic Studies, 7. Retrieved June 17, 2018, from https://www.researchcatalogue.net/view/88051/88052/11/1762.
- Ricketts, L. (2008, Fall). OTR, Texas School for the Blind and Visually Impaired. Texas Sense Abilities. Retrieved July 29, 2018, from http://www.tsbvi.edu/deaf-blind-project/3159-occupational-therapy-and-sensory-integration%2D%2Dvisual-impairment.
- Sánchez, J., Sáenz, M., & Garrido, J. M. (2010). Usability of a multimodal video game to improve navigation skills for blind children. ACM Transactions on Accessible Computing (TACCESS), 3(2), 7.Google Scholar
- Spagnol, S., Wersényi, G., Bujacz, M., Bălan, O., Herrera Martínez, M., Moldoveanu, A., & Unnthorsson, R. (2018). Current use and future perspectives of spatial audio technologies in electronic travel aids. Wireless Communications and Mobile Computing, 2018, 3918284.Google Scholar
- Tröster, H., & Brambring, M. (1994). The play behavior and play materials of blind and sighted infants and preschoolers. Journal of Visual Impairment & Blindness, 88(5), 421–432.Google Scholar
- Truax, B. (2001). Acoustic communication (Vol. 1). Westport, CT: Greenwood Publishing Group.Google Scholar
- Viega, M. (n.d.). Listening in the ambient mode: Implications for music therapy practice and theory. Retrieved from https://doi.org/10.15845/voices.v14i2.778
- Wii Remote. (2018, December). Retrieved December 18, 2018, from https://en.wikipedia.org/wiki/Wii_Remote.