Movement-Based and Tangible Interactions to Offer Body Awareness to Children with Autism

  • Rodrigo Zalapa
  • Monica Tentori
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8276)


Children with autism have sensory processing disorders impairing their ability of having awareness of their body and movementsso theyfrequently exhibit “atypical” body-interactions they useas “compensatory movements”. In this paper, we explore how tangible computing could offer to children with autism the body awareness they need during sensory therapies. We describe the design and development of Sensory Paint, a system that enables children with autism to control a multisensory environment using body-based and tangible interactions. Sensory Paint displays the shadow of the user to provide “biofeedback,” monitors users’ “atypical movements” to adjust the instrumental music playing in the background, and tracks users’ interactions with balls to change colors. Sensory Paint uses the kinect sensor and computer vision techniques for recognizing user interactions. The results of a performance evaluation of the use of SensoryPaint with 10 users shows SensoryPaint is accurate, easy to use, fun, and engaging.


Tangible computing movement-based interactions autism object recognition Kinect 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Leekam, S., Nieto, C., Libby, S., Wing, L., Gould, J.: Describing the Sensory Abnormalities of Children and Adults with Autism. J. Autism Dev. Disord. 37(5), 894–910 (2007)CrossRefGoogle Scholar
  2. 2.
    Tomchek, S.D., Dunn, W.: Sensory processing in children with and without autism: a comparative study using the short sensory profile. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 61(2), 190–200 (2007)CrossRefGoogle Scholar
  3. 3.
    Ornitz, E.M.: The modulation of sensory input and motor output in autistic children. J. Autism Dev. Disord. 4(3), 197–215 (1974)CrossRefGoogle Scholar
  4. 4.
    Beaudry Bellefeuille, I.: Un trastorno en el procesamiento sensorial es frecuentemente la causa de problemas de aprendizaje, conducta y coordinación motriz en niños. SCCALP / ERGON 46(197) (July 2006)Google Scholar
  5. 5.
    Parés, N., Carreras, A., Durany, J., Ferrer, J., Freixa, P., Gómez, D., Kruglanski, O., Parés, R., Ribas, J.I., Soler, M., Sanjurjo, À.: Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. In: IDC, New York, NY, USA, pp. 110–116 (2005)Google Scholar
  6. 6.
    Vaucelle, C., Bonanni, L., Ishii, H.: Design of haptic interfaces for therapy. In: Proceedings of CHI, New York, NY, USA, pp. 467–470 (2009)Google Scholar
  7. 7.
    Berrios, C.D., Jacobowitz, W.H.: Therapeutic holding: outcomes of a pilot study. J. Psychosoc. Nurs. Ment. Health Serv. 36(8), 14–18 (1998)Google Scholar
  8. 8.
    Jordà, S.: The reactable: tangible and tabletop music performance. In: CHI, New York, NY, USA, pp. 2989–2994 (2010)Google Scholar
  9. 9.
    Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In: TEI, New York, NY, USA, pp. 139–146 (2007)Google Scholar
  10. 10.
    Piper, A.M., Weibel, N., Hollan, J.: TAP & PLAY: an end-user toolkit for authoring interactive pen and paper language activities. In: CHI, New York, NY, USA, pp. 149–158 (2012)Google Scholar
  11. 11.
    Catalina, I., Monica, T.: Things that think for the cognitive skills training of students with autism. In: CHI EA 2012, Austin, TX, USA (2012)Google Scholar
  12. 12.
    Hernandez, H.A., Graham, T.C.N., Fehlings, D., Switzer, L., Ye, Z., Bellay, Q., Hamza, M.A., Savery, C., Stach, T.: Design of an exergaming station for children with cerebral palsy. In: CHI, New York, NY, USA, pp. 2619–2628 (2012)Google Scholar
  13. 13.
    Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly Media (2008)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Rodrigo Zalapa
    • 1
  • Monica Tentori
    • 1
  1. 1.Computer Science DepartmentCICESEMexico

Personalised recommendations