Soundscapes/Artabilitation – Evolution of a Hybrid Human Performance Concept, Method & Apparatus Where Digital Interactive Media, The Arts, & Entertainment are Combined

  • A. L. Brooks


‘SoundScapes’ is a body of empirical research that for almost two decades has focused upon investigating noninvasive gesture control of multi-sensory stimuli and potential uses in therapy and the arts. In this context noninvasive gesture refers to motion in invisible activity zones of a system input device utilizing technology outside of human vision. Especially targeted are disabled people of all ages, and special focus has been on the profoundly impaired who especially have limited opportunities for creative self-articulation and playful interaction. The concept has been explored in various situations including: - live stage performances; interactive room installations for museums, workshops, and festivals; and in health-care sessions at hospitals, institutes and special schools. Multifaceted aspects continuously cross-inform in a systemic manner, and each situation where the motion-sensitive environment is applied is considered as a hybrid system. Whilst simplistic in concept, i.e. learning by playful and creative doings, inherent are complexities of optimizing the interactive system to user-experience and evaluation of same. This chapter presents the system in context to its conceived-for-target community; it also presents the parallel practice-led investigations in performance art. Reciprocal design and reflective cross-analysis of the activities has resulted such that performance informs design and strategies of intervention and evaluation with impaired users, and vice versa.


Disable People Infrared Sensor Robotic Device Rehabilitation Training Feedback Stimulus 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    K. E. Misulis. “Essentials of Clinical Neurophysiology.” Butterworth-Heinemann, 1997.Google Scholar
  2. 2.
    A. Lucier. “Statement On:luciermisulis Music for Solo Performer.” In: D. Rosenboom (Ed.), Biofeedback and the Arts, Results of Early Experiments. Aesthetic Research Center of Canada Publications, 1976.Google Scholar
  3. 3.
    D. Warner. “Rock ’n roll Science:warner Playing the Body Electric” [online] Available from
  4. 4.
    A. L. Brooks, A. Camurri, N. Canagarajah and S. Hasselblad. “Interaction with shapes and sounds as a therapy for special needs and rehabilitation.” In:brooks International Conference on Disability, Virtual Reality and Associated Technologies (4th). Veszprém, Hungary, 18–20 September. P. Sharkey, C. S. Lányi, and P. Standen, (Eds.). Reading: University of Reading, pp. 205–212, 2002.Google Scholar
  5. 5.
    A. L. Brooks. Robotic Synchronized to Human Gesture as a Virtual Coach in (Re)habilitation Therapy. In: 3rd International Workshop on Virtual Rehabilitation (IWVR2004), VRlab, EPFL, Lausanne, Switzerland, pp. 17–16, 2004.Google Scholar
  6. 6.
    E. Petersson and A. Brooks. Non-formal therapy and learning potentials through human gesture synchronized to robotic gesture. International Journal Universal Access in the Information Society. Springer 6(2), pp. 167–177, 2007.CrossRefGoogle Scholar
  7. 7.
    W. M. Marston. Emotions of Normal People, Routledge, 1928.Google Scholar
  8. 8.
    A. L. Brooks. SoundScapes: A concept of Virtual Interactive Space (V.I.S.) [unpublished]. World Summit for Social Development/NGO Forum 6–12 March, Holmen, Copenhagen, 1995.Google Scholar
  9. 9.
    A. L. Brooks. Virtual interactive space (V.I.S.) as a movement capture interface tool giving multimedia feedback for treatment and analysis. In: “Bridging Cultures” – program of The 13th International Congress of the World Confederation for Physical Therapy, Yokohama Japan, May 23–28, Science Links Japan:, 1999.
  10. 10.
    A. L. Brooks. Virtual interactive space (V.I.S.). In: ‘Pushing the limits: optimising potential through science and technology’, Congress Program and Abstract Book, 5th Scientific Congress, Sydney 2000 Paralympic Games, Oct. 11–13, Convention Centre, Darling Harbor, Sydney, Australia, 2000.Google Scholar
  11. 11.
    A. L. Brooks. HUMANICS 1 – a feasibility study to create a home internet based telehealth product to supplement acquired brain injury therapy. In: International Conference on Disability, Virtual Reality and Associated Technologies (5th). Oxford University, UK, 20–22 September 2004. Sharkey, P., McCrindle, R. and Brown, D. (eds.) Reading: University of Reading, pp. 43–50, 2004.Google Scholar
  12. 12.
    A. L. Brooks and E. Petersson. Recursive reflection and learning in raw data video analysis of interactive ‘play’ environments for special needs health care. In: Proceedings of 7th International Workshop on Enterprise networking and Computing in Healthcare Industry, Korea HEALTHCOM 2005, IEEE Signal Processing Society, USA, pp. 83–87, 2005.Google Scholar
  13. 13.
    A. L. Brooks and S. Hasselblad. Creating aesthetically resonant environments for the handicapped, elderly and rehabilitation: Sweden. Proceedings of 6th International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT), Esbjerg, Denmark, 18th–20th September, pp. 191–198, 2004.Google Scholar
  14. 14.
    A. L. Brooks. Enhanced Gesture Capture in Virtual Interactive Space. Computers in Art, Design, and Education (CADE), 29 June–01 July, Copenhagen Business School, Denmark and Malmö University, Sweden, 2004.Google Scholar
  15. 15.
    A. L. Brooks and E. Petersson. Stillness design attributes in non-formal rehabilitation: CADE2007 - Computers in Art Design and Education. Perth, Curtin University of Technology, pp. 36–44, 2007.Google Scholar
  16. 16.
    G. Goldkuhl and P. J. Ågerfalk. “Actability: A way to understand information systems pragmatics.” CMTO Research papers No. 2000:13, Linköping University. Presented at the 3rd International Workshop on Organisational Semiotics, 4 July 2000, Stafford, UK, 2000.Google Scholar
  17. 17.
    P. J. Ågerfalk and S. Cronholm. “Usability versus Actability: A Conceptual Comparative Analysis.” Presented at the HCI International conference New Orleans, USA, Lawrence Erlbaum and Associates, pp. 235–237, 2001.Google Scholar
  18. 18.
    A. N. Leont’ev. “Activity, consciousness and personality.” NJ: Prentice-Hall, Englewood Cliffs, 1981.Google Scholar
  19. 19.
    R. Davies. “Commentary on P. J. Standen and D. J. Brown – Virtual Reality in Rehabilitation of People with Intellectual Disabilities: Review.” CyberPsychology and Behavior, 8(3), 2005.Google Scholar
  20. 20.
    A. L. Brooks and E. Petersson. “Play Therapy Utilizing the Sony EyeToyⓇ.” In: Annual International Workshop on Presence (8th), London, 21–23 September 2005. Slater, M. (ed.) London: University College London, pp. 303–314, 2005.Google Scholar
  21. 21.
    C. Hummels, T. Djajadiningrapt, and K. Overbeeke. “Knowing, doing and feeling: Communicating with your digital products. Interdisziplinäres Kolleg Kognitions und Neurowissenschaften, Günne am Möhnesee, March 2–9, pp. 289–308, 2001.Google Scholar
  22. 22.
    B. Buxton. “Sketching User Experiences: getting the design right and the right design,” Elsevier, 2007.Google Scholar
  23. 23.
    M. Polanyi. “Personal Knowledge: Towards a Post-Critical Philosophy,” Routledge, 2002 [1958].Google Scholar
  24. 24.
    R. Wollheim. “Art and Its Objects,” 2nd ed., Cambridge University press, 1980.Google Scholar
  25. 25.
    P. Ellis. “Layered analysis: A video-based qualitative research tool to support the development of a new approach for children with special needs.” The Bulletin for the Council for Research in Music Education. University of Illinois at Urbana-Champaign, USA, 130, pp.65–74, 1996.Google Scholar
  26. 26.
    P. Ellis. “Caress – ‘an endearing touch’.” In: J. Siraj-Blatchford (ed.) Developing New Technologies for Young Children. London: Trentham Books, pp. 113–137, 2004.Google Scholar
  27. 27.
    A. Pollini, Experimenting with an Ubiquitous Computing Open Architecture, [PhD Thesis], 2008
  28. 28.
    E. Petersson and A. L. Brooks. ArtAbilitation{ $Ⓡ$}: An Interactive Installation for the Study of Action and Stillness Cycles in Responsive Environments. Computers in Art, Design, and Education (CADE 2007) eprogram&abstracts.pdf, 2007.
  29. 38.
    A. L. Brooks. Towards a platform of alternative and adaptive interactive systems for idiosyncratic special needs, Proc. 7th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies with ArtAbilitation, pp 319–326, Maia, Portugal, 8–11 Sept. 2008.Google Scholar
  30. 30.
    B. K. Wiederhold. Virtual Healers, International Association for CyberTherapy & Rehabilitation, 2007.Google Scholar
  31. 31.
    G. Kress and T. van Leeuwen. “Reading Images. The Grammar of Visual Design.” London, Routledge, 1996.Google Scholar
  32. 32.
    J. S. Bruner. “Nature and Uses of Immaturity.” In: J. S. Bruner, A. Jolly and K. Sylva (eds.), Play – Its Role in Development and Evolution. Basic Books, 1976Google Scholar
  33. 33.
    F. A. Beach. “Comparison of Copulatory Behavior of Male Rats Raised in Isolation, Cohabitation, and Segregation.” Journal of Genetic Psychology, 60, pp. 121–136, 1942.Google Scholar
  34. 34.
    Z. Yan and K. Fischer. “Always Under Construction: Dynamic variations in adult cognitive development,” Human Development, 45, pp. 141–160, 2002.CrossRefGoogle Scholar
  35. 35.
    M. Csikszentmihályi. Creativity: Flow and the Psychology of Discovery and Invention. New York: Harper Perennial, 1996.Google Scholar
  36. 36.
    J. Löwgren and E. Stolterman. Thoughtful Interaction Design, Boston, MIT, 2005.Google Scholar
  37. 37.
    B. Eaglestone and P. D. Bamidis. “Music composition for the multi-disabled: A systems perspective.” Disability Human Development, 7(1), pp. 19–24, 2008.Google Scholar
  38. 38.
    A. L. Brooks. Interpretations: inter-sensory stimulation concept targeting inclusive access offering appreciation of classical music for all ages, standing, & disability, Proc. 7th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies with ArtAbilitation, pp 15–22, Maia & Porto, Portugal, 8–11 Sept. 2008.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Department of MedialogyUniversity EsbjergAalborgDenmark

Personalised recommendations