Skip to main content

Embodied Music Interaction: Creative Design Synergies Between Music Performance and HCI

  • Chapter
  • First Online:

Part of the book series: Palgrave Studies in Performance and Technology ((PSPT))

Abstract

In music performance, a range of novel digital musical interfaces (DMIs) has been explored that share both real-time and musical interaction. This chapter draws on the theoretical strand in the human-computer interaction (HCI) of  embodied interaction, a conceptual approach that is helpful for designing novel physical interactions and experiences. This chapter compares the design characteristics of tangible, mobile, wearable, gesture sensor-based, and laptop-based interaction from an embodied music interaction perspective, in which shareability, digital-physical coupling, materiality, and situatedness are important design aspects for music performance. This approach can be helpful for identifying the limitations of existing designs and potential new areas for development.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Bødker‚ Susanne. 2006. When Second Wave HCI Meets Third Wave Challenges. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction (NordiCHI ’06)‚ 1–8‚ Oslo‚ Norway.

    Google Scholar 

  • Bongers‚ Bert. 1998. An Interview with Sensorband. Computer Music Journal 22 (1): 13–24.

    Google Scholar 

  • Bongers, Bert. 2006. Interactivation—Towards an Ecology of People, Our Technological Environment, and the Arts. Amsterdam: Vrije Universiteit Amsterdam.

    Google Scholar 

  • Buxton, Bill. 1997. Artists and the Art of the Luthier. Computer Graphics: The SIGGRAPH Quarterly 31 (1): 10–11.

    Article  Google Scholar 

  • Chadabe, Joel. 1984. Interactive Composing: An Overview. Computer Music Journal 8 (1): 22–27.

    Article  Google Scholar 

  • Collins‚ Nick, Alex McLean‚ Julian Rohrhuber‚ and Adrian Ward. 2007. Live coding Techniques for Laptop Performance. Organised Sound 8 (3): 321–330.

    Google Scholar 

  • de Campo‚ Alberto. 2014. Republic: Collaborative Live Coding 2003–2013. In Collaboration and Learning through Live Coding 3 (9): 130–168‚ eds. A. Blackwell‚ A. McLean‚ J. Noble and J. Rohrhuber‚ 152–153. Dagstuhl‚ Germany: Dagstuhl Publishing.

    Google Scholar 

  • Dourish, Paul. 2001. Where the Action Is: Foundations of Embodied Interaction, Cambridge, MA: The MIT Press.

    Google Scholar 

  • Essl‚ George. 2010. The Mobile Phone Ensemble as Classroom. In Proceedings of the 2010 International Computer Music Conference (ICMC 2010)‚ 506–509‚ New York.

    Google Scholar 

  • Fels, Sidney. 2004. Designing for Intimacy: Creating New Interfaces for Musical Expression. Proceedings of the IEEE 92 (4): 672–685.

    Article  Google Scholar 

  • Gibson, James Jerome. 1966. The Senses Considered as Perceptual Systems. Boston: Houghton Mifflin.

    Google Scholar 

  • Gurevich, Michael, and A. Cavan Fyans. 2011. Digital Musical Interactions: Performer-system Relationships and their Perception by Spectators. Organised Sound 16 (02): 166–175.

    Article  Google Scholar 

  • Holland‚ Simon‚ Paul Marshall‚ Jon Bird‚ Sheep Dalton‚ Richard Morris‚ Nadia Pantidi‚ Yvonne Rogers‚ and Andy Clark. 2009. Running up Blueberry Hill: Prototyping Whole Body Interaction in Harmony Space. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI ’09)‚ 93–98‚ Cambridge‚ UK.

    Google Scholar 

  • Holland‚ Simon‚ Katie Wilkie‚ Paul Mulholland‚ and Allan Seago‚ eds. 2013. Music and Human-Computer Interaction. London: Springer-Verlag.

    Google Scholar 

  • Ishii‚ Hiroshi‚ and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People‚ Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI ’97)‚ 234–241‚ Atlanta‚ GA.

    Google Scholar 

  • Jewitt‚ Carey‚ Anna Xambó‚ and Sara Price. 2016. Exploring Methodological Innovation in the Social Sciences: The Body in Digital Environments and the Arts. International Journal of Social Research Methodology 20(1): 105–120.

    Google Scholar 

  • Jordà, Sergi. 2005. Digital Lutherie Crafting Musical Computers for New Musics’ Performance and Improvisation. Barcelona (Spain): Universitat Pompeu Fabra.

    Google Scholar 

  • Jordà, Sergi. 2008. On Stage: The Reactable and Other Musical Tangibles Go Real. International Journal of Arts and Technology 1 (3/4): 268–287.

    Article  Google Scholar 

  • Lee‚ Sang Won‚ and Jason Freeman. 2013. Echobo: A Mobile Music Instrument Designed for Audience to Play. In Proceedings of the 13th International Conference on New Interfaces for Musical Expression (NIME ’13)‚ 450–455‚ Daejeon‚ Korea.

    Google Scholar 

  • Minuto‚ Andrea‚ Dhaval Vyas‚ Wim Poelman‚ and Anton Nijholt. 2012. Smart Material Interfaces: A Vision. In Intelligent Technologies for Interactive Entertainment‚ eds. A. Nijholt‚ H. Hondorp and D. Reidsma‚ 57–62. Berlin: Springer.

    Google Scholar 

  • Miranda, Eduardo Reck, and Marcelo M. Wanderley. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Middleton, WI: A-R Editions.

    Google Scholar 

  • Roma‚ Gerard‚ Anna Xambó‚ and Jason Freeman. 2017. Handwaving: Gesture Recognition for Participatory Mobile Music. In Proceedings of the Audio Mostly 2017 (AM ’17)‚ London.

    Google Scholar 

  • Serra, Xavier, Marc Leman, and Gerhard Widmer. 2007. A Roadmap for Sound and Music Computing. The S2S Consortium.

    Google Scholar 

  • Shaer, Orit, and Eva Hornecker. 2009. Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction 3 (1–2): 1–137.

    Google Scholar 

  • Smith, Art. 1969. Art Smith‚ Jewelry. New York: Museum of Contemporary Crafts of the American Crafts Council.

    Google Scholar 

  • Starner, Thad. 2014. How Wearables Worked their Way into the Mainstream. IEEE Pervasive Computing 4: 10–15.

    Article  Google Scholar 

  • Suchman, Lucy. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Tanaka‚ Atau. 2004. Mobile Music Making. In Proceedings of the 2004 Conference on New Interfaces for Musical Expression (NIME ’04)‚ 154–156‚ Hamamatsu‚ Japan.

    Google Scholar 

  • Wang‚ Ge‚ Nicholas Bryan‚ Jieun Oh‚ and Rob Hamilton. 2009. Stanford Laptop Orchestra (SLOrk). In Proceedings of the 2009 International Computer Music Conference (ICMC 2009)‚ 505–508‚ ICMC 2009 Montreal‚ Quebec‚ Canada.

    Google Scholar 

  • Weinberg, Gil, and Seum-Lim Gan. 2001. The Squeezables: Toward an Expressive and Interdependent Multi-player Musical Instrument. Computer Music Journal 25 (2): 37–45.

    Article  Google Scholar 

  • Weiser, Mark. 1991. The Computer for the 21st Century. Scientific American 265 (3): 94–104.

    Article  Google Scholar 

  • Xambó, Anna, Gerard Roma, Laney Robin, Chris Dobbyn, and Sergi Jordà. 2014. SoundXY4: Supporting Tabletop Collaboration and Awareness with Ambisonics Spatialisation. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME ‘14), 249–252, London.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anna Xambó .

Editor information

Editors and Affiliations

Copyright information

© 2017 The Author(s)

About this chapter

Cite this chapter

Xambó, A. (2017). Embodied Music Interaction: Creative Design Synergies Between Music Performance and HCI. In: Broadhurst, S., Price, S. (eds) Digital Bodies. Palgrave Studies in Performance and Technology. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-349-95241-0_14

Download citation

Publish with us

Policies and ethics