Skip to main content

Towards a Participatory Approach for Interaction Design Based on Conceptual Metaphor Theory: A Case Study from Music Interaction

  • Chapter
  • First Online:
Music and Human-Computer Interaction

Part of the book series: Springer Series on Cultural Computing ((SSCC))

Abstract

“Music Interaction” is the term for interaction design within the domain of music. In areas such as music, the ability to engage effectively in certain activities tends to be restricted to those who have acquired detailed knowledge of domain-specific theories, terminologies, concepts or processes. It can be challenging to design or enhance user interfaces for software able to support novices in these kinds of musical activities. One promising approach to this challenge involves translating musicians’ implicit domain knowledge into patterns known as conceptual metaphors, which are metaphorical extensions of recurring patterns of embodied experience applied to abstract domains, and using this information to inform interaction designs for music. This approach has been applied experimentally with some success to designing user interfaces. However, to the best of our knowledge, this present work is the first to consider in detail the use of Conceptual Metaphor Theory as a key component of a participatory design process. In this chapter we present a participatory approach to Music Interaction design based on the principles of Conceptual Metaphor Theory. We posit that such an approach will facilitate the development of innovative and intuitive interaction designs for both novices and experts alike.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Activision (2010). Guitar Hero. http://www.guitarhero.com/. Accessed Jan 2013.

  • Antle, A. N., Droumeva, M., & Corness, G. (2008). Playing with the sound maker: Do embodied metaphors help children learn? In Proceedings of the 7th international conference on Interaction design and children (pp. 178–185). Chicago: ACM.

    Google Scholar 

  • Antle, A. N., Corness, G., & Droumeva, M. (2009). Human-computer-intuition? Exploring the cognitive basis for intuition in embodied interaction. International Journal of Arts and Technology, 2(3), 235–254.

    Article  Google Scholar 

  • Apple Inc. (2009). Garage Band ‘09. http://www.apple.com/ilife/garageband/. Accessed Sept 2009.

  • Brower, C. (2000). A cognitive theory of musical meaning. Journal of Music Theory, 44(2), 323–379.

    Article  Google Scholar 

  • Eitan, Z., & Granot, R. Y. (2006). How music moves: Musical parameters and listeners’ images of motion. Music Perception, 23(3), 221–247.

    Article  Google Scholar 

  • Eitan, Z., & Timmers, R. (2010). Beethoven’s last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context. Cognition, 114(3), 405–422.

    Article  Google Scholar 

  • Holland, S. (1992). Interface design for empowerment: A case study from music. In S. Holland & A. Edwards (Eds.), Multimedia interface design in education. Heidelberg: Springer.

    Google Scholar 

  • Holland, S. (1994). Learning about harmony with Harmony Space: An overview. In G. Wiggins & M. Smith (Eds.), Music education: An artificial intelligence approach. Heidelberg: Springer.

    Google Scholar 

  • Holland, S., Marshall, P., Bird, J., Dalton, S. N., Morris, R., Pantidi, N., Rogers, Y., & Clark, A. (2009). Running up Blueberry Hill: Prototyping whole body interaction in harmony space. In Proceedings of the 3rd conference on tangible and embodied interaction (pp. 92–98). New York: ACM.

    Google Scholar 

  • Hurtienne, J., & Blessing, L. (2007). Design for intuitive use – Testing image schema theory for user interface design. In Proceedings of the 16th international conference on engineering design (pp. 1–12). Paris, France.

    Google Scholar 

  • Hurtienne, J., Israel, J. H., & Weber, K. (2008). Cooking up real world business applications combining physicality, digitality, and image schemas. In Proceedings of the 2nd international conference on tangible and embedded interaction (pp. 239–246). New York: ACM.

    Google Scholar 

  • Johnson, M. (1997). Embodied musical meaning. Theory and Practice, 22–23, 95–102.

    Google Scholar 

  • Johnson, M. (2005). The philosophical significance of image schemas. In B. Hampe & J. Grady (Eds.), From perception to meaning: Image schemas in cognitive linguistics (pp. 15–33). Berlin: Walter de Gruyter.

    Chapter  Google Scholar 

  • Johnson, M. L., & Larson, S. (2003). “Something in the Way She Moves” - Metaphors of Musical Motion. Metaphor and Symbol, 18(2), 63–84.

    Article  Google Scholar 

  • Kensing, F., & Blomberg, J. (1998). Participatory design: Issues and concerns. Computer Supported Cooperative Work, 7(3), 167–185.

    Article  Google Scholar 

  • Lakoff, G., & Johnson, M. (1999). Philosophy in the Flesh. New York: Basic Books.

    Google Scholar 

  • Lakoff, G., & Núñez, R. E. (2000). Where mathematics comes from. New York: Basic Books.

    MATH  Google Scholar 

  • Larson, S. (1997). Musical forces and melodic patterns. Theory and Practice, 22–23, 55–71.

    Google Scholar 

  • Nintendo (2008) Wii Music http://www.wiimusic.com/launch/index.html/. Accessed Feb 2012.

  • Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., & Carey, T. (1994). Human–Computer Interaction. London: Addison-Wesley.

    Google Scholar 

  • Rohrer, T. (2005). Image schemata in the brain. In B. Hampe & J. Grady (Eds.), From perception to meaning: Image schemata in cognitive linguistics. Berlin: Walter de Gruyter.

    Google Scholar 

  • Rohrer, T. (2007). The body in space: Dimensions of embodiment. In T. Ziemke, J. Zlatev, R. Frank, & R. Dirven (Eds.), Body, language, and mind: Embodiment (pp. 339–378). Berlin: Walter de Gruyter.

    Google Scholar 

  • Saslaw, J. K. (1996). Forces, containers, and paths: The role of body-derived image schemas in the conceptualization of music. Journal of Music Theory, 40(2), 217–243.

    Article  Google Scholar 

  • Saslaw, J. K. (1997). Life forces: Conceptual structures in Schenker’s free composition and Schoenberg’s the musical idea. Theory and Practice, 22–23, 17–34.

    Google Scholar 

  • Treglown, M. (1999). The role of metaphor in user interface design. Unpublished Ph.D. thesis. Milton Keynes, UK: The Open University.

    Google Scholar 

  • Wilkie, K., Holland, S., & Mulholland, P. (2009). Evaluating musical software using conceptual metaphors. In Proceedings of the 23rd British Computer Society conference on human computer interaction (pp. 232–237). British Computer Society.

    Google Scholar 

  • Wilkie, K., Holland, S., & Mulholland, P. (2010). What can the language of musicians tell us about music interaction design? Computer Music Journal, 34(4), 34–48.

    Article  Google Scholar 

  • Zbikowski, L. M. (1997a). Conceptual models and cross-domain mapping: New perspective on theories of music and hierarchy. Journal of Music Theory, 41(2), 193–225.

    Article  Google Scholar 

  • Zbikowski, L. M. (1997b). Des Herzraums Abschied: Mark Johnson’s theory of embodied knowledge and music theory. Theory and Practice, 22–23, 1–16.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katie Wilkie .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Wilkie, K., Holland, S., Mulholland, P. (2013). Towards a Participatory Approach for Interaction Design Based on Conceptual Metaphor Theory: A Case Study from Music Interaction. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_15

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2990-5_15

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2989-9

  • Online ISBN: 978-1-4471-2990-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics