Abstract
“Music Interaction” is the term for interaction design within the domain of music. In areas such as music, the ability to engage effectively in certain activities tends to be restricted to those who have acquired detailed knowledge of domain-specific theories, terminologies, concepts or processes. It can be challenging to design or enhance user interfaces for software able to support novices in these kinds of musical activities. One promising approach to this challenge involves translating musicians’ implicit domain knowledge into patterns known as conceptual metaphors, which are metaphorical extensions of recurring patterns of embodied experience applied to abstract domains, and using this information to inform interaction designs for music. This approach has been applied experimentally with some success to designing user interfaces. However, to the best of our knowledge, this present work is the first to consider in detail the use of Conceptual Metaphor Theory as a key component of a participatory design process. In this chapter we present a participatory approach to Music Interaction design based on the principles of Conceptual Metaphor Theory. We posit that such an approach will facilitate the development of innovative and intuitive interaction designs for both novices and experts alike.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Activision (2010). Guitar Hero. http://www.guitarhero.com/. Accessed Jan 2013.
Antle, A. N., Droumeva, M., & Corness, G. (2008). Playing with the sound maker: Do embodied metaphors help children learn? In Proceedings of the 7th international conference on Interaction design and children (pp. 178–185). Chicago: ACM.
Antle, A. N., Corness, G., & Droumeva, M. (2009). Human-computer-intuition? Exploring the cognitive basis for intuition in embodied interaction. International Journal of Arts and Technology, 2(3), 235–254.
Apple Inc. (2009). Garage Band ‘09. http://www.apple.com/ilife/garageband/. Accessed Sept 2009.
Brower, C. (2000). A cognitive theory of musical meaning. Journal of Music Theory, 44(2), 323–379.
Eitan, Z., & Granot, R. Y. (2006). How music moves: Musical parameters and listeners’ images of motion. Music Perception, 23(3), 221–247.
Eitan, Z., & Timmers, R. (2010). Beethoven’s last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context. Cognition, 114(3), 405–422.
Holland, S. (1992). Interface design for empowerment: A case study from music. In S. Holland & A. Edwards (Eds.), Multimedia interface design in education. Heidelberg: Springer.
Holland, S. (1994). Learning about harmony with Harmony Space: An overview. In G. Wiggins & M. Smith (Eds.), Music education: An artificial intelligence approach. Heidelberg: Springer.
Holland, S., Marshall, P., Bird, J., Dalton, S. N., Morris, R., Pantidi, N., Rogers, Y., & Clark, A. (2009). Running up Blueberry Hill: Prototyping whole body interaction in harmony space. In Proceedings of the 3rd conference on tangible and embodied interaction (pp. 92–98). New York: ACM.
Hurtienne, J., & Blessing, L. (2007). Design for intuitive use – Testing image schema theory for user interface design. In Proceedings of the 16th international conference on engineering design (pp. 1–12). Paris, France.
Hurtienne, J., Israel, J. H., & Weber, K. (2008). Cooking up real world business applications combining physicality, digitality, and image schemas. In Proceedings of the 2nd international conference on tangible and embedded interaction (pp. 239–246). New York: ACM.
Johnson, M. (1997). Embodied musical meaning. Theory and Practice, 22–23, 95–102.
Johnson, M. (2005). The philosophical significance of image schemas. In B. Hampe & J. Grady (Eds.), From perception to meaning: Image schemas in cognitive linguistics (pp. 15–33). Berlin: Walter de Gruyter.
Johnson, M. L., & Larson, S. (2003). “Something in the Way She Moves” - Metaphors of Musical Motion. Metaphor and Symbol, 18(2), 63–84.
Kensing, F., & Blomberg, J. (1998). Participatory design: Issues and concerns. Computer Supported Cooperative Work, 7(3), 167–185.
Lakoff, G., & Johnson, M. (1999). Philosophy in the Flesh. New York: Basic Books.
Lakoff, G., & Núñez, R. E. (2000). Where mathematics comes from. New York: Basic Books.
Larson, S. (1997). Musical forces and melodic patterns. Theory and Practice, 22–23, 55–71.
Nintendo (2008) Wii Music http://www.wiimusic.com/launch/index.html/. Accessed Feb 2012.
Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., & Carey, T. (1994). Human–Computer Interaction. London: Addison-Wesley.
Rohrer, T. (2005). Image schemata in the brain. In B. Hampe & J. Grady (Eds.), From perception to meaning: Image schemata in cognitive linguistics. Berlin: Walter de Gruyter.
Rohrer, T. (2007). The body in space: Dimensions of embodiment. In T. Ziemke, J. Zlatev, R. Frank, & R. Dirven (Eds.), Body, language, and mind: Embodiment (pp. 339–378). Berlin: Walter de Gruyter.
Saslaw, J. K. (1996). Forces, containers, and paths: The role of body-derived image schemas in the conceptualization of music. Journal of Music Theory, 40(2), 217–243.
Saslaw, J. K. (1997). Life forces: Conceptual structures in Schenker’s free composition and Schoenberg’s the musical idea. Theory and Practice, 22–23, 17–34.
Treglown, M. (1999). The role of metaphor in user interface design. Unpublished Ph.D. thesis. Milton Keynes, UK: The Open University.
Wilkie, K., Holland, S., & Mulholland, P. (2009). Evaluating musical software using conceptual metaphors. In Proceedings of the 23rd British Computer Society conference on human computer interaction (pp. 232–237). British Computer Society.
Wilkie, K., Holland, S., & Mulholland, P. (2010). What can the language of musicians tell us about music interaction design? Computer Music Journal, 34(4), 34–48.
Zbikowski, L. M. (1997a). Conceptual models and cross-domain mapping: New perspective on theories of music and hierarchy. Journal of Music Theory, 41(2), 193–225.
Zbikowski, L. M. (1997b). Des Herzraums Abschied: Mark Johnson’s theory of embodied knowledge and music theory. Theory and Practice, 22–23, 1–16.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Wilkie, K., Holland, S., Mulholland, P. (2013). Towards a Participatory Approach for Interaction Design Based on Conceptual Metaphor Theory: A Case Study from Music Interaction. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_15
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2990-5_15
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2989-9
Online ISBN: 978-1-4471-2990-5
eBook Packages: Computer ScienceComputer Science (R0)