Applying Game Mechanics to Networked Music HCI Systems

  • Anıl ÇamcıEmail author
  • Cem Çakmak
  • Angus G. Forbes
Part of the Springer Series on Cultural Computing book series (SSCC)


We discuss the use of game mechanics as a means to facilitate collaboration in networked music performances. We first look at core concepts of gaming and how these relate to musical creativity and performance. We offer an overview of various perspectives towards game mechanics and rule systems with examples from video games and musical practices. We then describe audiovisual software that we developed in order to study the integration of game-like elements and mechanics into networked music performance. Finally, we offer the results of a preliminary user study conducted using this system in private and public performance contexts. We observe that imposing various game mechanics upon a networked performance affects the nature of the musical collaboration as well as the audience’s attentiveness towards the performance.


  1. Abt C (1987) Serious games. University Press of AmericaGoogle Scholar
  2. Adams E (2013) Fundamentals of game design. Pearson EducationGoogle Scholar
  3. Alexandraki C, Akoumianakis D (2010) Exploring new perspectives in network music performance: the diamouses framework. Comput Music J 34(2):66–83CrossRefGoogle Scholar
  4. Berthaut F, Dahl L (2016) BOEUF: a unified framework for modeling and designing digital orchestras. In: Kronland-Martinet R, Aramaki M, Ystad S (eds) Music, mind, and embodiment. CMMR 2015. Lecture notes in computer science, vol 9617. Springer, ChamCrossRefGoogle Scholar
  5. Berthaut F, Marshall M, Subramanian S et al (2013) Rouages: revealing the mechanisms of digital musical instruments to the audience. In: Proceedings of the 2013 conference on new interfaces for musical expression, pp 164–169Google Scholar
  6. Blacking J (1969) The value of music in human experience. Yearb. Int. Folk Music Counc. 1:33–71CrossRefGoogle Scholar
  7. Blaine T, Fels S (2003) Contexts of collaborative musical experiences. In: Proceedings of the 2003 conference on new interfaces for musical expression, pp 129–134Google Scholar
  8. Bryan-Kinns N (2004) Daisyphone: the design and impact of a novel environment for remote group music improvisation. In: Proceedings of the 5th conference on designing interactive systems: processes, practices, methods, and techniques, pp 135–144Google Scholar
  9. Burk PL (2000) Jammin’ on the web a new client/server architecture for multiuser musical performance. In: Proceedings of the international computer music conference 2000Google Scholar
  10. Çakmak C, Çamcı A, Forbes AG (2016) Networked virtual environments as collaborative music spaces. In: Proceedings of the 2016 conference on new interfaces for musical expression, pp 106–111Google Scholar
  11. Çamcı A, Lee K, Roberts CJ et al (2017) INVISO: a cross-platform user interface for creating virtual sonic environments. In: Proceedings of 2017 symposium on user interface software technology (UIST)Google Scholar
  12. Çamcı A (2016) Imagining through sound: an experimental analysis of narrativity in electronic music. Organ. Sound 21(3):179–191CrossRefGoogle Scholar
  13. Coleman DV (1976) Biographical, personality, and situational determinants of leisure time expenditure: with specific attention to competitive activities (athletics) and to more cooperative activities (music). PhD thesis, Cornell UniversityGoogle Scholar
  14. Costikyan G (1994) I have no words and I must design. Interact Fantasy# 2 J Role-Play Story-Mak. SystGoogle Scholar
  15. Crawford C (1984) The art of computer game design. McGraw-HillGoogle Scholar
  16. Friberg A (1991) Generative rules for music performance: a formal description of a rule system. Comput. Music J. 15(2):56–71MathSciNetCrossRefGoogle Scholar
  17. Game, n1 (2017) In: OED Online. Oxford University Press. Accessed September 20, 2017Google Scholar
  18. Gurevich M (2006) Jamspace: designing a collaborative networked music space for novices. In: Proceedings of the 2006 conference on new interfaces for musical expression, pp 118–123Google Scholar
  19. Hamilton R, Platz C (2016) Gesture-based collaborative virtual reality performance in carillon. In: Proceedings of the 2016 international computer music conference, pp 337–340Google Scholar
  20. Hattwick I, Wanderley MM (2012) A dimension space for evaluating collaborative musical performance systems. In: Proceedings of the 2012 conference on new interfaces for musical expression, pp 21–23Google Scholar
  21. Huizinga J (1955) Homo Ludens: a study of the play-element in culture. Beacon paperbacks 15: Sociology, Beacon PressGoogle Scholar
  22. Jarvinen A (2008) Games without frontiers: theories and methods for game studies and design. PhD thesis, University of TampereGoogle Scholar
  23. Jordà S (2005) Multi-user instruments: models, examples and promises. In: Proceedings of the 2005 conference on new interfaces for musical expression, pp 23–26 (2005)Google Scholar
  24. Jordà S, Geiger G, Alonso M et al (2007) The reactable: exploring 
the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of the 1st international conference on tangible and embedded interaction, pp 139–146Google Scholar
  25. Juul J (2011) Half-real: video games between real rules and fictional worlds. MIT PressGoogle Scholar
  26. Lerdahl F, Jackendoff R (1985) A generative theory of tonal music. MIT pressGoogle Scholar
  27. Malloch J, Birnbaum D, Sinyor E et al (2006) Towards a new conceptual framework for digital musical instruments. In: Proceedings of the 9th international conference on digital audio effects, p 49–52Google Scholar
  28. McKinney C, McKinney C (2012) Oscthulhu: applying video game state-based synchronization to network computer music. In: Proceedings of the international computer music conference 2012Google Scholar
  29. Mechanics, n1 (2017) In: OED Online. Oxford University Press. Accessed September 5, 2017Google Scholar
  30. Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 101(2):343–352CrossRefGoogle Scholar
  31. Miller K (2009) Schizophonic performance: guitar hero, rock band, and virtual virtuosity. J Soc Am Music 3(4):395–429CrossRefGoogle Scholar
  32. Moore S, Place TA (2001) Kromozone: a platform for networked multimedia performance. In: Proceeding of music without walls? Music without instruments?Google Scholar
  33. Murray J (1997) Hamlet on the Holodeck: the future of narrative in cyberspace. Free PressGoogle Scholar
  34. Parlett DS (1999) The Oxford history of board games. Oxford University PressGoogle Scholar
  35. Raffensperger PA (2013) Measuring and influencing sequential joint agent behaviours. PhD thesis, University of CanterburyGoogle Scholar
  36. Renaud A, Carôt A, Rebelo P (2007) Networked music performance: state of the art. In: Proceedings of the 30th audio engineering society conferenceGoogle Scholar
  37. Rohrer TP (2002) The debate on competition in music in the twentieth century. Update: Appl Res Music Educ 21(1):38–47Google Scholar
  38. Rohrhuber D, de Campo A (2004) Waiting and uncertainty in computer music networks. In: Proceedings of the international computer music conference 2004Google Scholar
  39. Rouse W, Boff K (2005) Organizational simulation: from modeling and simulation to games and entertainment. Wiley, Nova IorqueCrossRefGoogle Scholar
  40. Rowe MW (1992) The definition of game. Philosophy 67(262):467–479CrossRefGoogle Scholar
  41. Rudi J (2005) Computer music video: a composer’s perspective. Comput Music J 29(4):36–44CrossRefGoogle Scholar
  42. Salen K, Zimmerman E (2003) Rules of play: fundamentals of game design. MIT Press, CambridgeGoogle Scholar
  43. Sicart M (2008) Defining game mechanics. Game Stud 8(2):1–14Google Scholar
  44. Smirnov A (2013) Sound in Z: experiments in sound and electronic music in early 20th Century Russia. Koenig Books, LondonGoogle Scholar
  45. Suits B (2005) The grasshopper: games, life and utopia. Broadview PressGoogle Scholar
  46. Weinberg G (2005) Interconnected musical networks: toward a theoretical framework. Comput Music J 29(2):23–39CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of MichiganAnn ArborUSA
  2. 2.Rensselaer Polytechnic InstituteTroyUSA
  3. 3.University of CaliforniaSanta CruzUSA

Personalised recommendations