Advertisement

Sounding the Story: Music in Videogame Cutscenes

Chapter
Part of the International Series on Computer Entertainment and Media Technology book series (ISCEMT)

Abstract

Despite their ubiquity, cutscenes remain a relatively neglected element in videogame studies and especially in ludomusicological studies. This chapter considers the function of cutscenes and the role of music in them. Definitions of, and perspectives on, cutscenes are summarised. Models of immersion are then considered, with an emphasis on the role of cutscenes in enhancing or detracting from the same. Audio-visual synchresis is discussed, with a view to explicating narrative function and emotional affect in cutscenes. The chapter concludes with a provisional evaluation of the challenges posed and the potentials afforded by virtual-reality (VR) gaming, focusing on both the ramifications for cutscenes and also the use of music/audio.

References

  1. Berndt A., Hartmann K.: The Functions of Music in Interactive Media. In: Spierling, U., Szilas, N. (eds.) Interactive Storytelling. ICIDS 2008. Lecture Notes in Computer Science, vol 5334. Springer, Berlin, Heidelberg (2008)Google Scholar
  2. Bordwell, D., Thompson, K.: Film Art: An Introduction. McGraw-Hill, Boston (2008)Google Scholar
  3. Brown, E., Cairns, P.: A grounded investigation of immersion in games. In: (Proceedings) ACM Conference on Human Factors in Computing Systems, CHI (2004)Google Scholar
  4. Calleja, G.: In-Game: From Immersion to Incorporation. MIT Press, Cambridge, MA (2011)Google Scholar
  5. Calleja, G.: Erasing the magic circle. In: Sageng, J.R., Fossheim, H., Larsen, T.M. (eds.) The Philosophy of Computer Games. Springer, London (2012)Google Scholar
  6. Calleja, G., Herrewijn, L., Poels, K.: Affective involvement in digital games. In: Karpouzis, K., Yannakakis, G. (eds.) Emotion in Games. Socio-Affective Computing, vol 4. Springer, Cham (2016)Google Scholar
  7. Cheng, P.: Waiting for something to happen: narratives, interactivity and agency and the video game cut-scene. In: Proceedings of the 2007 DiGRA International Conference: Situated Play (2007)Google Scholar
  8. Chion, M.: Audio-Vision: Sound on Screens. Columbia University Press, New York (1994)Google Scholar
  9. Collins, K.: In the loop: creativity and constraint in 8-bit video game audio. twentieth-century music 4(2), 209-227 (2007)Google Scholar
  10. Collins, K.: Playing with Sound: A Theory of Interacting with Sound and Music in Video Games. MIT Press, Cambridge, MA (2013)Google Scholar
  11. Csikszentmihalyi, M.: Flow: The Psychology of Happiness. Rider, London (2002)Google Scholar
  12. Donnelly, K.J., Gibbons, W., Lerner, N. (eds.): Music in Video Games. Routledge, London (2014)Google Scholar
  13. Ermi, L., Mayra, F.: Fundamental components of the gameplay experience: analysing immersion. In: Proceedings of the 2005 DiGRA International Conference: Changing Views: Worlds in Play (2005)Google Scholar
  14. Eskelinen, M.: The gaming situation. Game Stud. 1(1). http://www.gamestudies.org/0101/eskelinen/ (2001)
  15. Fahlenbrach, K.: Affective spaces and audiovisual metaphors in video games. In: Perron, B., Schröter, F. (eds.) Video Games and the Mind: Essays on Cognition, Affect and Emotion. Macfarland, Jefferson, NC (2016)Google Scholar
  16. Fritsch, M.: History of video game music. In: Moormann, P. (ed.) Music and Game. Musik und Medien. Springer VS, Wiesbaden (2013)Google Scholar
  17. Gasselseder, H-P.: Re-scoring the game’s score: dynamic music, personality and immersion in the ludonarrative. IADIS International Journal on WWW/Internet 12(1), 17–34 (2014)Google Scholar
  18. Hancock, H.: Better game design through cutscenes. Gamasutra. https://www.gamasutra.com/view/feature/131410/better_game_design_through_.php?page=2 (2002)
  19. Hartmann, T., Wirth, W., Vorderer, P., et al. Spatial Presence Theory: State of the Art and Challenges Ahead. In: Lombard, M., Biocca, F., Freeman, J., et al (eds.) Immersed in Media. Springer, Cham (2015)Google Scholar
  20. Howells, S.: Watching a game, playing a movie: when media collide. In: King, G., Krzywinska, T. (eds.) ScreenPlay: Cinema/Videogames/Interfaces. Wallflower Press, New York (2002)Google Scholar
  21. Huizinga, J.: Homo Ludens. Beacon Press, Boston (1955)Google Scholar
  22. Ip, B.: Narrative structures in computer and video games: part 1 – context, definitions, and initial findings. Games and Cult. 6(2), 103–134 (2011a)CrossRefGoogle Scholar
  23. Ip, B.: Narrative structures in computer and video games: part 2 – emotions, structures, and archetypes. Games Cult. 6(3), 203–244 (2011b)CrossRefGoogle Scholar
  24. Jennett, C., Cox, A., Cairns, P., et al.: Measuring and defining the experience of immersion in games. In: International Journal of Human-Computer Studies 66(9), 641–661 (2008)Google Scholar
  25. Juslin, P.: Communicating emotion in music performance: a review and a theoretical framework. In: Juslin, P., Sloboda, J. (eds.) Music and Emotion: Theory and Research. Oxford, Oxford University Press (2001)Google Scholar
  26. Juul, J.: A Casual Revolution. MIT Press, Cambridge, MA (2010)Google Scholar
  27. Kamp, M.: Musical ecologies in video games. Philos. Technol. 27(2), 235–249 (2013)CrossRefGoogle Scholar
  28. King, G., Krzywinska, T. (eds.): Screenplay: Cinema/Videogames/Interfaces. Wallflower, London (2002)Google Scholar
  29. Klevjer, R.: In defense of cutscenes. In: Proceedings of Computer Games and Digital Cultures Conference. Tampere University Press, Tampere (2002)Google Scholar
  30. Lammes, S.: Spatial regimes of the digital playground: cultural functions of spatial identification in post-colonial computergames. In: Proceedings of Mediaterr@:Gaming Realities. A Challenge for Digital Culture. 236-243 (2006)Google Scholar
  31. Lankoski, P.: Computer games and emotion. In: Sageng, J., Fossheim, H., Larsen, T.M. (eds.) The Philosophy of Computer Games. Springer, Dordrecht (2012)Google Scholar
  32. Lerner, N.: Mario’s dynamic leaps: musical innovations (and the spectre of early cinema) in Donkey Kong and Super Mario Bros. In: Donnelly, K.J., Gibbons, W., Lerner, N. (eds.) Music in Video Games: Studying Play. Routledge, New York and London (2014)Google Scholar
  33. Loyer, E.: Parasocial and social player-avatar relationships: social others in Thomas was alone. Press Start. 2(1), 21–32 (2015)Google Scholar
  34. Madigan, J.: The Psychology of Immersion in Video Games. The Psychology of Video Games. http://www.psychologyofgames.com/2010/07/the-psychology-of-immersion-in-video-games (2010)Google Scholar
  35. Moberley, K.: Preemptive strikes: ludology, narratology, and deterrence in computer game studies. In: Thompson, J., Ouellette, M. (eds.) The Game Culture Reader. Newcastle-upon-Tyne, Cambridge Scholars Publishing (2013)Google Scholar
  36. Nacke, L., Lindley, C.: Affective ludology, flow and immersion in a first-person shooter: measurement of player experience. Loading… 3(5), 1–21 (2009)Google Scholar
  37. Newman, J.: Videogames. Routledge, London (2004)Google Scholar
  38. O’Grady, D.: Movies in the Gameworld: revisiting the video game cutscene and its temporal implications. In: Ouellette, M., Thompson, J. (eds.) The Game Culture Reader. Cambridge Scholars Publishing, Newcastle upon Tyne (2013)Google Scholar
  39. Perron, B., Schröter, F. (eds.): Video Games and the Mind: Essays on Coginition, Affect and Emotion. McFarland & Company, Jefferson, NC (2016)Google Scholar
  40. Phillips, W.: A Composer’s Guide to Game Music. MIT Press, Cambridge, MA (2014)Google Scholar
  41. Phillips, W.: Composing for virtual reality and interactive video game (interview). In: Scoreit Magazine. http://magazine.scoreit.org/interview-winifred-phillips-game-composer (2017)
  42. Rouse, R.: Embrace your limitations: cut-scenes in computer games. Comput. Graph. 7–10. http://dl.acm.org/citation.cfm?id=307713 (1998)
  43. Sageng, J.R., Fossheim, H., Larsen, T.M. (eds.): The Philosophy of Computer Games. Springer, New York (2012)Google Scholar
  44. Salen, K., Zimmerman, E.: Rules of Play. MIT Press, Cambridge, MA (2003)Google Scholar
  45. Seah, M., Cairns, P.: From immersion to addiction in videogames. In: Proceedings of the 22nd British HCI Group Annual (Vol.1) British Computer Society, 55–63 (2008)Google Scholar
  46. Sicart, M.: Digital games as ethical technologies. In: Sageng, J.R., Fossheim, H., Larsen, T.M. (eds.) The Philosophy of Computer Games. Springer, New York (2012)Google Scholar
  47. Smith, J.: Movie Music as Moving Music: Emotion, Cognition and the Film Score. In: Plantinga, C., Smith, G. (eds.) Passionate Views: Film, Cognition and Emotion. The John Hopkins Press, Baltimore (1999)Google Scholar
  48. Stenros, J.: In defence of a magic circle: the social, mental and cultural boundaries of play. In: Transactions of the Digital Games Research Association. Tampere University Press, Tampere (2014)Google Scholar
  49. Stevens, R., Raybould, D.: The reality paradox: authenticity, fidelity and the real in Battlefield 4. The Soundtrack 8(1), 57–75 (2015)Google Scholar
  50. Summers, T.: Understanding Video Game Music. Cambridge University Press, Cambridge (2016)CrossRefGoogle Scholar
  51. Tavinor, G.: Videogames and fictionalism. In: Fossheim, H., Mandt Larsen, T., Sageng, J.R. (eds.) The Philosophy of Computer Games. Springer, New York (2012)Google Scholar
  52. Taylor, T.: Play Between Worlds. Exploring Online Game Culture. MIT Press, Cambridge, MA (2006)Google Scholar
  53. Thon, J.-N.: Narrative comprehension and video game storyworlds. In: Perron, B., Schröter, F. (eds.) Video Games and the Mind: Essays on Cognition, Affect and Emotion. McFarland & Company, Jefferson, NC (2016)Google Scholar
  54. Van Elferen, I.: Analysing Game Musical Immersion: the ALI model. In: Kamp, M., Summers, T., Sweeney, M. (eds.) Ludomusicology: Approaches to Video Game Music. Equinox Publishing, Sheffield (2016)Google Scholar
  55. Warnke, M.: On the spot: the double immersion of virtual reality. In: Liptay, F., Dogramaci, B. (eds.) Immersion in the Visual Arts and Media. Brill, Leiden (2015)Google Scholar
  56. Weiss, M.: How videogames express ideas. In: DiGRA ‘03 – Proceedings of the 2003 DiGRA International Conference: Level Up (2003)Google Scholar
  57. Whalen, Z.: Play along – an approach to videogame music. Game Stud. Int. J. Comput. Game Res. 4(1). http://www.gamestudies.org/0401/whalen/ (2004)
  58. Wiebe, E., et al.: Measuring engagement in video game-based environments: Investigation of the User Engagement Scale. Computers in Human Behavior 32, 123–132 (2014)Google Scholar
  59. Willemsen, S., Kiss, M.: Unsettling melodies: a cognitive approach to incongruent film music. Acta Univ. Sapientiae Film Media Stud. 7, 169–183 (2013)Google Scholar
  60. Williams, D., et al.: A perceptual and affective evaluation of an affectively-driven engine for video game soundtracking. ACM Comput. Entertain. 14(3). https://cie.acm.org/articles/perceptual-and-affective-evaluation-affectively-driven-engine-video-game-soundtracking/ (2016)
  61. Wingstedt, J., et al.: Narrative music, visuals and meaning in film. Vis. Commun. 9(2), 193–210 (2001)CrossRefGoogle Scholar
  62. Zehnder, S., Lipscomb, S.: The role of music in video games. In: Vorderer, P., Bryant, J. (eds.) Playing Video Games: Motives, Responses and Consequences. London, Lawrence Erlbaum Associates (2006)Google Scholar
  63. Zhang, J., Fu, X.: The Influence of Background Music of Video Games on Immersion. Journal of Psychology & Psychotherapy 05(04), 1–7 (2015)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Department of MusicUniversity of LiverpoolLiverpoolUK

Personalised recommendations