Re-sequencing the Ludic Orchestra

Evaluating the Immersive Effects of Dynamic Music and Situational Context in Video Games
  • Hans-Peter GasselsederEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9186)


A growing number of video games utilize structural and expressive methods to implement music dramaturgy ‘dynamically’ into a non-linear and immersive format. Nevertheless little is known about these musically supported immersive experiences and their processing at the user end. Accordingly, this paper studies the effects of dynamic music on attention allocation and subsequent cognitive-emotional involvement. Self-report data is presented from 60 subjects playing an action-adventure in dynamic as well as static music conditions with low and high arousal expression. The dynamic condition systematically affected imaginary components of immersive experience. Design recommendations for flow and self-location are given with regards to task context and regulatory effects of emotion experience.


Dynamic music Games Immersion Presence Flow Emotion 


  1. 1.
    Anderson, C.A., et al.: Violent video game effects on aggression, empathy, and prosocial behavior in Eastern and Western Countries. Psychol. Bull. 136(2), 151–173 (2010)CrossRefGoogle Scholar
  2. 2.
    Atkinson, R.C., Shiffrin, R.M.: Human Memory. In: Spence, K.W., Spence, J.T. (eds.) The Psychology of Learning and Motivation, vol. 2. Academic Press, New York (1968)Google Scholar
  3. 3.
    Boltz, M.G., Ebendorf, B., Field, B.: Audiovisual interactions: the impact of visual information on music perception and memory. Music Percept. 27(1), 43–59 (2009)CrossRefGoogle Scholar
  4. 4.
    Bruner, J.: Actual Minds, Possible Worlds. Harvard University, Cambridge (1986)Google Scholar
  5. 5.
    Bruner, J.S., Postman, L.: On the perception of incongruity. J. Pers. 18, 206–223 (1949)CrossRefGoogle Scholar
  6. 6.
    Cohen, A.J.: Music as a source of emotion in film. In: Juslin, P., Sloboda, J. (eds.) Music and Emotion. Oxford University Press, Oxford (2001)Google Scholar
  7. 7.
    Csikszentmihalyi, M.: Flow. Harper and Row, New York (1991)Google Scholar
  8. 8.
    Decety, J., Grèzes, J.: The power of simulation: imagining one’s own and other’s behavior. Brain Res. 1079, 4–14 (2006)CrossRefGoogle Scholar
  9. 9.
    Ermi, L., Mäyrä, F.: Fundamental components of the gameplay experience. In: de Castell, S., Jenson, J. (eds.) Proceedings of the 2005 DiGRA Conference, pp. 15–27 (2005)Google Scholar
  10. 10.
    Gasselseder, H.-P.: Re-orchestrating game drama. Diploma Thesis, Department of Psychology, Paris-Lodron University of Salzburg, Austria (2012)Google Scholar
  11. 11.
    Gaver, W.W., Mandler, G.: Play it again. Sam. Cogn. Emot. 1, 259–282 (1987)CrossRefGoogle Scholar
  12. 12.
    Grimshaw, M., Lindley, C.A., Nacke, L.: Sound and immersion in the first-person shooter. In: Proceedings of Audio Mostly, Piteå, Sweden, 22–23 October 2008Google Scholar
  13. 13.
    IJsselsteijn, W., et al.: Characterising and measuring user experiences. In: ACE Conference 2007, Salzburg, Austria, 15–17 June 2007Google Scholar
  14. 14.
    Jeannerod, M.: The Cognitive Neuroscience of Action. Blackwell, Oxford (1997)Google Scholar
  15. 15.
    Juslin, P.N., Lindström, E.: Musical expression of emotions. Music Anal. Musical Expr. Emot. 29(1–3), 334–364 (2011)Google Scholar
  16. 16.
    Klimmt, C., et al.: Identification with video game characters as automatic shift of self-perceptions. Media Psychol. 13(4), 323–338 (2010)CrossRefGoogle Scholar
  17. 17.
    Koster, R.: Theory of Fun for Game Design. Paraglyph Press, Phoenix (2005)Google Scholar
  18. 18.
    Maasø, A.: Synchronisieren ist unnorwegisch [Dubbing is atypical norwegian]. Montage AV 9(1), 147–171 (2000)MathSciNetGoogle Scholar
  19. 19.
    Nagel, F., Kopiez, R., Grewe, O., Altenmüller, E.: EMuJoy. Behav. Res. Methods 39(2), 283–290 (2007)CrossRefGoogle Scholar
  20. 20.
    Örtqvist, D., Liljedahl, M.: Immersion and gameplay experience. Int. J. Comput. Games Technol. 2010, 1–11 (2010). Article ID 613931CrossRefGoogle Scholar
  21. 21.
    Petrini, K., Crabbe, F., Sheridan, C., Pollick, F.E.: The music of your emotions. PloS One 6, 4 (2011). CrossRefGoogle Scholar
  22. 22.
    Poels, K., de Kort, Y., IJsselsteijn, W.: It is always a lot of fun! In: FuturePlay Conference, Toronto, Canada, 15–17 November 2007Google Scholar
  23. 23.
    Popper, A.N., Fay, R.R.: Evolution of the ear and hearing. Brain Behav. Evol. (Issues and questions) 50(4), 213–220 (1997)CrossRefGoogle Scholar
  24. 24.
    Robillard, G., Bouchard, S., Fournier, T., Renaud, P.: Anxiety and presence during VR immersion. CyberPsychol. Behav. 6(5), 467–476 (2003)CrossRefGoogle Scholar
  25. 25.
    Rocksteady. Batman: Arkham City. Warner Bros. Interactive, Burbank, CA (2011)Google Scholar
  26. 26.
    Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psy. 39, 1161–1178 (1980)CrossRefGoogle Scholar
  27. 27.
    Spence, C., Driver, J.: Audiovisual links in exogenous covert spatial attention. Percept. Psychophys. 59, 1–22 (1997)CrossRefGoogle Scholar
  28. 28.
    Stevens, R., Raybould, D.: Designing a game for music. Integrated design approaches for ludic music and interactivity. In: Collins, K., Kapralos, B., Tessler, H. (eds.) Oxford Handbook of Interactive Audio. Oxford University Press, Oxford (2012)Google Scholar
  29. 29.
    Vorderer, P., et al.: Development of the MEC Spatial Presence Questionnaire, MEC-SPQ. Report for the European Comission. IST Programme ‘Presence Research Activites’ (2004)Google Scholar
  30. 30.
    Wirth, W., et al.: A process model of the formation of spatial presence experiences. Media Psychol. 9, 493–525 (2007)CrossRefGoogle Scholar
  31. 31.
    Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments. Presence Teleoperators Virtual Environ. 7(3), 225–240 (1998)CrossRefGoogle Scholar
  32. 32.
    Zwaan, R.A.: Situation models. Current Dir. Psy. Sci 8, 15–18 (1999)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Communication and PsychologyAalborg UniversityAalborgDenmark

Personalised recommendations