Abstract
From a cognitive standpoint, the analysis of music in audiovisual contexts presents a helpful field in which to explore the links between musical structure and emotional response.
This work emerges from an empirical study that shows strong evidence in support of the effect of tonal dissonance level on interpretations regarding the emotional content of visual information.
From this starting point the article progresses toward the design of interactive multimedia tools aimed at investigating the various ways in which music may shape the semantic processing of visual contexts. A pilot experiment (work in progress) using these tools to study the emotional effects of sensory dissonance is briefly described.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Boltz, M.G.: Musical Soundtracks as a Schematic Influence on the Cognitive Processing of Filmed Events. Music Perception 18, 427–454 (2001)
Cohen, A.J.: Music as a source of emotion in film. In: Juslin, P., Sloboda, J. (eds.) Music and Emotion, pp. 249–272. Oxford University Press, Oxford (2001)
Cohen, A.J.: How music influences the interpretation of film and Video: Approaches from experimental psychology. In: Kendall, R.A., Savage, R.W. (eds.) Selected Reports in Ethnomusicology: Perspectives in Systematic Musicology, vol. 12, pp. 15–36 (2005)
Bharucha, J.J.: Anchoring effects in music: The resolution of dissonance. Cognitive Psychology 16, 485–518 (1984)
Lerdahl, F., Krumhansl, C.L.: Modeling tonal tension. Music Perception 24, 329–366 (2007)
Helmholtz, H.L.F.: On the Sensation of Tone as a Physiological Basis for the Theory of Music. Dover, New York (1954) (Original German work published 1863)
Meyer, L.B.: Emotion and meaning in music. University of Chicago Press, Chicago (1956)
Bigand, E., Parncutt, R., Lerdahl, F.: Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training. Perception & Psychophysics 58, 124–141 (1996)
Bigand, E., Parncutt, R.: Perception of musical tension in long chord sequences. Psychological Research 62, 237–254 (1999)
Krumhansl, C.L.: A perceptual analysis of Mozart’s Piano Sonata, K. 282: Segmentation, tension and musical ideas. Music Perception 13, 401–432 (1996)
Steinbeis, N., Koelsch, S., Sloboda, J.A.: The role of harmonic expectancy violations in musical emotions: Evidence from subjective, physiological, and neural responses. Journal of Cognitive Neuroscience 18(8), 1380–1393 (2006)
Riemann, H.: Harmony simplified. Augener, London (1896); Bewerung, H. (Trans.) (Original work published 1893)
Koechlin, C.: Traité de l’harmonie. Max Eschig, Paris (1930)
Schenker, H.: Free Composition. Longman, New York (1979); Oster, E. (Trans.) (Original work published 1935)
Hindemith, P.: UnterweisungimTonsatz, vol. 3. Schott, Mainz (1937-1970); English edition, as The Craft of Musical Composition, vol. 1: Theoretical Part. Associated Music Publishers, London (1942); Mendel, A. (Trans.)
Costère, E.: Lois et styles des harmonies musicales. Presses Universitaires de France, Paris (1954)
Rameau, J.P.: Treatise of Harmony. Dover, New York (1971); Gosset, P. (Trans.) (Original work published 1722)
Ansermet, E.: Les fondements de la musiquedans la consciencehumaine. Delachaux et Niestle, Neuchâtel (1961)
Bravo, F.: The influence of music on the emotional interpretation of visual contexts. Master’s Thesis, AAT 1494771, Iowa State University, United States (2011)
Blood, A.J., Zatorre, R.J., Bermudez, P., Evans, A.C.: Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2, 382–387 (1999)
Forte, A.: The Structure of Atonal Music. University Press, Yale (1973)
Plomp, R., Levelt, W.J.M.: Tonal consonance and the critical bandwidth. Journal of the Acoustical Society of America 38, 548–560 (1965)
Vos, J., Vianen, B.G.: Thresholds for discrimination between pure and tempered intervals: The relevance of nearly coinciding harmonics. Journal of the Acoustical Society of America 77, 76–187 (1984)
DeWitt, L.A., Crowder, R.G.: Tonal fusion of consonant musical intervals. Perception & Psychophysics 41, 73–84 (1987)
Barthet, M., Depalle, P., Kronland-Martinet, R., Ystad, S.: From clarinet control to timbre perception. Acta Acustica United with Acustica 96, 678–689 (2010)
Barthet, M., Depalle, P., Kronland-Martinet, R., Ystad, S.: Acoustical correlates of timbre and expressiveness in clarinet performance. Music Perception 28, 135–153 (2010)
Paraskeva, S., McAdams, S.: Influence of timbre, presence/absence of tonal hierarchy and musical training on the perception of tension/relaxation schemas of musical phrases. In: Proceedings of the 1997 International Computer Music Conference, Thessaloniki, pp. 438–441 (1997)
Strauss, J.N.: Introduction to Post-Tonal Theory. Prentice-Hall, Cliffs (1990)
Sloboda, J.A.: Music structure and emotional response: Some empirical findings. Psychology of Music 19, 110–120 (1991)
Krumhansl, C.L.: An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology 51(4), 336–352 (1997)
Gabrielsson, A., Juslin, P.N.: Emotional expression in music. In: Goldsmith, H.H., Davidson, R.J., Scherer, K.R. (eds.) Handbook of Affective Sciences, pp. 503–534. Oxford University Press, New York (2003)
Gomez, P., Danuser, B.: Affective and physiological responses to environmental noises and music. International Journal of Psychophysiology 53(2), 91–103 (2004)
Koelsch, S., Fritz, T., von Cramon, Y., Müller, K., Friederici, A.: Investigating emotion with music: an fMRI study. Human Brain Mapping 27(3), 239–250 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bravo, F. (2013). The Influence of Music on the Emotional Interpretation of Visual Contexts. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds) From Sounds to Music and Emotions. CMMR 2012. Lecture Notes in Computer Science, vol 7900. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41248-6_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-41248-6_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41247-9
Online ISBN: 978-3-642-41248-6
eBook Packages: Computer ScienceComputer Science (R0)