Abstract
An empirical study on the perceived semantic quality of musical content and its relationship with perceived structural audio features is presented. In a first study, subjects had to judge a variety of musical excerpts using adjectives describing different emotive/affective/expressive qualities of music. Factor analysis revealed three dimensions, related to valence, activity and interest. In a second study, semantic judgements were then compared with automated and manual structural descriptions of the musical audio signal. Applications of the results in domains of audio-mining, interactive multimedia and brain research are straightforward.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balaban, M., Ebcioglu, K., Laske, O. (eds.): Understanding music with AI: Perspectives on music cognition. The MIT Press, Cambridge (1992)
Broeckx, J.: Muziek, ratio en affect: Over de wisselwerking van rationeel denken en affectief beleven bij voortbrengst en ontvangst van muziek. Metropolis, Antwerpen (1981)
Cambouropoulos, E.: Melodic cue abstraction, similarity and category formation: A computational approach. Music Perception 18(3), 347–370 (2000)
Camurri, A., De Poli, G., Leman, M.: MEGASE: a multisensory expressive gesture applications system environment for artistic performances. In: Proceedings of CAST 2001 - Living in mixed reality - Conference on communication of art, science and technology, Schloss Birlinghoven, Sankt Augustin, September 21-22, Fraunhofer-Institute for Media Communication IMK, Bonn (2001)
Camurri, A., Ferrentino, P.: Interactive environments for music and multimedia. Multimedia Systems 7, 32–47 (1999)
Coker, W.: Music and meaning - a theoretical introduction to musical aesthetics. The Free Press, New York (1972)
Cytowic, R.: Synesthesia. Springer, Heidelberg (1989)
De Poli, G., Piccialli, A., Roads, C. (eds.): Representations of musical signals. The MIT Press, Cambridge (1991)
Eerola, T., Jarvinen, T., Louhivuori, J., Toiviainen, P.: Statistical features and perceived similarity of folk melodies. Music Perception 18(3), 275–296 (2001)
Gabrielsson, A.: Adjective ratings and dimension analysis of auditory rhythm patterns. Scandinavian Journal of Psychology 14, 244–260 (1973)
Godøy, R., Jørgensen, H. (eds.): Musical imagery. Swets & Zeitlinger, Lisse. Haus, G (ed.), Music processing. Madison. Oxford University Press & A-R Editions, Wisconsin (2001)
Hevner, K.: Experimental studies of the elements of expression in music. American Journal of Psychology 48, 246–248 (1936)
Janata, P., Birk, J., Van Horn, J., Leman, M., Tillmann, B., Bharucha, J.: The cortical topography of cognitive structures underlyingwestern tonal music. Science 298, 2167–2170 (2002)
Juslin, P., Sloboda, J. (eds.): Music and emotion - theory and research. Oxford University Press, New York (2001)
Laban, R.: Modern educational dance. MacDonald & Evans, London (1963)
Leman, M. (ed.): Music, Gestalt, and computing - studies in cognitive and systematic musicology. Springer, Heidelberg (1997)
Leman, M.: An auditory model of the role of short-term memory in probe-tone ratings. Music Perception 17(4), 481–509 (2000)
Leman, M.: Musical audio-mining. In: Meij, J. (ed.) Dealing with the data flood: Mining data, text and multimedia, STT Netherlands Study Centre for Technology Trends, The Hague (2002)
Leman, M., Clarisse, L., De Baets, B., De Meyer, H., Lesaffre, M., Martens, G., Martens, J., Steelant, D.V.: Tendencies, perspectives, and opportunities of musical audio-mining. In: Calvo-Manzano, A., Pérez-López, A., Santiago, J.S. (eds.) Forum Acusticum Sevilla 2002, September 16-20, Sociedad Española de Acústica -SEA, Madrid (2002); Special issue of Journal Revista de Acústica, vol. XXXIII(3-4)
Leman, M., Lesaffre, M., Tanghe, K.: A toolbox for perception-based music analysis. Ghent: IPEM - Dept. of Musicology, Ghent University (2001), http://www.ipem.ugent.be/toolbox
Leman, M., Vermeulen, V., De Voogdt, L., Taelman, J., Moelants, D.: Acoustical and computational modelling of musical affect perception (submitted)
Lesaffre, M., Leman, M., Tanghe, K., De Baets, B., De Meyer, H., Martens, J.: User dependent taxonomy of musical features as a conceptual framework for musical audio-mining technology. In: Bresin, R. (ed.) Proceedings of the Stockholm Music Acoustics Conference (SMAC 2003), Royal Institute of Technology (KTH), August 6-9, pp. 635–638 (2003)
Marsden, A., Pople, A.: Towards a connected distributed model of musical listening. Interface - Journal of New Music Research 18(1-2), 61–72 (1989)
Nielzén, S., Cesarec, Z.: On the perception of emotional meaning in music. Psychology of music 9, 17–31 (1981)
Osgood, C., Suci, G., Tannenbaum, P.: The measurement of meaning. University of Illinois Press, Urbana (1957)
Roads, C., De Poli, G., Pope, S.: Musical signal processing. Swets & Zeitlinger, The Netherlands (1997)
Scherer, K.: Vocal communication of emotion: A review of research paradigms. Speech Communication 40, 227–256 (2003)
Terhardt, E.: Ein psychoakustisch begrúndetes konzept der musikalischen konsonanz. Acustica 36, 122–137 (1976)
Todd, P., Loy, D.: Music and connectionism. The MIT Press, Cambridge (1991)
Van Immerseel, L., Martens, J.: Pitch and voiced/unvoiced determination with an auditory model. The Journal of the Acoustical Society of America 91, 3511–3526 (1992)
van Noorden, L., Moelants, D.: Resonance in the perception of musical pulse. Journal of New Music Research 28(1), 43–66 (1999)
Wedin, L.: Multidimensional scaling of emotional expression in music. Swedish Journal of Musicology 54, 1–17 (1972)
Zannos, I. (ed.): Music and signs – semiotic and cognitive studies in music. ASKO Art & Science, Bratislava (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Leman, M., Vermeulen, V., De Voogdt, L., Taelman, J., Moelants, D., Lesaffre, M. (2004). Correlation of Gestural Musical Audio Cues and Perceived Expressive Qualities. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-24598-8_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21072-6
Online ISBN: 978-3-540-24598-8
eBook Packages: Springer Book Archive