Surprisal, Liking, and Musical Affect
Formulation and processing of expectation has long been viewed as an essential component of the emotional, psychological, and neurological response to musical events. There are multiple theories of musical expectation, ranging from a broad association between expectation violation and musical affect to precise descriptions of neurocognitive networks that contribute to the perception of surprising stimuli. In this paper, we propose a probabilistic model of musical expectation that relies on the recursive updating of listeners’ conditional predictions of future events in the musical stream. This model is defined in terms of cross-entropy, or information content given a prior model. A probabilistic program implementing some aspects of this model with melodies from Bach chorales is shown to support the hypothesized connection between the evolution of surprisal through a piece and affective arousal, indexed by the spread of possible deviations from the expected play count.
KeywordsAffect Entropy Music Perception Probabilistic programming Surprisal
My thanks to Noah Goodman, Ben Peloquin, Robert Hawkins, Malcolm Slaney, and Jonathan Berger for their assistance in the development and implementation of this research.
- Baron, J.H.: Intimate Music: A History of the Idea of Chamber Music. Pendragon Press, Stuyvesant (1998)Google Scholar
- Bhatia, V.K.: Worlds of Written Discourse: A Genre-Based View. Continuum International, London (2004)Google Scholar
- Elfeky, M.G., Aref, W.G., Elmagarmid, A.K.: WARP: time warping for periodicity detection. In: Fifth IEEE International Conference on Data Mining (ICDM 2005), p. 8, November 2005. https://doi.org/10.1109/ICDM.2005.152
- Frow, J.: Genre: The New Critical Idiom. Routledge, New York (2005)Google Scholar
- Holzapfel, A., Stylianou, Y.: Rhythmic similarity of music based on dynamic periodicity warping. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2217–2220, March 2008. https://doi.org/10.1109/ICASSP.2008.4518085
- Meyer, L.B.: Emotion and Meaning in Music. University of Chicago Press, Chicago (1956)Google Scholar
- Sapp, C.S.: Online database of scores in the Humdrum file format. In: ISMIR, pp. 664–665 (2005)Google Scholar