Audio-Video Analysis of Musical Expressive Intentions
This paper presents a preliminary study on the relation between audio-video streams and high-level information related to expressive nuances. A violinist was asked to play three musical excerpts several times, each one inspired by one of nine different expressive intentions. Perceptual tests was carried out using both audio-only and audio-visual recordings of the performances. The results demonstrate that the visual component aids the subjects to better recognize the different expressive intentions of the musical performances, showing that the fusion of audio-visual information can significantly improve the degree of recognition given by single means.
- 3.Canazza, S., De Poli, G., Rodà, A.: Analysis of expressive intentions in piano performance. Journal of ITC Sangeet Research Academy 16, 23–62 (2002)Google Scholar
- 7.Juslin, P.N., Sloboda, J.A.: Music and emotion. Theory and research. Oxford University Press, Oxford (2001)Google Scholar
- 8.Kirke, A., Miranda, E.R.: A survey of computer systems for expressive music performance. ACM Computing Surveys 42(1) (2009)Google Scholar