Abstract
In this research we investigate the relationship between emotion and cooperation in dialogue tasks. It is an area were still many unsolved questions are present. One of the main open issues is the labeling of “blended” emotions and their recognition. Usually there is a low agreement among raters in labeling and naming emotions and surprisingly emotion recognition is higher in a condition of modality deprivation (only acoustic or only visual vs. bimodal). Because of this previous results we don’t ask raters to directly label emotions, but to use a small set of features (as lips or eyebrows shape) to annotate our corpus. The analyzed materials come from an audiovisual corpus of Map Task dialogues elicited with a script. We point out the “emotive” tokens by simultaneous recordings of the phsychophysiological indexes (ElectroCardioGram ECG, Galvanic Skin Conductance GSC, ElectroMyoGraphy EMG). After this selection we annotate each token with our multimodal annotation scheme. Each annotation will lead to a cluster of signals identifying the emotion corresponding to a cooperative/non cooperative level; the last step involves agreement among coders and reliability of the emotion description. Future research will deal with brain imaging experiment on the effect of putting emotions into words and the role of context in emotion recognition.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Anderson, A., Bader, M., Bard, E., Boyle, E., Doherty, G.M., Garrod, S., Isard, S., Kowtko, J., McAllister, J., Miller, J., Sotillo, C., Thompson, H.S., Weinert, R.: The HCRC Map Task Corpus. Language and Speech 34, 351–366 (1991)
Anderson, J.C., Linden, W., Habra, M.E.: The importance of examining blood pressure reactivity and recovery in anger provocation research. International Journal of Psychophysiology 57, 159–163 (2005)
Cacioppo, J.T., Berntson, G.G., Larsen, J.T., Poehlmann, K.M., Ito, T.A.: The psychophysiology of emotion. In: Lewis, M., Haviland, J.M. (eds.) Handbook of emotions 2nd, pp. 173–191. The Guilford Press, New York (2000)
Craggs, R., Wood, M.: A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue. In: Proceedings of the Tutorial and Research Workshop on Affective Dialogue Systems, pp. 89–100 (2004)
Martin, J.-C., Caridakis, G., Devillers, L., Karpouzis, K., Abrilian, S.: Manual Annotation and Automatic Image Processing of Multimodal Emotional Behaviors: Validating the Annotation of TV Interviews. In: Fifth international conference on Language Resources and Evaluation, Genoa, Italy (2006)
Feldman Barrett, L., Lindquist, K.A., Gendron, M.: Language as Context for the Perception of Emotion. Trends in Cognitive Sciences 11(8), 327–332 (2007)
Smith, M.L., Cottrell, G.W., Gosselin, F., Schyns, P.G.: Transmitting and Decoding Facial Expressions. Psychological Science 16(3), 184–189 (2005)
Susskind, J.M., Littlewort, G., Bartlett, M.S., Movellan, J., Anderson, A.K.: Human and computer recognition of facial expressions of emotion. Neuropsychologia 45, 152–162 (2007)
Rodríguez, K., Stefan, K.J., Dipper, S., Götze, M., Poesio, M., Riccardi, G., Raymond, C., Wisniewska, J.: Standoff Coordination for Multi-Tool Annotation in a Dialogue Corpus. In: Proceedings of the Linguistic Annotation Workshop at the ACL 2007, Prague, Czech Republic (2007)
Davies, B.L.: Testing dialogue principles in task-oriented dialogues: An exploration of cooperation, collaboration, effort and risk. Leeds Working Papers in Linguistics and Phonetics, 11 (2006)
McNeill, D.: Gesture and thought. University of Chicago Press, Chicago (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cavicchio, F., Poesio, M. (2008). Annotation of Emotion in Dialogue: The Emotion in Cooperation Project. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds) Perception in Multimodal Dialogue Systems. PIT 2008. Lecture Notes in Computer Science(), vol 5078. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69369-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-69369-7_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69368-0
Online ISBN: 978-3-540-69369-7
eBook Packages: Computer ScienceComputer Science (R0)