Abstract
The chapter reviews methods of obtaining records that show signs of emotion. Concern with authenticity is central to the task. Converging lines of argument indicate that even sophisticated acting does not reproduce emotion as it appears in everyday action and interaction. Acting is the appropriate source for some kinds of material, and work on that topic is described. Methods that aim for complete naturalism are also described, and the problems associated with them are noted. Techniques for inducing emotion are considered under five headings: classical induction; physical induction; games; task settings; and conversational interactions. The ethical issues that affect area are outlined, and a framework for dealing with them is set out.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abassi AR, Uno T, Dailey M, Afzulpurkar NV (2007) Towards knowledge-based affective interaction: situational interpretation of affect. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon, September 2007. Springer LNCS, Berlin, pp 452–463
Amir N (2007) Emotional speech in a gambling game. In: Paper presented to the HUMAINE meeting on cross-cultural databases, Tel Aviv, Nov 2007
Ang J, Dhillon R, Krupski A, Shriberg E, Stolcke A (2002) Prosody-based automatic detection of annoyance and frustration in human–computer dialog. In: Proceedings ICSLP, Denver, CO, Sept 2002
Arnold MB (1960) Emotion and personality. Psychological aspects, vol 1. Columbia University Press, New York, NY
Aubergé V, Audibert N, Rilliard A (2004) E-Wiz: a trapper protocol for hunting the expressive speech corpora in lab. In: Proceedings of the 4th LREC, Lisbon, pp 179–182
Bachorowski J-A, Owren MJ (1995) Vocal expression of emotion: acoustic properties of speech are associated with emotional intensity and context. Psychol Sci 6:219–224
Bänziger T, Scherer K (2007) Using actor portrayal to systematically study multimodal emotional expression: the GEMEP corpus. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon, Sept 2007. Springer LNCS, Berlin, pp 476–487
Baron-Cohen S (2007) Mind reading: the interactive guide to emotions – version 1.3. Jessica Kingsley Publishers, London
Batliner A, Fischer K, Huber R, Spilker J, Nöth E (2003) How to find trouble in communication. Speech Commun 40:117–143
Batliner A, Hacker C, Steidl S, Nöth E, D’Arcy S, Russel M, Wong M (2004). “You stupid tin box” – children interacting with the AIBO robot: a cross-linguistic emotional speech corpus. In: Proceedings of the 4th international conference of language resources and evaluation (LREC 2004), Lisbon, pp 171–174
Batliner A, Hacker C, Steidl S, Noth E, Haas J (2003). User states, user strategies, and system performance: how to match the one with the other. In: Proceedings of the ISCA workshop on error handling in spoken dialogue systems, ISCA, Chateau d’Oex, pp 5–10
Bechara A, Damasio A, Damasio H, Anderson S (1994) Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50:7–15
Campbell N (2006) A language-resources approach to emotion: corpora for the analysis of expressive speech. In: Proceedings of the LREC workshop, Genoa, p 1
Camurri A, Castellano G, Cowie R, Glowinski D, Knapp B, Krumhansl CL, Villon O, Volpe G (2007) The Premio Paganini project: a multimodal gesture-based approach for explaining emotional processes in music performance. In: Proceedings of 7th international workshop on gesture in human–computer interaction and simulation 2007, Lisbon, May 2007
Carroll JM, Russell JA (1997) Facial expressions in Hollywood’s portrayal of emotion. J Pers Soc Psychol 72(1):164–176
Cowie R, McGuiggan A, McMahon E, Douglas-Cowie E (2003) Speech in the process of becoming bored. In: Proceedings of 15th international congress of phonetic sciences, Barcelona
Devillers L, Cowie R, Martin J-C, Douglas-Cowie E, Abrilian S, McRorie M (2006). Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches. In: Proceedings of the 5th international conference on language resources and evaluation (LREC 2006), Genoa
Devillers L, Vidrascu L (2005) Real-life emotion representation and detection in call centers data. ACII 2005, Beijing, pp 739–746
Devillers L, Vidrascu L, Lamel L (2005) Challenges in real-life emotion annotation and machine learning based detection. J Neural Netw (Special Issue: Emotion and Brain) 8(4):407–422
Douglas-Cowie E, Campbell N, Cowie R, Roach P (2003) Emotional speech: towards a new generation of databases. Speech Commun 40(1–2):33–60
Douglas-Cowie E, Cowie R, Sneddon I, Cox C, Lowry O, McRorie M, Martin J-C, Devillers L, Abrilian S, Batliner A, Amir N, Karpouzis K (2007) The HUMAINE database: addressing the collection and annotation of naturalistic and induced emotional data. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon, Sept 2007. Springer LNCS, Berlin, pp 488–500
Ekman P, Friesen W (1975) Pictures of facial affect. Consulting Psychologists’ Press, Palo Alto, CA
Enos F, Hirschberg J (2006) A framework for eliciting emotional speech: capitalizing on the actor’s process. In: Proceedings of the LREC workshop on corpora for research on emotion and affect, Genoa, May 2006, pp 6–10
Frigo S (2006) The relationships between acted and naturalistic emotional corpora. In: LREC workshop research on corpora on emotion and affect, Genoa
Gerrards-Hesse A, Spies K, Hesse FW (1994) Experimental inductions of emotional states and their effectiveness: a review. Br J Psychol 85:55–78
Kanade T, Tian Y, Cohn JF (2000) Comprehensive database for facial expression analysis. In: Proceedings of the 4th IEEE international conference on automatic face and gesture recognition 2000, Grenoble, France, pp 46–53
Kenealy P (1988) Validation of a music mood induction procedure: some preliminary findings. Cogn Emot 2:41–48
Kienast M, Sendlmeier WF (2000) Acoustical analysis of spectral and temporal changes in emotional speech. In: Cowie R, Douglas-Cowie E, Schroeder M (eds) Speech and emotion: proceedings of the ISCA workshop. Newcastle, County Down, Sept 2000, Belfast, Textflow, pp 92–97
Lang PJ, Bradley MM, Cuthbert BN (1999) International affective picture system IAPS: technical manual and affective ratings. The Center for Research in Psychophysiology, University of Florida, Gainesville, FL
McMahon E (forthcoming) The effect of a prior emotional state on driving. Thesis to be submitted for the degree of Ph.D., Queen’s University, Belfast
Merola G (2006) Gestures while reporting emotions. Third HUMAINE Summer School, Genova, Sept 2006. Downloaded from http://emotion-research.net/ws/summerschool3/GestEm2_Merola.pdf
Meyerhoff JL, Hansen JHL (2007) Methods and systems for detecting, measuring, and monitoring stress in speech. US Patent 7283962. Downloaded from http://www.freepatentsonline.com/7283962.html
Mitchell CJ, Menezes C, Williams JC, Pardo B, Erickson D, Fujimura O (2000) Changes in syllable and boundary strengths due to irritation. In: Douglas-Cowie E, Cowie R, Schroeder M (eds) Proceedings of the ISCA workshop on speech and emotion, Belfast, Textflow, pp 98–103
Poggi I, Federica Cavicchio F, Emanuela Magno Caldognetto EM (2005) Persuasive goals of irony in a political trial. Paper presented to Humaine: WP8 workshop, Trento, 17–18 Nov 2005
Polzin TS, Waibel A (2000) Emotion-sensitive human–computer interfaces. In: Douglas-Cowie E, Cowie R, Schroeder M (eds) Proceedings of the ISCA workshop on speech and emotion. Belfast, Textflow, pp 201–206
Rehm M, Wissner M (2005) Gamble – a multiuser game with an embodied conversational agent. In: Kishino F, Kitamura Y, Kato H, Nagata N (eds) Entertainment computing – ICEC 2005: 4th international conference. Springer, Berlin, pp 180–191
van Reekum CM, Johnstone T, Banse R, Etter A, Wehrle T, Scherer KR (2004) Psychophysiological responses to appraisal dimensions in a computer game. Cogn Emot 18:663–688
Varadarajan V, Hansen J, Ayako I (2006) UT-SCOPE – a corpus for speech under cognitive/physical task stress and emotion. In: Proceedings of the LREC workshop on corpora for research on emotion and affect, Genoa, May 2006, pp 72–75
Velten E (1968) A laboratory task for induction of mood states. Behav Res Ther 6:473–482
Walker MA, Passonneau R, Boland JE (2001) Quantitative and qualitative evaluation of Darpa Communicator spoken dialogue systems. In: Proceedings of the 39th annual meeting on association for computational linguistics, Toulouse, pp 515–522
Wang N, Marsella S (2006). Evg: an emotion evoking game. In: Proceedings of the 6th international conference on intelligent virtual agents, Marina del Rey, CA. Springer LNCS, Berlin, pp 282–291
Yale Face Database B (2001) http://cvc.yale.edu/projects/yalefacesB/yalefacesB.html
Zara A, Maffiolo V, Martin J-C, Devillers L (2007) Collection and annotation of a corpus of human–human multimodal interactions: emotion and other anthropomorphic characteristics. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon, Sept 2007. Springer LNCS, Berlin, pp 464–475
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Cowie, R., Douglas-Cowie, E., McRorie, M., Sneddon, I., Devillers, L., Amir, N. (2011). Issues in Data Collection. In: Cowie, R., Pelachaud, C., Petta, P. (eds) Emotion-Oriented Systems. Cognitive Technologies. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15184-2_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-15184-2_12
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15183-5
Online ISBN: 978-3-642-15184-2
eBook Packages: Computer ScienceComputer Science (R0)