Abstract
In this paper we introduce a multi-modal database for the analysis of human interaction, in particular mimicry, and elaborate on the theoretical hypotheses of the relationship between the occurrence of mimicry and human affect. The recorded experiments are designed to explore this relationship. The corpus is recorded with 18 synchronised audio and video sensors, and is annotated for many different phenomena, including dialogue acts, turn-taking, affect, head gestures, hand gestures, body movement and facial expression. Recordings were made of two experiments: a discussion on a political topic, and a role-playing game. 40 participants were recruited, all of whom self-reported their felt experiences. The corpus will be made available to the scientific community.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pantic, M., Gunes, H.: Automatic, dimensional and continuous emotion recognition. Int’l. Journal of Synthetic Emotion 1(1), 68–99 (2010)
Vinciarelli, A., Dielmann, A., Favre, S., Salamin, H.: A database of political debates for analysis of social interactions. In: IEEE Int’l. Conf. Affective Computing and Intelligent Interfaces, vol. 2, pp. 96–99 (2009)
Savran, A., Ciftci, K., Chanel, G., Mota, J., Viet, L.H., Sankur, B., Akarun, L., Caplier, A., Rombaut, M.: Emotion detection in the loop from brain signals and facial images. eNTERFACE report (2006)
Lichtenauer, J., Valstar, M., Jie, S., Pantic, M.: Cost-effective solution to synchronized audio-visual capture using multiple sensors. In: IEEE Int’l. Conf. Advanced Video and Signal Based Surveillance, pp. 324–329 (2009)
Gatica-Perez, D.: Automatic nonverbal analysis of social interaction in small groups: A review. Image and Vision Computing 27(12), 1775–1787 (2009)
McKeown, G., Valstar, M.F., Cowie, R., Pantic, M.: The SEMAINE corpus of emotionally coloured character interactions. In: IEEE Conf. Multimedia and Expo, pp. 1079–1084 (2010)
Littlewort, G., Bartlett, M.S., Fasel, I., Susskind, J., Movellan, J.: Dynamics of facial expression extracted automatically from video. In: IEEE Int’l. Computer Vision and Pattern Recognition Workshop, pp. 80–80 (2004)
Coan, J., Allen, J.: Handbook of Emotion Elicitation and Assessment. Oxford University Press, Oxford (2007)
Devillers, L., Vidrascu, L., Lamel, L.: Challenges in real life emotion annotation and machine learning based detection. Neural Networks 18(4), 407–422 (2005)
Carletta, J.: Unleashing the killer corpus: experiences in creating the multi-everything AMI meeting corpus. Language Resources and Evaluation 41(2), 181–190 (2007)
Athanaselis, T., Bakamidis, S., Dologlou, I., Cowie, R., Douglas-Cowie, E., Cox, C.: ASR for emotional speech: Clarifying the issues and enhancing performance. Neural Networks 18(4), 437–444 (2005)
Tiedens, L.Z., Fragale, A.R.: Power moves: Complementarity in dominant and submissive nonverbal behaviour. J. of Personality & Social Psychology 84(3), 558–568 (2003)
Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.C., Devillers, L., Abrilian, S., Batliner, A., Amir, N., Karpouzis, K.: The Humaine database: Addressing the collection and annotation of naturalistic and induced emotional data. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 488–500. Springer, Heidelberg (2007)
Brass, M., Bekkering, H., Prinz, W.: Movement observation affects movement execution in a simple response task. Acta Psychologica 106(1-2), 3–22 (2001)
Catmur, C., Walsh, V., Heyes, C.: Sensorimotor learning configures the human mirror system. Current Biology 17(17), 1527–1531 (2007)
Estow, S., Jamieson, J.P., Yates, J.R.: Self-monitoring and mimicry of positive and negative social behaviors. J. of Research in Personality 41(2), 425–433 (2007)
Heider, J.D., Skowronski, J.J.: Ethnicity-based similarity and the chameleon effect. Austin State University (2008) (manuscript)
Van Swol, L.M.: The effects of nonverbal mirroring on perceived persuasiveness, agreement with an imitator, and reciprocity in a group discussion. Communication Research 30(4), 461–480 (2003)
Baaren van, R.B., Fockenberg, D.A., Holland, R.W., Janssen, L., van Knippenberg, A.: The moody chameleon: the effect of mood on non-conscious mimicry. Social Cognition 24(4), 426–437 (2006)
van Baaren, R.B., Holland, R.W., Steenaert, B., Van Knippenberg, A.: Mimicry for money: Behavioral consequences of imitation. J. of Experimental Social Psychology 39(4), 393–398 (2003)
van Baaren, R.B., Horgan, T.G., Chartrand, T.L., Dijkmans, M.: The forest, the trees and the chameleon: Context dependence and mimicry. J. of Personality and Social Psychology 86(3), 453–459 (2004)
Lakin, J.L.: Exclusion and nonconscious behavioral mimicry: The role of belongingness threat. Ph.D. dissertation (2003)
Lakin, J.L., Chartrand, T.L.: Exclusion and Nonconscious Behavioral Mimicry. In: The Social Outcast: Ostracism, Social Exclusion, Rejection, and Bullying, pp. 279–295. Psychology Press, New York (2005)
Maurer, R.E., Tindall, J.H.: Effect of postural congruence on client’s perception of counselor empathy. Journal of Counseling Psychology 30, 158–163 (1983)
Bavelas, J.B., Black, A., Lemery, C.R., Mullett, J.: I show how you feel: Motor mimicry as a communicative act. J. of Personality and Social Psychology 50, 322–329 (1986)
Chartrand, T.L., Jefferis, V.E.: Consequences of automatic goal pursuit and the case of nonconscious mimicry, pp. 290–305. Psychology Press, Philadelphia (2003)
Chartrand, T.L., Maddux, W.W., Lakin, J.L.: Beyond the perception-behavior link: The ubiquitous utility and motivational moderators of nonconscious mimicry. In: Unintended Thought II: The New Unconscious, pp. 334–361. Oxford University Press, New York (2005)
MacDonald, G., Leary, M.R.: Why does social exclusion hurt? The relationship between social and physical pain. Psychological Bulletin 131, 202–223 (2005)
Lakin, J.L., Chartrand, T.L.: Using nonconscious behavioural mimicry to create affiliation and rapport. Psychology Science 14(4), 334–339 (2003)
Lichtenauer, J., Shen, J., Valstar, M.F., Pantic, M.: Cost-effective solution to synchronized audio-visual data capture using multiple sensors, Report, Imperial College London (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, X., Lichtenauer, J., Valstar, M., Nijholt, A., Pantic, M. (2011). A Multimodal Database for Mimicry Analysis. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6974. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24600-5_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-24600-5_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24599-2
Online ISBN: 978-3-642-24600-5
eBook Packages: Computer ScienceComputer Science (R0)