Multimodality Issues in Conversation Analysis of Greek TV Interviews

  • Maria Koutsombogera
  • Harris Papageorgiou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5398)


This paper presents a study on multimodal conversation analysis of Greek TV interviews. Specifically, we examine the type of facial, hand and body gestures and their respective communicative functions in terms of feedback and turn management. Taking into account previous work on the analysis of non-verbal interaction, we describe the tools and the coding scheme employed, we discuss the distribution of the features of interest and we investigate the effect of the situational and conversational interview setting on the interactional behavior of the participants. Finally, we conclude with comments on future work and exploitation of the resulting resource.


non-verbal/multimodal expressions feedback turn management conversation analysis interview corpus 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ekman, P.: Emotional and Conversational Nonverbal Signals. In: Messing, L.S., Campbell, R. (eds.) Gesture, Speech and Sign, pp. 45–55. Oxford University Press, London (1999)CrossRefGoogle Scholar
  2. 2.
    Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge (2004)CrossRefGoogle Scholar
  3. 3.
    MacNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)Google Scholar
  4. 4.
    Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A.: The HUMAINE Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 488–500. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  5. 5.
    Poggi, I., Pelachaud, C., Magno Caldognetto, E.: Gestural Mind Markers in ECAs. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915, pp. 338–349. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Vilhjalmsson, H.: Augmenting Online Conversation through Automated Discourse Tagging. In: 6th annual minitrack on Persistent Conversation at the 38th HICSS, Hawaii (2005)Google Scholar
  7. 7.
    Heritage, J.: Conversation Analysis and Institutional Talk. In: Sanders, R., Fitch, K. (eds.) Handbook of Language and Social Interaction, pp. 103–146. Lawrence Erlbaum, New Jersey (2005)Google Scholar
  8. 8.
    Ilie, C.: Semi-institutional Discourse: The Case of Talk Shows. Journal of Pragmatics 33, 209–254 (2001)CrossRefGoogle Scholar
  9. 9.
    Poggi, I., Magno Caldognetto, E.: A Score for the Analysis of Gestures in Multimodal Communication. In: Messing, L.S. (ed.) Proceedings of the Workshop on the Integration of Gesture and Language in Speech, Applied Science and Engineering Laboratories, pp. 235–244. Newark and Wilmington, Del (1996)Google Scholar
  10. 10.
    Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN Coding Scheme for the Annotation of Feedback, Turn Management and Sequencing Phenomena. Multimodal Corpora for Modeling Human Multimodal Behaviour. Journal on Language Resources and Evaluation 41(3-4), 273–287 (2007)Google Scholar
  11. 11.
    Papageorgiou, H., Prokopidis, P., Protopapas, A., Carayannis, G.: Multimedia Indexing and Retrieval Using Natural Language, Speech and Image Processing Methods. In: Stamou, G., Kollias, S. (eds.) Multimedia Content and the Semantic Web: Methods, Standards and Tools, pp. 279–297. Wiley, Chichester (2005)CrossRefGoogle Scholar
  12. 12.
    Georgantopoulos, B., Goedemé, T., Lounis, S., Papageorgiou, H., Tuytelaars, T., Van Gool, L.: Cross-media summarization in a retrieval setting. In: LREC 2006 Workshop on Crossing media for improved information access, pp. 41–49 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Maria Koutsombogera
    • 1
    • 2
  • Harris Papageorgiou
    • 1
  1. 1.Institute for Language & Speech Processing, Artemidos 6&EpidavrouAthensGreece
  2. 2.Department of LinguisticsUniversity of AthensAthensGreece

Personalised recommendations