Abstract
The participant in a human-to-human communication who controls the floor bears the burden of moving the communication process along. Change in control of the floor can happen through a number of mechanisms, including interruptions, delegation of the floor, and so on. This paper investigates floor control in multiparty meetings that are both audio and video taped; hence, we are able to analyze patterns not only of speech (e.g., discourse markers) but also of visual cues (e.g, eye gaze exchanges) that are commonly involved in floor control changes. Identifying who has control of the floor provides an important focus for information retrieval and summarization of meetings. Additionally, without understanding who has control of the floor, it is impossible to identify important events such as challenges for the floor. In this paper, we analyze multimodal cues related to floor control in two different meetings involving five participants each.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge Univ. Press, Cambridge (1976)
Bosch, L., Oostdijk, N., Ruiter, J.P.: Durational aspects of turn-taking in spontaneous face-to-face and telephone dialogues. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2004. LNCS, vol. 3206, pp. 563–570. Springer, Heidelberg (2004)
Burger, S., MacLaren, V., Yu, H.: The ISL meeting corpus: The impact of meeting type on speech type. In: Proc. of Int. Conf. on Spoken Language Processing (ICSLP) (2002)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E.: Embodied Conversational Agents. MIT Press, Cambridge
Kimbara, I., Welji, H., Harper, M., Quek, F., McNeill, D., Duncan, S., Tuttle, R., Huang, T.: VACE multimodal meeting corpus. In: Renals, S., Bengio, S. (eds.) MLMI 2005. LNCS, vol. 3869, pp. 40–51. Springer, Heidelberg (2006)
Duncan, S.: Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23, 283–292 (1972)
Ford, C.E., Thompson, S.A.: Interactional units in conversation: syntactic, intonational, and pragmatic resources for the management of turns. In: Ochs, T., Schegloff (eds.) Interaction and Grammar. Cambridge Univ. Press, Cambridge (1996)
Garofolo, J., Laprum, C., Michel, M., Stanford, V., Tabassi, E.: The NIST Meeting Room Pilot Corpus. In: Proc. of Language Resource and Evaluation Conference (2004)
Jovanovic, N., Akker, R.: Towards automatic addressee identification in multi-party dialogues. In: Proceedings of SIGDial (2004)
Jovanovic, N., Akker, R., Nijholt, A.: A corpus for studying addressing behavior in multi-party dialogues. In: Proc. of SIGdial Workshop on Discourse and Dialogue (2005)
Jurafsky, D., Rebecca, B., et al.: Automatic detection of discourse structure for speech recognition and understanding. In: Proc. of IEEE Workshop on Speech Recognition and Understanding (1997)
Kipp, M.: Anvil: A generic annotation tool for multimodal dialogue. In: Proc. of European Conf. on Speech Processing (EuroSpeech) (2001)
Liu, Y.: Structural Event Detection for Rich Transcription of Speech. Ph.D thesis, Purdue University (2004)
Local, J., Kelly, J.: Projection and ’silences’: Notes on phonetic and conversational structure. Human Studies 9, 185–204 (1986)
McCowan, I., Gatica-Perez, D., Bengio, S., Lathoud, G., Barnard, M., Zhang, D.: Automatic analysis of multimodal group actions in meetings. IEEE Trans. on Pattern Analysis and Machine Intelligence 27(3), 305–317 (2005)
Morgan, N., et al.: Meetings about meetings: Research at ICSI on speech in multiparty conversations. In: Proc. of ICASSP, Hong Kong, vol. 4, pp. 740–743 (2003)
Novick, D.G., Hansen, B., Ward, K.: Coordinating turn-taking with gaze. In: Proc. of Int. Conf. on Spoken Language Processing (ICSLP) (1996)
Padilha, E., Carletta, J.: A simulation of small group discussion. In: Proc. of the sixth Workshop on the Semantics and Pragmatics of Dialogue (EDILOG 2002), Edinburgh, UK, pp. 117–124 (2002)
Padilha, E., Carletta, J.: Nonverbal behaviours improving a simulation of small group discussion. In: Proceedings of the First International Nordic Symposium of Multi-modal Communication (2003)
Rose, T., Quek, F., Shi, Y.: MacVisSTA: A system for multimodal analysis. In: Proc. of Int. Conf. on Multimodal Interface (ICMI) (2004)
Sacks, H., Schegloff, E., Jefferson, G.: A simplest systematics for the organisation of turn taking for conversation. Language 50, 696–735 (1974)
Shriberg, E., Dhillon, R., Bhagat, S., Ang, J., Carvey, H.: The ICSI meeting recorder dialog act (MRDA) corpus. In: Proc. of SIGdial Workshop on Discourse and Dialogue (2004)
Torres, O., Cassell, J., Prevost, S.: Modeling gaze behavior as a function of discourse structure. In: Proc. of the First International Workshop on Human-Computer Conversations, Bellagio, Italy (1997)
Weilhammer, K., Rabold, S.: Durational aspects in turn taking. In: International Congresses of Phonetic Sciences (2003)
Wichmann, A., Caspers, J.: Melodic cues to turn-taking in English: Evidence from perception. In: Proc. of SIGdial Workshop on Discourse and Dialogue (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, L. et al. (2006). A Multimodal Analysis of Floor Control in Meetings. In: Renals, S., Bengio, S., Fiscus, J.G. (eds) Machine Learning for Multimodal Interaction. MLMI 2006. Lecture Notes in Computer Science, vol 4299. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11965152_4
Download citation
DOI: https://doi.org/10.1007/11965152_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69267-6
Online ISBN: 978-3-540-69268-3
eBook Packages: Computer ScienceComputer Science (R0)