Abstract
In the DenK project a multimodal interface is developed where natural language is combined with graphical interaction. For the design of this interface, knowledge is collected about how humans refer to objects in a task-oriented environment, by means of natural language and gestures. In this paper we report results of an experiment concerning referring behaviour in tasd-oriented keyboard dialogues. The results are compared with those of an earlier experiment we performed with spoken dialogues. The differences were all found to be related to the so-called principle of minimal cooperative total effort, which says that, within the limitations of the available modalities, the participants aim at spending as little total effort as possible on referring to a certain object on the other hand, and on identifying the object on the other hand. Based on the results, we formulate recommendations for the design of multimodal interfaces which include typed natural language.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ahn, R.M.C., Beun, R.J., Borghuis, T., Bunt, H.C. & Overveld, C.W.A.M. van (1995) The DenK-architecture: a Fundamental Approach to User-Interfaces. Artificial Intelligence Review, 8, 431–445.
Beun, R.J. and Bunt, H.C. (1987) Investigating Linguistic Behaviour in Information Dialogues with a Computer. IPO Annual Progress Report, 22, 77–86.
Bunt, H.C. (1997) Issues in Multimodal Human-Computer Communication. This volume.
Bunt, H.C., Ahn, R.M.C., Beun, R.J., Borghuis, T., & Overveld, C.W.A.M. van (1997) Cooperative Multimodal Communication in the DenK System. This volume.
Clark, H.H. and Wilkes-Gibbs, D. (1986) Referring as a collaborative process. Cognition, 22, 1–39.
Cohen, P.R. (1984) The Pragmatics of Referring and the Modality of Communication.Computational Linguistics, 10(2), 97–125.
Cremers, A.H.M. (1995) The Process of Cooperative Object Reference in a Shared Domain. In: E. Fava (ed.) Speech acts and linguistic research: proceedings of the workshop, July 15–17, 1994 First International Summer Institute in Cognitive Science, Center for Cognitive Science, State University of New York at Buffalo, NY. Padova: edizione nemo, 139–153.
Cremers, A.H.M. and Beun, R.J. (1985) Object Reference in a Shared Domain of Conversation. Eindhoven, Institute for Perception Research, manuscript no. 1089.
Hauptmann, A.G. and Rudnicky, A.I. (1988) Talking to Computers: an Empirical Investigation. International Journal of Man-Machine Studies, 28, 583–604.
Oviatt, S.L. and Cohen, P.R. (1991) Discourse Structure and Performance Efficiency in Interactive and Non-interactive Spoken Modalities. Computer Speech and Language, 5, 297–326.
Piwek, P., Beun, R.J. and Cremers, A.H.M. (1995) Deictic Use of Dutch Demonstratives. IPO Annual Progress Report, 30, 99–108.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Cremers, A. (1998). Object reference in task-oriented keyboard dialogues. In: Bunt, H., Beun, RJ., Borghuis, T. (eds) Multimodal Human-Computer Communication. CMC 1995. Lecture Notes in Computer Science, vol 1374. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052324
Download citation
DOI: https://doi.org/10.1007/BFb0052324
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64380-7
Online ISBN: 978-3-540-69764-0
eBook Packages: Springer Book Archive