Abstract
Plan inference techniques have been used extensively to understand natural language dialogue. But as noted by Clark[5], language and communication are more than just utterances. This paper presents the problems that we have had to address and the solutions that we have devised in designing a system to recognize intentions from information graphics. Our work is part of a larger project to develop an interactive natural language system that provides an alternative means for individuals with sight-impairments to access the content of information graphics.
The work of the second author was supported by the National Science Foundation under Grant No. 0132821.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Albrecht, I. Zukerman, and A. Nicholson. Bayesian models for keyhole plan recognition in an adventure game. User Modeling and User-Adapted Interaction, pages 5–47, 1998.
L. Ardisono and D. Sestero. Using dynamic user models in the recognition of the plans of the user. User Modeling and User-Adapted Interaction, 5(2):157–190, 1996.
S. Carberry. Plan Recognition in Natural Language Dialogue. ACL-MIT Press Series on Natural Language Processing. MIT Press, Cambridge, Massachusetts, 1990.
S.K. Card, J. Mackinlay, and B. Shneiderman. Readings in Information Visualization: Using Vision to Think. Morgan-Kaufmann, 1999. Chapter 1.
H. Clark. Using Language. Cambridge University Press, 1996.
M. Corio and G. Lapalme. Generation of texts for information graphics. In Proceedings of the 7th European Workshop on Natural Language Generation EWNLG’99, pages 49–58, 1999.
H. P. Grice. Utterer’s Meaning and Intentions. Philosophical Review, 68:147–177, 1969.
B. E. John and A. Newell. Toward an engineering model of stimulus response compatibility. In R. W. Gilmore and T. G. Reeve, editors, Stimulus-response compatibility: An integrated approach, pages 107–115. North-Holland, NewYork, 1990.
S. Kerpedjiev and S. Roth. Mapping communicative goals into conceptual tasks to generate graphics in discourse. In Proceedings of the International Conference on Intelligent User Interfaces, pages 60–67, 2000.
S. M. Kosslyn. Understanding charts and graphs. Applied Cognitive Psychology, 3:185–226, 1989.
D. Litman and J. Allen. A Plan Recognition Model for Subdialogues in Conversation. Cognitive Science, 11:163–200, 1987.
G. L. Lohse. A cognitive model for understanding graphical perception. Human-Computer Interaction, 8:353–388, 1993.
P. B. L. Meijer. An experimental system for auditory image representations. IEEE Transactions on Biomedical Engineering, 39(2):291–300, February 1992.
V. Mittal. Visual prompts and graphical design: A framework for exploring the design space of 2-D charts and graphs. In Proceedings of the Fourteenth National Conference on Artificial Intelligence, pages 57–63, 1997.
R. Perrault and J. Allen. A Plan-Based Analysis of Indirect Speech Acts. American Journal of Computational Linguistics, 6(3–4):167–182, 1980.
J. R. Pomerantz and M. Kubovy. Theoretical approaches to perceptual organization. In K. R. Boff, L. Kaufman, and J. P. Thomas, editors, Handbook of Perception and Human Performance, pages 36.1–36.46. Wiley, NewYork, 1986.
J. E. Russo. Adaptation of cognitive processes to eye movement systems. In J. W. Senders, D. F. Fisher, and R. A. Monty, editors, Eye movements and higher psychological functions, pages 89–109. Lawrence Erlbaum Associates, Inc., Hillsdale, NJ, 1978.
C. D. Wickens and C. M. Carswell. The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors, 37(3):473–494, 1995.
J. Yu, J. Hunter, E. Reiter, and S. Sripada. Recognising visual patterns to communicate gas turbine time-series data. In A. Macintosh, R. Ellis, and F. Coenen, editors, Proceedings of ES2002, pages 105–118, 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Elzer, S., Green, N., Carberry, S., McCoy, K. (2003). Extending Plan Inference Techniques to Recognize Intentions in Information Graphics. In: Brusilovsky, P., Corbett, A., de Rosis, F. (eds) User Modeling 2003. UM 2003. Lecture Notes in Computer Science(), vol 2702. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44963-9_17
Download citation
DOI: https://doi.org/10.1007/3-540-44963-9_17
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40381-4
Online ISBN: 978-3-540-44963-8
eBook Packages: Springer Book Archive