Abstract
The task of the knowledge-based presentation system WIP is the generation of a variety of multimodal documents from an input consisting of a formal description of the communicative intent of a planned presentation. WIP generates illustrated texts that are customized for the intended audience and situation. We present the architecture of WIP and introduce as its major components the presentation planner, the layout manager, the text generator and the graphics generator. An extended notion of coherence for multimodal documents is introduced that can be used to constrain the presentation planning process. The paper focuses on the coordination of contents planning and layout that is necessary to produce a coherent illustrated text. In particular, we discuss layout revisions after contents planning and the influence of layout constraints on text generation. We show that in WIP the design of a multimodal document is viewed as a non-monotonic planning process that includes various revisions of preliminary results in order to achieve a coherent output with an optimal media mix.
An extended version of this paper will appear as WIP: The Coordinated Generation of Multimodal Presentations from a Common Representation in A. Ortony, J. Slack, and O. Stock (eds.), Computational Theories of Communication and their Applications, Berlin: Springer-Verlag, 1991
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Allgayer, J., Harbusch, K., Kobsa, A., Reddig, C., Reithiriger, N., and Schmauks, D.: XTRA: A Natural Language Access System to Expert Systems. In: International Journal of Man-Machine Studies Vol. 31 (1989) 161–195
André, E. and Rist, T.: Towards a Plan-Based Synthesis of Illustrated Documents. In: Proc. of the 9th European Conference on Artificial Intelligence (1990) 25–30
André, E. and Rist, T.: Synthesizing Illustrated Documents: A Plan- Based Approach. In: Proc. of Info Japan 90, Vol. 2 (1990) 163–170
Bandyopadhyay, S.: Towards an Understanding of Coherence in Multimodal Discourse. Technical Memo DFKI-TM-90-01, German Research Center for Artificial Intelligence, Saarbrücken Site (1990)
Beach, R. J.: Setting Tables and Illustrations with Style. Xerox PARC Technical Report CSL-85–3 (1985)
Borning, A. and Duisberg, A.: Constraint-Based Tools for Building User Interfaces. ACM Trans, on Graphics 5:6 (1986) 345–374
Borning, A., Freeman-Benson, B., and Wilson, M.: Constraint Hierarchies. Internal Report, Department of Computer Science and Engineering, FR- 35, University of Washington, Seattle (1989)
Feiner, S.: A Grid-Based Approach to Automating Display Layout. In: Proc, of the Graphics Interface 88. Palo Alto: Morgan Kaufmann (1988) 192- 197
Feiner, S. and McKeown, K.: Coordinating Text and Graphics in Explanation Generation. In: DARPA Speech and Natural Language Workshop (1989)
Finkler, W. and Neumann, G.: POPEL-HOW: A Distributed Parallel Model for Incremental Natural Language Production with Feedback. In: Proc. of the 11th IJCAI (1989) 1518–1523
Freeman-Benson, B., Maloney, J., and Borning, A.: An Incremental Constraint Solver. Communications of the ACM, Vol. 33, No. 1 (1990) 54–63
Graf, W. and Maaß, W.: Constraint-basierte Verarbeitung graphischen Wissens. To appear in Proc. of the 4th Int. GI-Kongreß Wissensbasierte Systeme — Verteilte KI. Berlin: Springer-Verlag (1991)
Harbusch, K.: Constraining Tree Adjoining Grammars by Unification. Proc. of the 13th COLING (1990) 167–172
Jameson, A. and Wahlster, W.: User Modelling in Anaphora Generation: Ellipsis and Definite Description. In: Proc. of the 5th ECAI (1982) 222–227
Kjorup, S.: Pictorial Speech Acts. In: Erkenntnis 12 (1978) 55–71
Mann, W. and Thompson, S.: Rhetorical Structure Theory: Towards a Functional Theory of Text Organization. In: TEXT, 8 (3) (1988)
Marks, J. and Reiter, E.: Avoiding Unwanted Conversational Im- plicatures in Text and Graphics. In: Proc. of the 8th AAAI (1990) 450–455
Maaß, W.: Constraint-basierte Repräsentation von graphischem Wissen am Beispiel des Layout-Managers in WIP. MS thesis, Computer Science Departement, University of Saarbrücken (1991)
McKeown, K. and Feiner, S.: Interactive Multimedia Explanation for Equipment Maintenance and Repair. In: DARPA Speech and Natural Language Workshop (1990) 42–47
Moore, J. and Paris, C.: Planning Text for Advisory Dialogues. In: Proc. of the 27th ACL (1989) 203–211
Müller-Brockmann, J.: Grid Systems in Graphic Design. Stuttgart: Hatje (1981)
Neal, J. and Shapiro, S.: Intelligent Multi-Media Interface Technology. In: Proc. of the Workshop on Architectures of intelligent Interfaces: Ele- ments&Prototypes (1988) 69–91
Nebel, B.: Reasoning and Revision in Hybrid Representation Systems. Lecture Notes in AI, Vol. 422, Berlin: Springer-Verlag (1990)
Rist, T. and André, E.: Wissensbasierte Perspektivenwahl für die automatische Erzeugung von 3D-Objektdarstellungen. In: K. Kansy and P. Wißkirchen (eds.). Graphik und KI. IFB 239, Berlin: Springer-Verlag (1990) 48- 57
Roth, S., Mattis, J., and Mesnard, X.: Graphics and Natural Language as Components of Automatic Explanation. In: Proc. of the Workshop on Architectures of Intelligent Interfaces: Elements & Prototypes (1988) 109–128
Searle, J.: Speech Acts: An Essay in the Philosophy of Language. Cambridge, MA: Cambridge University Press (1969)
Schauder, A.: Inkrementelle syntaktische Generierung natürlicher Sprache mit Tree Adjoining Grammars. MS thesis, Computer Science Departement, University of Saarbrücken (1990)
Stock, O.: Natural Language and Exploration of an Information Space: the ALFresco Interactive System. Technical Report, Istituto per la Ricerca Scientifica e Tecnologica, Trento, Italy (1991)
van Dijk, T.: Textwissenschaft. München: dtv (1980)
Wahlster, W.: User and Discourse Models for Multimodal Communication. In: J. Sullivan and S. Tyler (eds.). Architectures for Intelligent User Interfaces: Elements and Prototypes. Reading, MA: Addison-Wesley (1991)
Wahlster, W. and Kobsa, A.: User Models in Dialog Systems. In: A. Kobsa and W. Wahlster (eds.). User Models in Dialog Systems. Symbolic Computation Series, Berlin: Springer-Verlag (1989) 4–34
Wahlster, W., André, E., Hecking, M., and Rist, T.: WIP: Knowledge-based Presentation of Information. Report WIP-1, German Research Center for Artificial Intelligence, Saarbrücken (1989)
Wahlster, W., André, E., Graf, W., and Rist, T.: Designing Illustrated Texts: How Language Production Is Influenced by Graphics Generation. In: Proc. of the 5th Conference of the European Chapter of the ACL, Berlin: Springer-Verlag (1991) 8–14
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wahlster, W., André, E., Bandyopadhyay, S., Graf, W., Rist, T. (1991). Knowledge-based Generation of Illustrated Documents. In: Kaindl, H. (eds) 7. Österreichische Artificial-Intelligence-Tagung / Seventh Austrian Conference on Artificial Intelligence. Informatik-Fachberichte, vol 287. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-46752-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-46752-3_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-54567-5
Online ISBN: 978-3-642-46752-3
eBook Packages: Springer Book Archive