Zusammenfassung
Bei der Entwicklung neuerer intelligenter Benutzerschnittstellen, die wie im Beispiel des multimodalen Präsentationssystems WIP natürliche Sprache und Graphik kombinieren, spielt insbesondere die wissensbasierte Gestaltung des Layouts multimodaler Dokumente eine wichtige Rolle. Am Beispiel des Layout-Managers in WIP soll gezeigt werden, wie aufgrund der von einem Präsentationsplaner spezifizierten semantischen und pragmatischen Relationen, die von den media-spezifischen Generatoren erzeugten Graphik- und Textfragmente in einem Dokument automatisch arrangiert werden können. Dabei wird das Layoutproblem als Constraint-Satisfaction-Problem behandelt. Es wird hier gezeigt, wie der Constraint-Ansatz sowohl zur Repräsentation von graphischem Wissen, als auch zur Berechnung der Plazierung der Layout-objekte auf einem Design-Grid verwendet werden kann. So werden semantische Kohärenzrelationen wie etwa ‘sequence’ oder ‘contrast’ durch entsprechende Design-Constraints reflektiert, die perzeptuelle Kriterien (Alignierung, Gruppierung, Symmetrie, etc.) spezifizieren. Zur Realisierung wird in WIP ein mehrschichtiger inkrementeller Constraint-Solver mit lokaler Propagierung verwendet, der es erlaubt, Constraints dynamisch zu generieren.
Die vorliegende Arbeit entstand im Rahmen des vom BMFT unter dem Förderkennzeichen ITW 8901 8 geförderten Projektes WIP (Wissensbasierte Informationspräsentation)
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Literatur
E. André and T. Rist. Synthesizing illustrated documents: A plan-based approach. In Proceedings of InfoJapan ’90, Vol. 2, pages 163–170, Tokyo, 1990. Also DFKI Research Report RR-91-06.
Y. Arens, E. Hovy, and M. Vossers. Descrying the knowledge underlying the processing of multimedia instruction manuals. Submitted to Cognitive Science ’91, 1991.
R. Arnheim, editor. Visual Thinking. Faber and Faber, London, 1969.
N. Badler and B. Webber. Task communication through natural language and graphics: A workshop report. Dept. of Computer and Information Science, University of Pennsylvania, June 1990.
R. Beach. Setting Tables and Illustrations with Style. PhD thesis, Dept. of Computer Science, University of Waterloo, Ontario, 1985.
A. Borning. The programming language aspects of ThingLab, a constraint-oriented simulation laboratory. ACM Transactions on Programming Languages and Systems, 3 (4): 353–387, October 1981.
A. Borning, R. Dulsberg, B. Freeman-Benson, A. Kramer, and M. Woolf. Constraint hierarchies. In Proceedings of OOPSLA ’87, pages 48–60, October 1987.
G. Braun, editor. Grundlagen der visuellen Kommunikation. Bruckmann, München, 1987.
E. Davis. Constraint propagation with interval labels. Artificial Intelligence, 32: 281–331, 1987.
S. Feiner. APEX: An experiment in the automated creation of pictorial explanations. IEEE Computer Graphics and Applications, 5 (11): 29–39, 1985.
S. Feiner. A grid-based approach to automating display layout. In Proceedings of the Graphics Interface ’88, pages 192–197, Los Altos, CA, June 1988. Morgan Kaufmann.
S. Feiner and K. McKeown. Coordinating text and graphics in explanation generation. In Proceedings of the 8th National Conference of the American Association for Artificial Intelligence, pages 442–449, Boston, MA, July 1990.
B. Freeman-Benson, J. Maloney, and A. Borning. An incremental constraint solver. Communications of the ACM, 33 (1): 54–63, 1990.
M. Friedell. Automatic synthesis of graphical object descriptions. Computer Graphics, 18 (3): 53–62, 1984.
J. Gosling. Algebraic Constraints. PhD thesis, Dept. of Computer Science, Carnegie Mellon University, 1983.
W. Graf. Spezielle Aspekte des automatischen Layout-Designs bei der koordinierten Generierung von multimodalen Dokumenten. Gl-Workshop ‘Multimediale elektronische Dokumente’, Heidelberg, November 1990.
W. Graf. Constraint-based processing of design knowledge. In Proceedings of the AAAI-91 Workshop on Intelligent Multimedia Interfaces, Anaheim, CA, July 1991.
W. Leler, editor. Constraint Programming Languages: Their Specification and Generation. Addison-Wesley, Reading, MA, 1988.
W. Maaß. Constraint-basierte Repräsentation von graphischem Wissen am Beispiel des Layout- Managers in WIP. Master’s thesis, Dept. of Computer Science, University of Saarbrücken, 1991. forthcoming.
W. Maaß, T. SchifFmann, and D. Soetopo. LAYLAB: Ein System zur automatischen Plazierung in multimodalen Dokumenten. Fortgeschrittenenpraktikum ‘Wissensbasierte Graphikgenerierung’, Dept. of Computer Science, University of Saarbrücken, 1991.
J. Mackinlay. Automatic Design of Graphical Presentations. PhD thesis, Dept. of Computer Science, Stanford University, Stanford, CA, 1985.
A. Mackworth. Consistency in networks of relations. Artificial Intelligence, 8 (1): 99–118, 1977.
W. Mann and S. Thompson. Rhetorical structure theory: Towards a functional theory of text organization. TEXT, 8 (3), 1988.
J. Marks. The competence of an automated graphic designer. In Proceedings of the 1991 Long Island Conference on Artificial Intelligence and Computer Graphics, NYIT, pages 53–61, New York, March 1991.
J. Marks and E. Reiter. Avoiding unwanted c onversational implicatures in text and graphics. In Proceedings of the 8th National Conference of the American Association for Artificial Intelligence, pages 450–456, Boston, MA, July 1990.
S. Mittal and B. Falkenhainer. Dynamic constraint satisfaction problems. In Proceedings of the 8th National Conference of the American Association for Artificial Intelligence, pages 25–32, Boston, MA, July 1990.
U. Montanari. Networks of constraints: Fundamental properties and applications to picture processing. Information Science, 7 (2): 95–132, 1974.
J. Müller-Brockmann, editor. Grid Systems in Graphic Design. Verlag Arthur Niggli, Niederteufen, Switzerland, 1981.
D. Navinchandra, editor. Exploration and Innovation in Design. Springer-Verlag, Berlin, Germany, 1991.
G. Nelson. Juno, a constraint-based graphics system. Proceedings of the SIGGRAPH ’85, 19 (3): 235–243, 1985.
S. Roth, J. Mattis, and X. Mesnard. Graphics and natural language as components of automatic explanation. In J. Sullivan and S. Tyler, editors, Architectures for Intelligent Interfaces: Elements and Prototypes. Addison-Wesley, Reading, MA, 1990.
D. Seligmann and S. Feiner. Specifying composite illustrations with communicative goals. In Proceedings of the UIST ’89 (ACM SIGGRAPH Symp. on User Interface Software and Technology, pages 1–9, Williamsburg, VA, November 1988.
A. Stankowski and K. Duschek, editors. Visuelle Kommunikation. Dietrich Reimer, Berlin, 1989.
G. Sussman and G. Steele. Constraints — a language for expressing almost-hierachical descriptions. Artificial Intelligence, 14 (1): 1–39, 1980.
I. Sutherland. Sktechpad: A man-machine graphical communication system. In IFIPS Proceedings of the Spring Joint Computer Conference, pages 329–345, 1963.
P. van Hentenryck, editor. Constraint Satisfaction in Logic Programming. MIT Press, Cambridge, MA, 1989.
C. van Wyk. A high-level language for specifying pictures. ACM Transactions on Graphics, 1 (2): 163–182, 1982.
W. Wahlster, E. André, S. Bandyopadhyay, W. Graf, and T. Rist. WIP: The coordinated generation of multimodal presentations from a common representation. In A. Ortony, J. Slack, and O. Stock, editors, A.I. and Cognitive Science Perspectives on Communication. Springer- Verlag, Berlin, Germany, 1991. Also DFKI Research Report RR-91-08.
W. Wahlster, E. André, W. Graf, and T. Rist. Designing illustrated texts: How language production is influenced by graphics generation. In Proceedings of the 5th Conference of the European Chapter of the Association for Computational Linguistics, pages 8–14, Berlin, Germany, April 1991. Also DFKI Research Report RR-91-05.
D. Willows and H. Houghton, editors. The Psychology of Illustration, Vol. 1, 2. Springer-Verlag, Berlin, Germany, 1987.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Graf, W., Maaß, W. (1991). Constraint-basierte Verarbeitung graphischen Wissens. In: Brauer, W., Hernández, D. (eds) Verteilte Künstliche Intelligenz und kooperatives Arbeiten. Informatik-Fachberichte, vol 291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-76980-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-76980-1_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-54617-7
Online ISBN: 978-3-642-76980-1
eBook Packages: Springer Book Archive