Skip to main content
SpringerLink
Log in

Strategies for Generating Coherent Descriptions of Object Movements in Street Scenes

  • Chapter
Natural Language Generation

Part of the book series: NATO ASI Series ((NSSE,volume 135))

Abstract

In this chapter a verbalization strategy for the generation of descriptions is motivated which leads to a specific text structure and to an event selection algorithm that is based on a specialization hierarchy of motion verbs. It is assumed that the hearer is familiar with the static parts of the scene and that the system is to inform him about the motions in such a way that he may imagel them. This assumption in turn leads to the strategy of anticipated visualization for the selection of optional deep cases of a verb. Both strategies have been operationalized and are implemented in the NAOS system. It is further shown that the generation of restrictive relative clauses and the use of negation arises naturally from the task of generating referring expressions in a dynamic environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Appelt, D.E. (1982) Planning Natural-Language Utterances to Satisfy Multiple Goals. SRI International, Technical Note 259, Menlo Park, CA.

    Google Scholar 

  • Badler, N.I. (1975) Temporal Scene Analysis: Conceptual Description of Object Movements. Report TR-80, Department of Computer Science, University of Toronto.

    Google Scholar 

  • Busemann, S. (1984) Surface transformations during the Generation of Written German Sentences. In: Bolc, L. & McDonald, D. (Eds.) Natural Language Generation Systems. Berlin: Springer.

    Google Scholar 

  • Conklin, J.D. & McDonald, D.D. (1982) Salience: The Key to the Selection Problem in Natural Language Generation. In: Proceedings of COLING-82.

    Google Scholar 

  • Davey, A. (1978) Discourse Production. A Computer Model of Some Aspects of a Speaker. Edinburgh: Edinburgh University Press.

    Google Scholar 

  • Fillmore, C.J. (1968) The Case for Case. In: Bach, E. & Harms, R.T. (Eds.) Universals in Linguistic Theory. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • Fillmore, C.J. (1977) Scenes-and-frames Semantics. In: Zampolli, A. (Ed.) Linguistic Structures Processing. Amsterdam: North-Holland.

    Google Scholar 

  • Goldman, N.M. (1975) Conceptual Generation. In: Schank, R.C. (Ed.) Conceptual Information Processing. Amsterdam: North-Holland.

    Google Scholar 

  • Grice, H.P. (1975) Logic and Conversation. In: Cole P. & Morgan, J.L. (Eds.) Speech Acts. London: Academic Press.

    Google Scholar 

  • von Hahn, W., Hoeppner, W., Jameson, A. & Wahlster, W. (1980) The Anatomy of the Natural Language Dialogue System HAM-RPM. In: Bolc, L. (Ed.) Natural Language Based Computer Systems. München: Hanser/McMillan.

    Google Scholar 

  • Hoeppner, W., Christaller, T., Marburger, H., Morik, K., Nebel, B., O’Leary, M. & Wahlster, W. (1983) Beyond Domain-Independence: Experience with the Development of a German Language Access System to Highly Diverse Background Systems. In: Proceedings of IJCAI-83.

    Google Scholar 

  • Kosslyn, S.M. (1980) Image and Mind. Cambridge, Mass.: Harvard University Press.

    Google Scholar 

  • Levelt, W.J.M., Schreuder, R. & Hoenkamp, E. (1978) Structure and Use of Verbs of Motion. In: Campbell, R.N. & Smith, P.T., (Eds.) Recent Advances in the Psychology of Language. New York: Plenum Publishing Corporation.

    Google Scholar 

  • Mann, W.C. & Moore, J. (1981) Computer Generation of Multiparagraph Text. American Journal of Computational Linguistics, 7, 17–29.

    Google Scholar 

  • Mann, W.C. (1984) Discourse Structures for Text Generation. In: Proceedings of COLING-84.

    Google Scholar 

  • Mann, W.C., Bates, M., Grosz, B., McDonald, D.D., McKeown, K.R. & Swartout, W.R. (1982) Text Generation. American Journal of Computational Linguistics, 8, 62–69.

    Google Scholar 

  • McDonald, D.D. (1983) Natural Language Generation as a Computational Problem: an Introduction. In: Brady, M. & Berwick, R.C. (Eds.) Computational Models of Discourse. Cambridge, Mass.: MIT Press.

    Google Scholar 

  • McKeown, K.R. (1985) Discourse Strategies for Generating Natural-Language Text. Artificial Intelligence, 27, 1–41.

    Article  Google Scholar 

  • Meehan, J. (1981) TALE-SPIN. In: Schank, R.C. & Riesbeck, C.K. (Eds.) Inside Computer Understanding: Five Programs plus Miniatures. Hillsdale, N.J.: Erlbaum.

    Google Scholar 

  • Miller, G.A. & Johnson-Laird, P.N. (1976) Language and Perception. Cambridge, Mass.: Cambridge University Press.

    Google Scholar 

  • Neumann, B. (1984a) On Natural Language Access to Image Sequences: Event Recognition and Verbalization. In: Proceedings of the First Conference on Artificial Intelligence Applications (CAIA-84), Denver, Colorado.

    Google Scholar 

  • Neumann, B. (1984b) Natural Language Description of Time-Varying Scenes. FBI-HH-B105/84, Fachbereich Informatik, Universität Hamburg.

    Google Scholar 

  • Neumann, B. & Novak, H.-J. (1983a) Natural Language Oriented Event Models for Image Sequence Interpretation: The Issues. CSRG Techn. Note Nr. 34, University of Toronto.

    Google Scholar 

  • Neumann, B. & Novak, H.-J.(1983b) Event Models for Recognition and Natural Language Description of Events in Real-World Image Sequences. In: Proceedings of IJCAI-83.

    Google Scholar 

  • Neumann, B. & Novak, H.-J. (1986) NAOS: Ein System zur natürlichsprachlichen Beschreibung zeitveränderlicher Szenen. Informatik Forschung und Entwicklung, 1, 83–92.

    Google Scholar 

  • Novak, H.-J. (1985) A Relational Matching Strategy for Temporal Event Recognition. In: Laubsch, J. (Ed.) GWAI-84. Berlin: Springer.

    Google Scholar 

  • Olson, D.R. (1972) Language Use for Communicating, Instructing and Thinking. In: Freedle, R.O. & Carroll, J.B. (Eds.) Language Comprehension and the Acquisition of Knowledge. Washington, D.C.: Winston.

    Google Scholar 

  • Okada, N. (1980) Conceptual Taxonomy of Japanese Verbs for Understanding Natural Language and Picture Patterns. In: Proceedings of COLING-80.

    Google Scholar 

  • Reiter, R. (1978) On Closed World Data Bases. In: Gallaire, H. & Minker, J (Eds.) Logic and Data Bases. New York: Plenum.

    Google Scholar 

  • Tsotsos, J.K. (1980) A Framework for Visual Motion Understanding. CSRG TR-114, University of Toronto.

    Google Scholar 

  • Tsuji, S., Kuroda, S. & Morizono, A. (1977) Understanding a Simple Cartoon Film by a Computer Vision System. In: Proceedings of IJCAI-77.

    Google Scholar 

  • Wahlster, W., Marburger, H., Jameson, A. & Busemann, S. (1983) Overanswering Yes-NoQuestions: Extended Responses in a NL Interface to a Vision System. In: Proceedings of IJCAI-83.

    Google Scholar 

  • Weber, G. (1983) Untersuchungen zur mentalen Repräsentation von Bewegungsverben: Merkmale, Dimensionen und Vorstellungsbilder. Dissertation, Universität Braunschweig.

    Google Scholar 

  • Yuille, J.C. (1983) (Ed.) Imagery, Memory and Cognition. Hillsdale, N.J.: Erlbaum.

    Google Scholar 

Download references

Authors
  1. Hans-Joachim Novak
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Experimental Psychology, University of Nijmegen, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands

    Gerard Kempen

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Martinus Nijhoff Publishers, Dordrecht

About this chapter

Cite this chapter

Novak, HJ. (1987). Strategies for Generating Coherent Descriptions of Object Movements in Street Scenes. In: Kempen, G. (eds) Natural Language Generation. NATO ASI Series, vol 135. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3645-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-3645-4_9

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-8131-3

  • Online ISBN: 978-94-009-3645-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation