Skip to main content

Generating Referring Expressions and Pointing Gestures

  • Chapter
Natural Language Generation

Part of the book series: NATO ASI Series ((NSSE,volume 135))

Abstract

Among other things, a natural language generator which is embedded in a dialog system should take the user’s input into account. In this way, the output generated will be better adapted to the user’s needs. Consequently, the generator and the other components of the system should share knowledge bases whenever possible. In this chapter, preliminary considerations pertaining to the generation component of XTRA — a natural language access system to expert systems — are presented. The generator is fully integrated into the system and shares its knowledge bases. The advantage of this structure is demonstrated for the generation of certain referring expressions. Apart from linguistic reference — e.g. pro-words — extralinguistic pointing gestures can be employed both by the user and the XTRA system as well. Finally, the integration of pointing gestures in the generation component is discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Allgayer, J. (1986) Eine Graphikkomponente zur Integration von Zeigehandlungen in natürlichsprachliche KI-Systeme. In: Hommel, G. & Schindler, S. (Eds.) GI-16. Jahrestagung. Berlin: Springer-Verlag.

    Google Scholar 

  • Allgayer, J. & Reddig, C. (1986) Processing Descriptions Containing Words and Gestures — A System Architecture. In: Rollinger, C.R. (Ed.) GWAI/OGAI 86. Heidelberg: Springer Verlag.

    Google Scholar 

  • Appelt, D.E. (1985) Planning English Sentences. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Brachman, R.J. & Schmolze, J.G. (1985) An Overview of the KL-ONE Knowledge Representation System. Cognitive Science, 9, 171–216.

    Article  Google Scholar 

  • Duden (1984) Duden—Die Grammatik. Mannheim: Bibliographisches Institut.

    Google Scholar 

  • Grosz, B. (1977) The Representation and Use of Focus in Dialogue Understanding. Ph.D. Thesis. University of California, Berkeley.

    Google Scholar 

  • Habel, C. (1984) Zur Repräsentation der referentiellen Struktur. In: Rollinger, C.-R. (Ed.) Probleme des (Text-)Verstehens — Ansätze der Künstlichen Intelligenz. Tübingen: Niemeyer.

    Google Scholar 

  • Hahn, W. von, Hoeppner, W., Jameson, A. & Wahlster, W. (1980) The Anatomy of the Natural Language Dialog System HAM-RPM. In: Bolc, L. (Ed.) Natural Language Based Computer Systems. München: Hanser/Macmillan.

    Google Scholar 

  • Karlin, R.F. (1985) Romper Mumbles. Report MS-CIS 85–41, Department of Computer and Information Science, University of Pennsylvania, Philadelphia.

    Google Scholar 

  • Kobsa, A., Allgayer, J., Reddig, C., Reithinger, N., Schmauks, D., Harbusch, K. & Wahlster, W. (1986) Combining Deictic Gestures and Natural Language for Referent Identification. In: Proceedings of the 11th International Conference on Computational Linguistics. Bonn, West Germany.

    Google Scholar 

  • Reichman, R. (1985) Getting Computers to Talk Like You and Me. Cambridge, MA.: MIT Press.

    Google Scholar 

  • Reithinger, N. (1984) Antwortgenerierung für das Erlanger Spracherkennungssystem. Diploma Thesis, University of Erlangen-Nürnberg.

    Google Scholar 

  • Rochester, S.R., Martin, J.R. (1977) The Art of Referring: The Speaker’s Use of Noun Phrases to Instruct the Listener. In: Freedle, R.O. (Ed.) Discourse Production and Comprehension. Norwood, NJ.: Ablex.

    Google Scholar 

  • Schmauks, D. (1986a) Formulardeixis und ihre Simulation auf dem Bildschirm. Ein Überblick aus linguistischer Sicht. Memo No. 4, Sonderforschungsbereich 314, Department of Computer Science, University of Saarbrücken.

    Google Scholar 

  • Schmauks, D. (1986b) Form und Funktion von Zeigegesten: Ein interdisziplinärer Überblick. Memo No. 10, Sonderforschungsbereich 314, Department of Computer Science, University of Saarbrücken.

    Google Scholar 

  • Sidner C.L. (1983) Focussing in the Comprehension of Definite Anaphora. In: Brady, M. & Berwick, R.C. (Eds.) Computational Models of Discourse. Cambridge, MA.: MIT Press.

    Google Scholar 

  • Wong, H.K.T. (1975) Generating English Sentences from Semantic Structures. Technical Report No. 84, University of Toronto.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Martinus Nijhoff Publishers, Dordrecht

About this chapter

Cite this chapter

Reithinger, N. (1987). Generating Referring Expressions and Pointing Gestures. In: Kempen, G. (eds) Natural Language Generation. NATO ASI Series, vol 135. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3645-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-3645-4_6

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-8131-3

  • Online ISBN: 978-94-009-3645-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics