Advertisement

An Interface for Annotating Natural Interactivity

  • Niels Ole Bernsen
  • Laila Dybkjær
  • Mykola Kolodnytsky
Chapter
Part of the Text, Speech and Language Technology book series (TLTB, volume 22)

Abstract

The need for annotated corpora in the field of natural interactivity and its subdisciplines is steadily increasing. Annotated corpora are being used to, e.g., develop and evaluate interactive speech systems, produce animated faces, and develop gesture recognition systems. The more natural the system must behave, the stronger are the demands on the quality and sophistication of the underlying corpus annotation. Thus, good tools are in high demand in order to facilitate advanced corpus annotation processes. In this chapter we describe ongoing work towards building a general-purpose tool for coding natural interactive communicative behaviour. We briefly present a review of existing natural interactivity coding tools followed by the common NITE project coding tool specification. Based on the specification, we describe our work on the interface to the NITE WorkBench for Windows, or NWB.

Keywords

Facial Expression Code Scheme Natural Interactivity Annotation Tool Annotation Scheme 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bernsen, N. O.: Natural human-human-system interaction. In Earnshaw, R., Guedj, R., van Dam, A., and Vince, J. (Eds.): Frontiers of Human-Centred Computing, On-Line Communities and Virtual Environments. Berlin: Springer Verlag 2001, Chapter 24, 347–363.CrossRefGoogle Scholar
  2. Cassell, J., Sullivan, J., Prevost, S. and Churchill, E. (Eds.): Embodied Conversational Agents. Cambridge, MA: MIT Press, 2000.Google Scholar
  3. Dybkjær, L., Berman, S., Bernsen, N. O., Carletta, J., Heid, U. and Llisterri, J.: Requirements Specification for a Tool in Support of Annotation of Natural Interaction and Multimodal Data. ISLE Deliverable D11.2, 2001b.Google Scholar
  4. Dybkjær, L., Berman, S., Kipp, M., Olsen, M. W., Pirrelli, V., Reithinger, N. and Soria, C.: Survey of Existing Tools, Standards and User Needs for Annotation of Natural Interaction and Multimodal Data. ISLE Deliverable Dl1.1, 2001a. View or download from isle.nis.sdu.dkGoogle Scholar
  5. Dybkjær, L., Bernsen, N. O., Dybkjær, H., McKelvie, D. and Mengel, A.: The MATE Markup Framework. MATE Deliverable D1.2. Odense University, Denmark, 1998.Google Scholar
  6. Isard, A., McKelvie, D., Cappelli, B., Dybkjær, L., Evert, S., Fitschen, A., Heid, U., Kipp, M., Klein, M., Mengel, A., Møller, M. B. and Reithinger, N.: Specification of workbench architecture. MATE Deliverable D3.1, August 1998. View or download from mate.nis.sdu.dkGoogle Scholar
  7. Knudsen, M. W., Martin, J.-C., Dybkjær, L., Ayuso, M. J. M, N., Bernsen, N. O., Carletta, J., Kita, S., Heid, U., Llisterri, J., Pelachaud, C., Poggi, I., Reithinger, N., van ElsWijk, G. and Wittenburg, P.: Survey of Multimodal Annotation Schemes and Best Practice. ISLE Deliverable D9.1, 2002b. View or download from isle.nis.sdu.dkGoogle Scholar
  8. Knudsen, M. W., Martin, J.-C., Dybkjær, L., Berman, S., Bemsen, N. O., Choukri, K., Heid, U., Mapelli, V., Pelachaud, C., Poggi, I., van ElsWijk, G. and Wittenburg, P.: Survey of NIMM Data Resources, Current and Future User Profiles, Markets and User Needs for NIMM Resources. ISLE Deliverable D8.1, 2002a. View or download from isle.nis.sdu.dkGoogle Scholar
  9. Soria, C., Bernsen, N. O., Cadée, N., Carletta, J., Dybkjær, L., Evert, S., Heid, U., Isard, A., Kolodnytsky, M., Lauer, C., Lezius, W., Noldus, L. P. J. J., Pirrelli, V., Reithinger, N. and Vogele, A.: Advanced Tools for the Study of Natural Interactivity. Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02), 2002, 357–363.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2003

Authors and Affiliations

  • Niels Ole Bernsen
    • 1
  • Laila Dybkjær
    • 1
  • Mykola Kolodnytsky
    • 1
  1. 1.Natural Interactive Systems LaboratoryDenmark

Personalised recommendations