Advertisement

Spoken Dialogue Systems Evaluation

  • Niels Ole Bernsen
  • Laila Dybkjær
  • Wolfgang Minker
Chapter
Part of the Text, Speech and Language Technology book series (TLTB, volume 37)

This chapter first provides a brief introduction to evaluation methods and criteria and then presents two very different spoken dialogue research prototype systems and their evaluation. The first prototype is the non-task-oriented, multimodal Hans Christian Andersen (HCA) system for edutainment, the second prototype is the task-oriented, multimodal SENECA onboard system in the car. The systems were tested with representative users in the laboratory and in the field, respectively. For both systems we describe rationale for the chosen evaluation method, evaluation process, evaluation criteria, and evaluation results.

Keywords

Evaluation Spoken dialogue systems Methods Criteria. 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer 2007

Authors and Affiliations

  • Niels Ole Bernsen
    • 1
  • Laila Dybkjær
    • 2
  • Wolfgang Minker
    • 3
  1. 1.Natural Interactive Systems LaboratoryDenmark
  2. 2.Natural Interactive Systems LaboratoryDFKI Language Technology LabBerlinGermany
  3. 3.Institute for Information TechnologyUniversity of UlmGermany

Personalised recommendations