Advertisement

Measuring Performance of Spoken Dialog Systems

Chapter
  • 290 Downloads
Part of the SpringerBriefs in Electrical and Computer Engineering book series

Abstract

Key to the evaluation of spoken dialog systems and the prerequisite to tuning these systems is to properly measure their performance. This chapter reviews common performance metrics distinguishing between subjective, objective, observable, and hidden domains. A special focus is placed on spoken language understanding performance metrics and on the architecture required to gather the data necessary to calculate these metrics.

Keywords

Evaluation infrastructure Hidden metrics Objective metrics Observable metrics Performance metrics Semantic annotation Speech performance analysis metrics Subjective metrics 

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.SpeechCycle, Inc.New YorkUSA

Personalised recommendations