Abstract
Key to the evaluation of spoken dialog systems and the prerequisite to tuning these systems is to properly measure their performance. This chapter reviews common performance metrics distinguishing between subjective, objective, observable, and hidden domains. A special focus is placed on spoken language understanding performance metrics and on the architecture required to gather the data necessary to calculate these metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Annotation refers to the (mostly manual) process of assigning a semantic class to a given transcription, i.e. textual representation of an utterance.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Suendermann, D. (2011). Measuring Performance of Spoken Dialog Systems. In: Advances in Commercial Deployment of Spoken Dialog Systems. SpringerBriefs in Electrical and Computer Engineering(). Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9610-7_3
Download citation
DOI: https://doi.org/10.1007/978-1-4419-9610-7_3
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-9609-1
Online ISBN: 978-1-4419-9610-7
eBook Packages: EngineeringEngineering (R0)