Speech and Speaker Recognition Evaluation

  • Sadaoki Furui
Part of the Text, Speech and Language Technology book series (TLTB, volume 37)

This chapter overviews techniques for evaluating speech and speaker recognition systems. The chapter first describes principles of recognition methods, and specifies types of systems as well as their applications. The evaluation methods can be classified into subjective and objective methods, among which the chapter focuses on the latter methods. In order to compare/normalize performances of different speech recognition systems, test set perplexity is introduced as a measure of the difficulty of each task. Objective evaluation methods of spoken dialogue and transcription systems are respectively described. Speaker recognition can be classified into speaker identification and verification, and most of the application systems fall into the speaker verification category. Since variation of speech features over time is a serious problem in speaker recognition, normalization and adaptation techniques are also described. Speaker verification performance is typically measured by equal error rate, detection error trade-off (DET) curves, and a weighted cost value. The chapter concludes by summarizing various issues for future research.


Speech recognition Speaker recognition Objective evaluation Subjective evaluation Perplexity Accuracy Correctness Equal error rate DET curve. 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer 2007

Authors and Affiliations

  • Sadaoki Furui
    • 1
  1. 1.Department of Computer ScienceTokyo Institute of Technology TokyoJapan

Personalised recommendations