Evaluation of User Behaviour Simulations

Abstract

Several approaches are known aiming at the evaluation of the performance of user behaviour models and related simulation approaches. This chapter describes and evaluates a new approach for the evaluation of the performance of user behaviour simulations on the basis of generated dialogues. Here, performance means the ability of a user behaviour simulation to mimic the interaction behaviour of real users in a dialogue with a spoken dialogue system. The basic idea of the evaluation approach to be presented is the comparison of dialogue sets by the contained courses of dialogues.