Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems

  • Stefan Hillmann

Part of the T-Labs Series in Telecommunication Services book series (TLABS)

Table of contents

  1. Front Matter
    Pages i-xxx
  2. Stefan Hillmann
    Pages 1-7
  3. Stefan Hillmann
    Pages 9-41
  4. Stefan Hillmann
    Pages 123-169
  5. Stefan Hillmann
    Pages 171-177
  6. Back Matter
    Pages 179-240

About this book


This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness.

Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.


automatic usability evaluation multimodal human-computer interaction user behaviour simulation dialogue efficiency dialogue effectiveness Behavior simulation evaluation

Authors and affiliations

  • Stefan Hillmann
    • 1
  1. 1.Quality and Usability LabTechnische Universität BerlinBerlinGermany

Bibliographic information

  • DOI
  • Copyright Information Springer International Publishing AG 2018
  • Publisher Name Springer, Cham
  • eBook Packages Engineering Engineering (R0)
  • Print ISBN 978-3-319-62517-1
  • Online ISBN 978-3-319-62518-8
  • Series Print ISSN 2192-2810
  • Series Online ISSN 2192-2829
  • Buy this book on publisher's site
Industry Sectors
IT & Software
Oil, Gas & Geosciences