Skip to main content

A User Model to Predict User Satisfaction with Spoken Dialog Systems

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6392))

Abstract

In order to predict interactions of users with spoken dialog systems and their ratings of the interaction, we propose to model basic needs of the user which impacting her emotional state. In defining the model we follow the PSI theory by Dörner [1] and identify Competence and Certainty as relevant needs in this context. By analysis of questionnaires we show that such needs impact the users overall opinion of the system. Furthermore, relations to interaction parameters are analyzed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dörner, D.: Die Mechanik des Seelenwagens. Eine neuronale Theorie der Handlungsregulation. 1. Auflage. Verlag Hans Huber, Bern (2002)

    Google Scholar 

  2. Kieras, D.E.: Model-based Evaluation. In: Jacko, J., Sears, A. (eds.) The Human-Computer Interaction Handbook, pp. 1191–1208. Erlbaum, Mahwah (2003)

    Google Scholar 

  3. Levin, E., Pieraccini, R., Eckert, W.: Using Markov decision process for learning dialogue strategies. In: ICASSP 1998, Seattle, pp. 201-204 (1998)

    Google Scholar 

  4. Pietquin. O.: A framework for unsupervised learning of dialogue strategies. PhD thesis, Faculty of Engineering, Mons (TCTS Lab), Belgium (2004)

    Google Scholar 

  5. Ai, H., Weng, F.: User Simulation as Testing for Spoken Dialog Systems. In: 9th SIGdial Workshop on Discourse and Dialogue, Columbus, OH (2008)

    Google Scholar 

  6. Rieser, V., Lemon, O.: Automatic Learning and Evaluation of User-Centered Objective Functions for Dialogue System Optimisation. In: LREC 2008, Marrakech, Morocco, pp. 2356-2361 (2008)

    Google Scholar 

  7. Walker, M., Litman, D., Kamm, C., Abella, A.: PARADISE: A Framework for Evaluating Spoken Dialogue Agents. In: ACL/EACL 35th Ann. Meeting of the Assoc. for Computational Linguistics, Madrid, pp. 271–280 (1997)

    Google Scholar 

  8. Möller, S., Engelbrecht, K.-P., Schleicher, R.: Predicting the Quality and Usability of Spoken Dialogue Services. Speech Communication 50, 730–744 (2008)

    Article  Google Scholar 

  9. Engelbrecht, K.-P., Hartard, F., Gödde, F., Möller, S.: A Closer Look at Quality Judgments of Spoken Dialog Systems. In: Interspeech 2009, Brighton (2009)

    Google Scholar 

  10. Möller, S., Engelbrecht, K.-P.: Towards a Perception-based Evaluation Model for Spoken Dialogue Systems. In: 4th IEEE Tutorial and Research Workshop PIT, Kloster Irsee (2008)

    Google Scholar 

  11. Engelbrecht, K.-P., Quade, M., Möller, S.: Analysis of a New Simulation Approach to Dialogue System Evaluation. Speech Communication 51, 1234–1252 (2009)

    Article  Google Scholar 

  12. Dörner, D., Gerdes, J., Mayer, M., Misra, S.: A Simulation of Cognitive and Emotional Effects of Overcrowding. In: ICCM 2006, pp. 92–99 (2006)

    Google Scholar 

  13. ITU-T Rec. P.851. Subjective Quality Evaluation of Telephone Services Based on Spoken Dialogue Systems. In: International Telecommunication Union, Geneva (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Engelbrecht, KP., Möller, S. (2010). A User Model to Predict User Satisfaction with Spoken Dialog Systems. In: Lee, G.G., Mariani, J., Minker, W., Nakamura, S. (eds) Spoken Dialogue Systems for Ambient Environments. IWSDS 2010. Lecture Notes in Computer Science(), vol 6392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16202-2_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16202-2_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16201-5

  • Online ISBN: 978-3-642-16202-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics