Abstract
In this paper, we present an agent-based dialog simulation technique for learning new dialog strategies and evaluate conversational agents. Using this technique the effort necessary to acquire data required to train the dialog model and then explore new dialog strategies is considerably reduced. A set of measures has also been defined to evaluate the dialog strategy that is automatically learned and compare different dialog corpora. We have applied this technique to explore the space of possible dialog strategies and evaluate the dialogs acquired for a conversational agent that collects monitored data from patients suffering from diabetes.
Funded by projects CICYT TIN2008-06742-C02-02/TSI, CICYT TEC2008-06732-C02- 02/TEC, CAM CONTEXTS (S2009/TIC-1485), and DPS2008-07029-C02-02.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ai, H., Raux, A., Bohus, D., Eskenazi, M., Litman, D.: Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users. In: Proc. of the 8th SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, pp. 124–131 (2007)
Black, L., McTear, M.F., Black, N.D., Harper, R., Lemon, M.: Appraisal of a conversational artefact and its utility in remote patient monitoring. In: Proc. of the 18th IEEE Symposium CBMS 2005, Dublin, Ireland, pp. 506–508 (2005)
Griol, D., Sánchez-Pi, N., Carbó, J., Molina, J.: An Architecture to Provide Context-Aware Services by means of Conversational Agents. Advances in Intelligent and Soft Computing 79, 275–282 (2010)
Paek, T., Horvitz, E.: Conversation as action under uncertainty. In: Proc. of the 16th Conference on Uncertainty in Artificial Intelligence, San Francisco (USA), pp. 455–464 (2000)
Schatzmann, J., Georgila, K., Young, S.: Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems. In: Proc. of the 6th SIGdial Workshop on Discourse and Dialogue, Lisbon, Portugal, pp. 45–54 (2005)
Schatzmann, J., Thomson, B., Weilhammer, K., Ye, H., Young, S.: Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System. In: Proc. of Human Language Technologies HLT/NAACL 2007 Conference, Rochester, USA, pp. 149–152 (2007)
Schatzmann, J., Weilhammer, K., Stuttle, M., Young, S.: A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies. Knowledge Engineering Review 21(2), 97–126 (2006)
Young, S.: The Statistical Approach to the Design of Spoken Dialogue Systems. Tech. rep., CUED/F-INFENG/TR 433, Cambridge University Engineering Department, Cambridge, UK (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Griol, D., Sánchez-Pi, N., Carbó, J., Molina, J.M. (2011). An Agent-Based Dialog Simulation Technique to Develop and Evaluate Conversational Agents. In: Demazeau, Y., Pěchoucěk, M., Corchado, J.M., Pérez, J.B. (eds) Advances on Practical Applications of Agents and Multiagent Systems. Advances in Intelligent and Soft Computing, vol 88. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19875-5_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-19875-5_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19874-8
Online ISBN: 978-3-642-19875-5
eBook Packages: EngineeringEngineering (R0)