Abstract
This paper presents the COOKCOACH, a system that guides the user while cooking a recipe during a spoken dialogue coaching session. We describe our experience creating the first version of our coaching dialogue system that helps the user cook a selected dish.We use the CMU dialogue systems framework OLYMPUS. The main challenge we faced was the change of paradigm: instead of the system being driven by the user, the user is guided by the system. The result is a system capable of dictating generic tasks to the user. The methodology allows us to create different systems in diverse domains for similar guidance tasks that support the user while s/he performs some procedural task. The use of ontologies to facilitate the creation of new systems is briefly explored.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dan Bohus, Antoine Raux, Thomas K. Harris, Maxine Eskenazi, and Alexander I. Rudnicky, “Olympus: an open-source framework for conversational spoken language interface research,” in NAACL-HLT ’07: Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies, 2007.
Dan Bohus and Alexander I. Rudnicky, “The RavenClaw dialog management framework: Architecture and systems,” Computer Speech and Language, vol. 23, no. 3, 2009.
Alan Black and Maxine Eskenazi, “The spoken dialogue challenge,” in Proceedings of SIGDIAL. 2009, ACL.
Dan Bohus and Alexander I. Rudnicky, “LARRI: A language-based maintenance and repair assistant,” in Spoken Multimodal Human-Computer Dialogue in Mobile Environments, vol. 28 of Text, Speech and Language Technology, pp. 203–218. Springer Netherlands, 2005.
Gregory Aist, John Dowding, Beth Ann Hockey, Manny Rayner, James Hieronymus, Dan Bohus, Bradley Boven, Nate Blaylock, Ellen Campana, Susana Early, Genevieve Gorrell, and Steven Phan, “Talking through procedures: an Intelligent Space Station procedure assistant,” in Proceedings of EACL, 2003.
Manny Rayner, Beth Ann Hockey, James Hieronymus, John Dowding, Gregory Aist, and Susana Early, “An intelligent procedure assistant built using REGULUS 2 and ALTERF,” in Proceedings of ACL, 2003.
Robert E. Kraut, Susan R. Fussell, and Jane Siegel, “Visual information as a conversational resource in collaborative physical tasks,” Human-computer interaction, vol. 18, no. 1, 2003.
Ricardo Ribeiro, Fernando Batista, Joana Paulo Pardal, Nuno J. Mamede, and H. Sofia Pinto, “Cooking an ontology,” in AIMSA. 2006, vol. 4183 of LNCS, Springer.
Telmo Ramos Machado, “Extracç ão de informaç ão – introduç ão automática de receitas de acordo com ontologia,” M.S. thesis, IST, Technical University of Lisbon, 2007.
Dan Tasse and Noah A. Smith, “SOUR CREAM: Toward semantic processing of recipes,” Tech. Rep. CMU-LTI-08-005, Carnegie Mellon University, 2008.
Brian K. Reid, “USENET CookBook: An experiment in electronic publication,” Tech. Rep. WRL-87-7, Digital Equipment Corporation Western Research Lab (now HP Labs), 1987.
Filipe M. Martins, Ana Cristina Mendes, Márcio Viveiros, Joana Paulo Pardal, Pedro Arez, Nuno J. Mamede, and Joao Paulo Neto, “Reengineering a domainindependent framework for spoken dialogue systems,” in Software Engineering, Testing, and Quality Assurance for Natural Language Processing. 2008, SETQA-NLP, ACL.
Filipe M. Martins, Joana Paulo Pardal, Luís Franqueira, Pedro Arez, and Nuno J. Mamede, “Starting to cook a tutoring dialogue system,” in Proc. SLT, 2008.
James Allen, George Ferguson, Mary Swift, Amanda Stent, Scott Stoness, Lucian Galescu, Nathan Chambers, Ellen Campana, and Gregory Aist, “Two diverse systems built using generic components for spoken dialogue (recent progress on TRIPS),” in Proc. ACL Interactive Poster and Demos Sessions, 2005.
David Milward and Martin Beveridge, “Ontology-based dialogue systems,” in 3rd Workshop on Knowledge and Reasoning in Practical Dialogue Systems – IJCAI, 2003.
Annika Flycht-Eriksson, Design and Use of Ontologies in Informationproviding Dialogue Systems, Ph.D. thesis, School of Engineering at Link¨oping University, 2004.
Joana Paulo Pardal, “Dynamic use of ontologies in dialogue systems,” in Proc. NAACL-HLT 2007 Doctoral Consortium, 2007.
Joana Paulo Pardal, “Position paper on spoken dialogue systems,” in Young Researchers Roundtable on Spoken Dialogue Systems, 2009, YRRoSDS.
Joana Paulo Pardal, “Position paper on spoken dialogue systems,” in Young Researchers Roundtable on Spoken Dialogue Systems, 2008, YRRoSDS.
Michael Schneider, “The Semantic Cookbook: Sharing cooking experiences in the Smart Kitchen,” in IET, 2007.
Acknowledgements
Joana Paulo Pardal is supported by a PhD fellowship from the Portuguese National Science Foundation, Fundao para a Cilncia e Tecnologia, FCT (SFRH/BD/30791/ 2006). This work was partially funded by FCT (INESC-ID multi-annual funding) through the PIDDAC Program funds.
We gratefully thank James F. Allen and Mary D. Swift for their insightful input and comments.
The OntoChef ontology was joint work with Fernando Batista, Ricardo Ribeiro and Paula Vaz.
The prototype of the Cook Tutor was joint work with Filipe Martins, Luís Franqueira, Pedro Arez and Luísa Coheur.
The authors would also like to thank Dan Bohus and Matthew Marge for the support provided in the use of Olympus/RavenClaw and about LARRI and IPA implementations.
Finally, none of this work would have been possible without the help of family and friends that supported our work throughout the experiences, and, most importantly, volunteered to be recorded for the Cooking Corpus.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this paper
Cite this paper
Pardal, J.P., Mamede, N.J. (2011). Starting to Cook a Coaching Dialogue System in the Olympus framework. In: Delgado, RC., Kobayashi, T. (eds) Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1335-6_26
Download citation
DOI: https://doi.org/10.1007/978-1-4614-1335-6_26
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-1334-9
Online ISBN: 978-1-4614-1335-6
eBook Packages: EngineeringEngineering (R0)