Summary
We report on the experience gained in building large-scale research prototypes of fully integrated multimodal dialogue systems in the context of the SmartKom project. The development of such systems requires a flexible software architecture and adequate software support to cope with the challenge of system integration. A practical result of our experimental work is an advanced integration platform that enables flexible reuse and extension of existing software modules and that is able to deal with a heterogeneous software environment. Starting from the foundations of our general framework, we give an overview of the SmartKom testbed, and we describe the practical organization of the development process within the project.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
L. Bass, P. Clements, and R. Kazman. Software Architecture in Practice. Addison-Wesley, Boston, MA, 2nd edn., 2003.
P.A. Bernstein. Middleware: A Model for Distributed System Services. Communications of the ACM, 39(2):86–98, 1989.
T. Bub and J. Schwinn. The Verbmobil Prototype System—A Software Engineering Perspective. Natural Language Engineering, 5(1):95–112, 1999.
N. Carriero and D. Gelernter. Linda in Context. Communications of the ACM, 32(4):444–458, 1989.
W. Emmerich. Software Engineering and Middleware: A Roadmap. In: Proc. Conf. on the Future of Software Engineering, pp. 117–129, Limerick, Ireland, 2000. ACM.
L.D. Erman, F. Hayes-Roth, V.R. Lesser, and D.R. Reddy. The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty. ACM Computing Surveys, 12(2):213–253, 1980.
D. Fensel, F. van Harmelen, I. Horrocks, D.L. McGuinness, and P.F. Patel-Schneider. OIL: An Ontology Infrastructure for the Semantic Web. IEEE Intelligent Systems, 16(2):38–45, 2001.
K. Geihs. Middleware Challenges Ahead. IEEE Computer, 34(6):24–31, 2001.
A. Geist, A. Beguelin, J. Dongorra, W. Jiang, R. Manchek, and V. Sunderman. PVM: Parallel Virtual Machine. A User’s Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, MA, 1994.
I. Gurevych, S. Merten, and R. Porzel. Automatic Creation of Interface Specifications from Ontologies. In: H. Cunningham and J. Patrick (eds.), Proc. HLTNAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 59–66, Edmonton, Canada, 2003. Association for Computational Linguistics.
G. Herzog, H. Kirchmann, S. Merten, A. Ndiaye, P. Poller, and T. Becker. MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems. In: H. Cunningham and J. Patrick (eds.), Proc. HLT-NAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 75–82, Edmonton, Canada, 2003. Association for Computational Linguistics.
G. Herzog, A. Ndiaye, S. Merten, H. Kirchmann, T. Becker, and P. Poller. Large-Scale Software Integration for Spoken Language and Multimodal Dialog Systems. Natural Language Engineering, 10(3–4):283–305, 2004. Special Issue on Software Architecture for Language Engineering.
J. Hopkins. Component Primer. Communications of the ACM, 43(10):27–30, 2000.
A. Klüter, A. Ndiaye, and H. Kirchmann. Verbmobil From a Software Engineering Point of View: System Design and Software Integration. In: W. Wahlster (ed.), Verbmobil: Foundations of Speech-to-Speech Translation, pp. 635–658, Berlin Heidelberg New York, 2000. Springer.
N. Reithinger, G. Herzog, and A. Ndiaye. Situated Multimodal Interaction in SmartKom. Computers & Graphics, 27(6):899–903, 2003.
W. Wahlster. SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: R. Krahl and D. Günther (eds.), Proc. Human Computer Interaction Status Conference 2003, pp. 47–62, Berlin, Germany, June 2003. DLR.
M.W. Wu and Y.D. Lin. Open Source Software Development: An Overview. IEEE Computer, 34(6):33–38, 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Herzog, G., Ndiaye, A. (2006). Building Multimodal Dialogue Applications: System Integration in SmartKom. In: Wahlster, W. (eds) SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-36678-4_28
Download citation
DOI: https://doi.org/10.1007/3-540-36678-4_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23732-7
Online ISBN: 978-3-540-36678-2
eBook Packages: Computer ScienceComputer Science (R0)