Abstract
In this chapter we outline a multimodal interaction description language XISL (eXtensible Interaction Scenario Language) that has been developed to describe MMI scenarios. The main feature of XISL is that it allows modalities to be described flexibly, which makes it easy to add new modalities or to modify existing modalities on MMI systems. Moreover, XISL is separately described from XML or HTML contents, thus making both the XISL and XML (HTML) documents more reusable. We constructed three types of XISL execution systems, namely a PC terminal, a PDA terminal, and a mobile phone terminal, and show the descriptive power of XISL by implementing an online shopping application on these terminals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beckham, J. L., Fabbrizio, G. D., and Klarlund, N. (2001). Towards SMIL as a foundation for multimodal, multimedia applications. In Proceedings of European Conference on Speech Communication and Technology (EURO-SPEECH), pages 1363–1366, Aalborg, Denmark.
Kamio, H., Amamiya, M., Matsu'ura, H., and Nitta, T. (1997). Muse, a rapid prototyping tool. In Proceedings of International Conference on Human-Computer Interaction, pages 569–572, San Francisco, California, USA.
Katsurada, K., Ootani, Y., Nakamura, Y., Kobayashi, S., Yamada, H., and Nitta, T. (2002). A modality-independent MMI system architecture. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 2549–2552, Denver, Colorado, USA.
Nitta, T., Katsurada, K., Yamada, H., Nakamura, Y., and Kobayashi, S. (2001). XISL: An attempt to separate multimodal interactions from XML contents. In Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH), pages 1197–1200, Aalborg, Denmark.
Wang, K. (2002). SALT: A spoken language interface for web-based multimodal dialog systems. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 2241–2244, Denver, Colorado, USA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer
About this chapter
Cite this chapter
Katsurada, K., Yamada, H., Nakamura, Y., Kobayashi, S., Nitta, T. (2005). XISL: A Modality-Independent MMI Description Language. In: Minker, W., Bühler, D., Dybkjær, L. (eds) Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Text, Speech and Language Technology, vol 28. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3075-4_8
Download citation
DOI: https://doi.org/10.1007/1-4020-3075-4_8
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-3073-4
Online ISBN: 978-1-4020-3075-8
eBook Packages: Computer ScienceComputer Science (R0)