Abstract
This chapter investigates some issues faced in developing multimodal data services for public mobile telecommunications. It discusses applications, standards, mobile devices, and existing R&D efforts. Three demonstrators developed by the authors are presented, including QuickMap, a map finder based on GPRS and WAP-Push. Findings are summarised in the description of a path that will lead to successful multimodal data services in mobile telecommunications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Almeida, L., Amdal, I., Beires, N., Boualem, M., Boves, L., den Os, E., Filoche, P., Gomes, R., Knudsen, J. E., Kvale, K., Rugelbak, J., Tallec, C., and Warakagoda, N. (2002). The MUST guide to Paris; implementation and expert evaluation of a multimodal tourist guide to Paris. In Proceedings of ISCA Tutorial and Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), Kloster Irsee, Germany.
Azzini, I., Giorgino, T., Nardelli, L., Orlando, M., and Rognoni, C. (2002). An architecture for a multi-modal web browser. In Proceedings of ISCA Tutorial and Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), Kloster Irsee, Germany.
Bohus, D. and Rudnicky, A. (2004). LARRI: A language-based maintenance and repair assistant. In Minker, W., Bühler, D., and Dybkjær, L., editors, Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Kluwer Academic Publishers, Dordrecht, The Netherlands. (this volume).
Bühler, D., Minker, W., Häussler, J., and Krüger, S. (2002). The SmartKom Mobile multi-modal dialogue system. In Proceedings of ISCA Tutorial and A Path to Multimodal Data Services for Telecommunications Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), pages 66–70, Kloster Irsee, Germany.
Cheyer, A. and Martin, D. (2001). The Open Agent Architecture. Journal of Autonomous Agents and Multi-Agent Systems, 4(1/2):143–148.
Cohen, P., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. (1997). QuickSet: Multimodal interaction for distributed applications. In Proceedings of ACM International Conference on Multimedia, pages 31–40, Seattle, Washington, USA.
Cohen, P. and Oviatt, S. (1995). The role of voice input for human-machine communication. In Proceedings of National Academy of Sciences, number 22, pages 9921–9927.
Doherty, P., Granlund, G., Kuchcinski, K., Sandewall, E., Nordberg, K., Skarman, E., and Wiklund, J. (2000). The WITAS unmanned aerial vehicle project. In Proceedings of 14th European Conference on Artificial Intelligence (ECAI), pages 747–755, Berlin, Germany.
Elting, C. and Michelitsch, G. (2001). A multimodal presentation planner for a home entertainment environment. In Proceedings of Workshop on Perceptive User Interfaces (PUI), Lake Buena Vista, Florida, USA.
Goldschen, A. and Loehr, D. (1999). The role of the DARPA communicator architecture as a human computer interface for distributed simulations. In Proceedings of Spring Simulation Interoperability Workshop, Orlando, Florida, USA. Simulation Interoperability Standards Organization.
Herfet, T. and Kirste, T. (2001). EMBASSI — multimodal assistance for infotainment & service infrastructures. In Proceedings of Statustagung der Leitprojekte Mensch-Technik-Interaktion, pages 35–44, Saarbrficken, Germany.
Hoellerer, S. (2002). Challenges and important aspects in planning and performing evaluation studies for multimodal dialogue systems. In Proceedings of ELSNET Workshop Towards a Roadmap for Multimodal Language Resources and Evaluation at LREC 2002, Las Palmas, Gran Canaria, Spain.
Huang, X., Acero, A., Chelba, C., Deng, L., Duchene, D., Goodman, J., Hon, H., Jacoby, D., Jiang, L., Loynd, R., Mahajan, M., Mau, P., Meredith, S., Mughal, S., Neto, S., Plumpe, M., Wang, K., and Wang, Y. (2000). MIPAD: A next generation PDA prototype. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 33–36, Beijing, China.
Ishii, H. (2002). Tangible bits: Designing the seamless interface between people, bits and atoms. Keynote speech at Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02). Pittsburgh, Pennsylvania, USA.
Johnston, M., Bangalore, S., Stent, A., Vasireddy, G., and Ehlen, P. (2002). Multimodal language processing for mobile information access. In Proceedings of International Conference on Spoken Language Processing (ICSLP), pages 2237–2241, Denver, Colorado, USA.
Kleindienst, J., Seredi, L., Kapanen, P., and Bergman, J. (2002). CATCH-2004 multi-modal browser: Overview description with usability analysis. In Proceedings of IEEE International Conference on Multimodal Interfaces (ICMI), pages 442–447, Pittsburgh, Pennsylvania, USA.
Kumar, S., Cohen, P., and Levesque, H. (2000). The Adaptive Agent Architecture: Achieving fault-tolerance using persistent broker teams. In Proceedings of International Conference on Multi-Agent Systems (ICMAS), pages 159–166, Boston, Massachusetts, USA.
Lemon, O., Bracy, A., Gruenstein, A., and Peters, S. (2001). The WITAS multi-modal dialogue system I. In Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH), pages 1559–1562, Aalborg, Denmark.
Maybury, M. T. (2002). Multimodal systems, resources, and evaluation. In Proceedings of International Conference on Language Resources and Evaluation (LREC), pages g–n, Las Palmas, Gran Canaria, Spain.
Nass, C. (2002). Integrating multiple modalities: Psychology and design of multimodal interfaces. Keynote speech at Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02). Pittsburgh, Pennsylvania, USA.
Niklfeld, G., Finan, R., and Pucher, M. (2001a). Architecture for adaptive multimodal dialog systems based on VoiceXML. In Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH), pages 2341–2344, Aalborg, Denmark.
Niklfeld, G., Finan, R., and Pucher, M. (2001b). Multimodal interface architecture for mobile data services. In Proceedings of TCMC Workshop on Wearable Computing, Graz, Austria.
Oviatt, S. (2000). Multimodal system processing in mobile environments. In Proceedings of Annual ACM Symposium on User Interface Software and Technology, pages 21–30, San Diego, California, USA.
Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., and Ferro, D. (2000). Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions. Human Computer Interaction, 15:263–322.
Oviatt, S., Stevens, C., Coulston, R., Xiao, B., Wesson, M., Girand, C., and Mellander, E. (2002). Towards adaptive conversational interfaces: Modeling speech convergence with animated personas. In Proceedings of ISCA Tutorial and Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), Kloster Irsee, Germany.
Pearce, D. and Kopp, D. (2001). ETSI STQ Aurora presentation to 3GPP. Slide presentation.
Pieraccini, R., Carpenter, B., Woudenberg, E., Caskey, S., Springer, S., Bloom, J., and Phillips, M. (2002). Multi-modal spoken dialog with wireless devices. In Proceedings of ISCA Tutorial and Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), Kloster Irsee, Germany.
Pospischil, G., Umlauft, M., and Michlmayr, E. (2002). Designing Lol@, a mobile tourist guide for UMTS. In Proceedings of International Symposium on Human Computer Interaction with Mobile Devices (Mobile HCI), pages 140–154, Pisa, Italy.
Rössler, H., Sienel, J., Wajda, W., Hoffmann, J., and Kostrzewa, M. (2001). Multimodal interaction for mobile environments. In Proceedings of International Workshop on Information Presentation and Natural Multimodal Dialogue, pages 47–51, Verona, Italy.
Seneff, S., Hurley, E., Lau, R., Pao, C., Schmid, P., and Zue, V. (1998). Galaxy-II: a reference architecture for conversational system development. In Proceedings of International Conference on Spoken Language Processing (IC-SLP), pages 931–934, Sydney, Australia.
Sturm, J., Bakx, I., Cranen, B., Terken, J., and Wang, F. (2002a). Usability evaluation of a Dutch multimodal system for railway information. In Proceedings of International Conference on Language Resources and Evaluation (LREC), pages 255–261, Las Palmas, Gran Canaria, Spain.
Sturm, J., Cranen, B., Wang, F., Terken, J., and Bakx, I. (2002b). The effect of user experience on interaction with multimodal systems. In Proceedings of ISCA Tutorial and Research Workshop Multimodal Dialogue in Mobile Environments (IDS02), Kloster Irsee, Germany.
Wahlster, W., Reithinger, N., and Blocher, A. (2001). SmartKom: Multimodal communication with a life-like character. In Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH), pages 1547–1550, Aalborg, Denmark.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer
About this chapter
Cite this chapter
Niklfeld, G., Pucher, M., Finan, R., Eckhart, W. (2005). A Path to Multimodal Data Services for Telecommunications. In: Minker, W., Bühler, D., Dybkjær, L. (eds) Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Text, Speech and Language Technology, vol 28. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3075-4_9
Download citation
DOI: https://doi.org/10.1007/1-4020-3075-4_9
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-3073-4
Online ISBN: 978-1-4020-3075-8
eBook Packages: Computer ScienceComputer Science (R0)