Skip to main content

Multimodal Presentation of Information in a Mobile Context

  • Chapter
  • First Online:
Advanced Intelligent Environments

Abstract

This chapter deals with the design of multimodal information systems in the framework of ambient intelligence . Its agent architecture is based on KUP, an alternative to traditional software architecture models for human–computer interaction . The KUP model is accompanied by an algorithm for choosing and instantiating interaction modalities. The model and the algorithm have been implemented in a platform called PRIAM, with which we have performed experiments in pseudo-real scale.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • AndrĂ©, E. (2000).The Generation of Multimedia Presentations. In Dale, R., Moisl, H., and Somers, H., editors, A Handbook of Natural Language Processing, pages 305–327. Marcel Dekker, Inc. New York.

    Google Scholar 

  • Bass, L., Faneuf, R., Little, R., Mayer, N., Pellegrino, B., Reed, S., Seacord, R., Sheppard, S., and Szczur, M. R. (1992). A Metamodel for the Runtime Architecture of an Interactive System. SIGCHI Bulletin, 24(1):32–37.

    Article  Google Scholar 

  • Bell, B. and Feiner, S. (2000). Dynamic Space Management for User Interfaces. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, pages 239–248. ACM Press New York, USA.

    Google Scholar 

  • Berger, S., Kjeldsen, R., Narayanaswami, C., Pinhanez, C., Podlaseck, M., and Raghunath, M. (2005). Using Symbiotic Displays to View Sensitive Information in Public. In The 3rd IEEE International Conference on Pervasive Computing and Communications (PerCom 2005), pages 139–148.

    Google Scholar 

  • Bernsen, N. (1994). Foundations of Multimodal Representations: A Taxonomy of Representational Modalities. Interacting with Computers, 6(4):347–371.

    Article  Google Scholar 

  • Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Florins, M., and Vanderdonckt, J. (2002). Plasticity of User Interfaces: A Revised Reference Framework. Proceedings of the 1st International Workshop on Task Models and Diagrams for User Interface Design Table of Contents, pages 127–134.

    Google Scholar 

  • Chou, S.-C., Hsieh, W.-T., Gandon, F. L., and Sadeh, N. M. (2005). Semantic Web Technologies for Context-Aware Museum Tour Guide Applications. In Proceedings of the 19th International Conference on Advanced Information Networking and Applications (AINA’05), pages 709–714. IEEE Computer Society, Washington, DC.

    Google Scholar 

  • Coutaz, J. (1987). PAC, an Object-Oriented Model for Dialog Design. In Bullinger, H.-J. and Shackel, B., editors, Proceedings of International Conference on Human-Computer Interaction (INTERACT’87), pages 431–436. North-Holland.

    Google Scholar 

  • Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., and Richard, Y. M. (1995). Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE Properties. In Proceedings of International Conference on Human-Computer Interaction (INTERACT’95), pages 115–120.

    Google Scholar 

  • Dey, A. K., Salber, D., and Abowd, G. D. (2001). A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-aware Applications. Human Computer Interaction, 16(2-4):97–166.

    Article  Google Scholar 

  • Eaddy, M., BlaskĂł, G., Babcock, J., and Feiner, S. (2004). My own Private Kiosk: Privacy-Preserving Public Displays. In Proceedings of Eighth International Symposium on Wearable Computers (ISWC 2004).

    Google Scholar 

  • Hlavacs, H., Gelies, F., Blossey, D., and Klein, B. (2005). A Ubiquitous and Interactive Zoo Guide System. In Proceedings of the 1st International Conference on Intelligent Technologies for Interactive Entertainment (Intetain 2005), volume 3814 of Lecture Notes in Computer Science (LNCS), pages 235–239. Springer.

    Google Scholar 

  • Hutchings, D., Stasko, J., and Czerwinski, M. (2005). Distributed Display Environments. Interactions, 12(6):50–53.

    Article  Google Scholar 

  • Jacquet, C., Bellik, Y., and Bourda, Y. (2006). Dynamic Cooperative Information Display in Mobile Environments. In Gabrys, B., Howlet, R., and Jain, L., editors, 10th International Conference on Knowledge-Based … Intelligent Information … Engineering Systems (KES2006), volume 4252 of Lecture Notes in Artificial Intelligence (LNAI), pages 154–161. Springer-Verlag, Germany.

    Google Scholar 

  • Jacquet, C., Bourda, Y., and Bellik, Y. (2005). An Architecture for Ambient Computing. In Hagras, H. and Callaghan, V., editors, The IEE International Workshop on Intelligent Environments (IE 2005), es 47–54. The IEE.

    Google Scholar 

  • Kindberg, T. and Barton, J. (2001). A Web-Based Nomadic Computing System. Computer Networks, 35(4):443–456.

    Article  Google Scholar 

  • Krasner, G. E. and Pope, S. T. (1988). A Cookbook for Using the Model-View Controller User Interface Paradigm in Smalltalk-80. Journal of Object Oriented Programming, 1(3):26–49.

    Google Scholar 

  • Lok, S., Feiner, S., and Ngai, G. (2004). Evaluation of Visual Balance for Automated Layout. In Proceedings of the 9th International Conference on Intelligent User Interface, pages 101–108. ACM Press, New York, USA.

    Google Scholar 

  • Long, S., Kooper, R., Abowd, G. D., and Atkeson, C. G. (1996). Rapid Prototyping of Mobile Context-Aware Applications: The Cyberguide Case Study. In Mobile Computing and Networking, pages 97–107. ACM, New York

    Google Scholar 

  • Mansoux, B., Nigay, L., and Troccaz, J. (2005). The Mini-Screen: An Innovative Device for Computer Assisted Surgery Systems. Studies in Health Technology and Informatics, 111:314–320.

    Google Scholar 

  • Pfaff, G. E., editor (1985). User Interface Management Systems: Proceedings of the Seeheim Workshop. Springer.

    Google Scholar 

  • Streitz, N. A., Röcker, C., Prante, T., Stenzel, R., and van Alphen, D. (2003). Situated Interaction with Ambient Information: Facilitating Awareness and Communication in Ubiquitous Work Environments. In Proceedings of International Conference on Human-Computer Interaction.

    Google Scholar 

  • Teil, D. and Bellik, Y. (2000). Multimodal Interaction Interface Using Voice and Gesture. In Taylor, M. M., NĂ©el, F., and Bouwhuis, D. G., editors, The Structure of Multimodal Dialogue II, Chapter 19, pages 349–366. John Benjamins Publishing Company, Amsterdam.

    Google Scholar 

  • Tomitsch, M., Grechenig, T., and Mayrhofer, S. (2007). Mobility and Emotional Distance: Exploring the Ceiling as an Ambient Display to Provide Remote Awareness. In The Third IET Conference on Intelligent Environments (IE 2007), pages 164–167.

    Google Scholar 

  • Vogel, D. and Balakrishnan, R. (2004). Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, pages 137–146. ACM Press, New York, USA.

    Google Scholar 

  • Weiser, M. (1993). Some Computer Science Issues in Ubiquitous Computing. Communications of the ACM, 36(7):75–84.

    Article  Google Scholar 

  • Zhou, M. X., Wen, Z., and Aggarwal, V. (2005). A Graph-Matching Approach to Dynamic Media Allocation in Intelligent Multimedia Interfaces. In Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI ’05), pages 114–121. ACM.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christophe Jacquet .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag US

About this chapter

Cite this chapter

Jacquet, C., Bourda, Y., Bellik, Y. (2009). Multimodal Presentation of Information in a Mobile Context. In: Kameas, A., Callagan, V., Hagras, H., Weber, M., Minker, W. (eds) Advanced Intelligent Environments. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-76485-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-76485-6_4

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-76484-9

  • Online ISBN: 978-0-387-76485-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics