Skip to main content

Multimodal and Agent-Based Human–Computer Interaction in Cultural Heritage Applications: an Overview

  • Chapter
Complex Intelligent Systems and Their Applications

Part of the book series: Springer Optimization and Its Applications ((SOIA,volume 41))

  • 751 Accesses

Summary

One of the most recent and interesting applications of human–computer interaction technologies is the provision of advanced information services within public places, such as cultural heritage sites or schools and university campuses. In such contexts, concurrent technologies used in smart mobile devices can be used to satisfy the mobility need of users allowing them to access relevant resources in a context-dependent manner. Of course, most of the constraints to be taken into account when designing a pervasive information providing system are given by the actual domain where they are deployed.

This chapter presents an overview of such techniques, focused on two different approaches to the development of human–computer interaction aimed at providing solutions for engaging fruition of cultural heritage sites and exhibits. The chapter will first present multimodality as a key enabler for a more natural interaction with the virtual guide and its surrounding environment. The second approach will be presented next, offering an overview of the evolution of agent-based human–computer interaction systems for the same domain.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Abdel-Naby, S.; Giorgini, P.; Weiss, M. Design patterns for multiagent systems to elevate pocket device applications. Agents World (ESAW’07). NCSR “Demokritos”, Athens, Greece, 22–24 October 2007.

    Google Scholar 

  • Almeida, P.; Yokoi, S. (2003). Interactive character as a virtual tour guide to an online museum exhibition. Proceedings of Museum and the Web.

    Google Scholar 

  • Amigoni, F.; Schiaffonati, V. (2003). The Minerva multiagent system for supporting creativity in museums organization. Proceedings of the IJCAI2003 (Eighteenth International Joint Conference on Artificial Intelligence), Workshop on Creative Systems: Approaches to Creativity in AI and Cognitive Science (IJCAI), Acapulco, Mexico, 9–10 August 2003, pp. 65–74.

    Google Scholar 

  • Amigoni, F.; Schiaffonati, V. (2009). The Minerva system: a step toward automatically created virtual museums. Applied Artificial Intelligence, 23(3), pp. 204–232.

    Article  Google Scholar 

  • Ancona, M., Cappello, M., Casamassima, M., Cazzola, W., Conte, D., Pittore, M., Quercini, G., Scagliola, N., Villa, M. (2006). Mobile vision and cultural heritage: the AGAMEMNON project. Proceedings of the 1st International Workshop on Mobile Vision, Austria, May 2006.

    Google Scholar 

  • Augello, A., Santangelo, A., Sorce, S., Pilato, G., Gentile, A., Genco, A., Gaglio, S. (2006). MAGA: a mobile archaeological guide at Agrigento. Proceedings of the Workshop “Giornata Nazionale su Guide Mobili Virtuali 2006” (ACM-SIGCHI), Italy, Torino, 18 ottobre 2006, online proceedings http://hcilab.uniud.it/sigchi/doc/Virtuality06/index.html.

  • Bellifemine, F., Poggi, A., Rimassa, G. (1999). JADE: a FIPA-compliant agent frame work. CSELT internal technical report. Part of this report has been also published in Proceedings of PAAM’99, London, April 1999, pp. 97–108.

    Google Scholar 

  • Cossentino M., Potts C. (2002). A CASE tool supported methodology for the design of multi-agent systems. Proceedings of the 2002 International Conference on Software Engineering Research and Practice (SERP’02), Las Vegas, NV, USA, 24–27 June 2002.

    Google Scholar 

  • Costantini, S., Tocchio A., (2004). The DALI logic programming agent-oriented language. Logics in Artificial Intelligence, Proceedings of the 9th European Conference. LNAI, vol. 3229, Springer, Berlin, pp. 685–688.

    Google Scholar 

  • Costantini S., Mostarda, L., Tocchio, A., Tsintza P. (2008). DALICA: agent-based ambient intelligence for cultural-heritage acenarios. IEEE Intelligent Systems, 23(2), pp. 34–41.

    Google Scholar 

  • Damala, A., Cubaud, P., Bationo, A., Houlier, P., Marchal, I. (2008). Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit. Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts (DIMEA ’08), Athens, Greece, pp. 120–127.

    Google Scholar 

  • Damiano, R., Galia, C., Lombardo, V. (2006). Virtual tours across different media in DramaTour project. Workshop Intelligent Technologies for Cultural Heritage Exploitation at the 17th European Conference on Artificial Intelligence (ECAI 2006), Riva del Garda, pp. 21–25.

    Google Scholar 

  • Ducatel K., Bogdanowicz M., Scapolo F., Leijten J., Burgelman J.-C. (2001). Scenarios for ambient intelligence in 2010. Technical report, Information Society Technologies Programme of the European Union Commission (IST), Feb. 2001. http://www.cordis.lu/ist/.

  • Farella, E., Brunelli, D., Benini, L., Ricco, B., Bonfigli, M.E. (2005). Computing for interactive virtual heritage. IEEE Multimedia, 12(3), pp. 46–58.

    Article  Google Scholar 

  • Gentile A., Cossentino, M., Vitabile, S., Chella, A., Sorbello F. (2002). Intelligent agent mapping on a massively parallel MIMD computing platform. Proceedings of 2002 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA 2002), vol. II, CSREA Press, Las Vegas, pp. 850–855.

    Google Scholar 

  • Giunchiglia F., Mylopoulos J., Perini A. (2002). The Tropos software development methodology: processes, models and diagrams. AAMAS Conference 2002.

    Google Scholar 

  • Hodjat, B., Hodjat, S., Treadgold, N., Jonsson, I. (2006). CRUSE: a context reactive natural language mobile interface. Proceedings of the 2nd Annual International Workshop on Wireless Internet (WICON ’06), Boston, Massachusetts, 2–5 August 2006, ACM, New York, p. 20.

    Chapter  Google Scholar 

  • Huang H., Cerekovic, A., Pandzic, I. S., Nakano, Y., Nishida, T. (2009). Toward a multi-culture adaptive virtual tour guide agent with a modular approach. AI & Society, 24(3), pp. 225–235.

    Article  Google Scholar 

  • Ibanez, J., Aylett, R., Ruiz-Rodarte R. (2003). Storytelling in virtual environments form a virtual guide perspective. Virtual Reality, 7(1).

    Google Scholar 

  • Jones, C.M., Lim, M.Y., Aylett, R. (2005). Empathic interaction with a virtual guide. AISB Symposium on Empathic Interaction, University of Hertfordshire, 12–15 April 2005.

    Google Scholar 

  • Kling, R. 1991. Cooperation, coordination and control in computer-supported work. Communications of the ACM, 34(12), pp. 83–88.

    Article  Google Scholar 

  • Liarokapis F., Newman, R. M. (2007). Design experiences of multimodal mixed reality interfaces. Proceedings of the 25th Annual ACM International Conference on Design of Communication, El Paso, TX, USA, pp. 34–41.

    Google Scholar 

  • Lind, J. (2001). Iterative software engineering for multiagent systems. The MASSIVE Method. Lecture Notes in Computer Science, vol. 1994, Springer, Berlin.

    Google Scholar 

  • Lopez-Jaquero, V., Montero, F., Gonzalez, P. (2009). AB-HCI: an interface multi-agent system to support human-centred computing. Software, IET, 3(1), pp. 14–25.

    Article  Google Scholar 

  • McNeese, M.D.; Zaff, B.S.; Citera, M.; Brown, C.E.; Whitaker, R. (1995). AKADAM: eliciting user knowledge to support participatory ergonomics. The International Journal of Industrial Ergonomics, 15(5), pp. 345–363.

    Article  Google Scholar 

  • Nickerson, M. (2005). All the world is a museum: access to cultural heritage information anytime, anywhere. Proceedings of International Cultural Heritage Informatics Meeting, ICHIM05, Paris, September 2005, pp. 2–15.

    Google Scholar 

  • Padgham, L., Winikoff, M. (2005). Prometheus: a practical agent-oriented methodology. Agent-Oriented Methodologies, edited by B. Henderson-Sellers and P. Giorgini, Idea Group.

    Google Scholar 

  • Penserini, L., Liu, L., Mylopoulos, J., Panti, M., Spalazzi, L. (2003) Cooperation strategies for agent-based P2P systems. WIAS: Web Intelligence and Agent Systems: An International Journal, 1(1), pp. 3–21.

    Google Scholar 

  • Pilato, G., Vitabile, S., Conti, V., Vassallo, G., Sorbello, F. (2004a). Web directories as a knowledge base to build a multi-agent system for information sharing. Web Intelligence and Agent Systems, An International Journal, 2(4), pp. 265–277.

    Google Scholar 

  • Pilato, G., Vitabile, S., Conti, V., Vassallo, G., Sorbello, F. (2004b). A mobile agent based system for documents classification and retrieval. Intelligenza Artificiale, 1(3), pp. 34–40.

    Google Scholar 

  • Rakotonirainy, A., Loke, S. W., Zaslavsky A. Multi-agent support for open mobile virtual communities. Proceedings of the International Conference on Articial Intelligence (IC-AI 2000) (Vol. I), Las Vegas, NV, USA, pp. 127–133, 2000.

    Google Scholar 

  • Santoro, C., Paternò, F., Ricci G., Leporini B. (2007). A multimodal mobile museum guide for all. Proceedings of the Mobile Interaction with the Real World (MIRW 2007) in Conjunction with the 5th Workshop on “HCI in Mobile Guides”, Singapore, September 09.

    Google Scholar 

  • Shah, N., Siddiqi, J. I. A., Akhgar, B. (2007). An intelligent agent based approach to MOSAICA’s pedagogical framework. Proceedings of the Ninth International Conference on Enterprise Information Systems (ICEIS), pp. 219–226.

    Google Scholar 

  • Stock, O., Zancanaro, M., Busetta, P., Callaway, C., Krüger, A., Kruppa, M., Kuflik, V., Not, E., Rocchi, C. (2007). Adaptive, intelligent presentation of information for the museum visitor in PEACH. User Modeling and User-Adapted Interaction, 17(3), pp. 257–304.

    Article  Google Scholar 

  • Weiser M. (1991). The computer for the twenty-first century. Scientific American, pp. 94–10.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Salvatore Vitabile .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Gentile, A., Vitabile, S. (2010). Multimodal and Agent-Based Human–Computer Interaction in Cultural Heritage Applications: an Overview. In: Xhafa, F., Barolli, L., Papajorgji, P. (eds) Complex Intelligent Systems and Their Applications. Springer Optimization and Its Applications, vol 41. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-1636-5_11

Download citation

Publish with us

Policies and ethics