Skip to main content
Log in

A stroll with Carletto: adaptation in drama-based tours with virtual characters

  • Original Paper
  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

In this paper, we present an application for character-based guided tours on mobile devices. The application is based on the Dramatour methodology for information presentation, which incorporates a dramatic attitude in character-based presentations. The application has been developed for a historical site and is based on a virtual character, “Carletto”, a spider with an anthropomorphic aspect, who engages in a dramatized presentation of the site. Content items are delivered in a location-aware fashion, relying on a wireless network infrastructure, with visitors who can stroll freely. The selection of contents keeps track of user location and of the interaction history, in order to deliver the appropriate type and quantity of informative items, and to manage the given/new distinction in discourse. The communicative strategy of the character is designed to keep it believable along the interaction with the user, while enforcing dramatization effects. The design of the communicative strategy relies on the fact that the units of the presentation are tagged with metadata concerning their content and communicative function. The description of the application is accompanied by an evaluation study based on a sample of about 300 visitors, carried out in April 2006, when the installation was open to the public for 1 week.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adomavicius G., Tuzhilin A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)

    Article  Google Scholar 

  • Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Sotto voce: exploring the interplay of conversation and mobile audio spaces. In: Proceedings of the SIECHI Conference on Human Factors in Computing Systems, pp. 431–438. ACM, USA (2002)

  • Aroyo, L., Brussee, R., Gorgels, P., Rutledge, L., Stash, N., Wang, Y.: Personalized museum experience: the rijksmuseum use case. In: Trant, J., Bearman, D. (eds.) Proceedings of Museums on the Web 2007: Selected Papers from an International Conference. San Francisco, CA, USA. http://www.archimuse.com/mw2007/papers/aroyo/aroyo.html (2007). Accessed May, 2008

  • Bianchi, A., Zancanaro, M.: Tracking users’ movements in an artistic physical space. In: Proceedings of the i3 Annual Conference, European network for intelligent information interfaces, pp. 103–106 (1999)

  • Bickmore, T., Cassel, J.: Social dialogue with embodied conversational agents. In: Advances in Natural Multimodal Dialogue Systems, vol. 30, pp. 23–54. Springer, Netherlands (2005)

  • Borriello G., Chalmers M., LaMarca A., Nixon P.: Delivering real-world ubiquitous location systems. Commun. ACM 48(3), 36–41 (2005)

    Article  Google Scholar 

  • Bruner J.: The narrative construction of reality. Crit. Inq. 18(1), 1–21 (1991)

    Article  Google Scholar 

  • Callaway C., Not E., Novello A., Rocchi C., Stock O., Zancanaro M.: Automatic cinematography and multilingual NLG for generating video documentaries. Artif. Intell. 165, 57–89 (2005)

    Article  Google Scholar 

  • Carmagnola, F., Cena, F., Console, L., Cortassa, O., Gena, C., Goy, A., Torre, I., Toso, A., Vernero, F.: Tag-based user models for social multi-device adaptive guides (2008, this issue)

  • Carroll J., Rosson M.: The paradox of the active user. In: Carrol, J.(eds) Interfacing Thought: Cognitive Aspects of Human-Computer Interaction, pp. 80–111. MIT Press, Cambridge (1987)

    Google Scholar 

  • Cassel J., Bickmore T., Campbell L., Vilhjamlmsson H., Yan H.: Human conversation as a system framework: designing embodied converational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E.(eds) Embodied Conversational Agents, pp. 29–63. The MIT Press, Cambridge (2000)

    Google Scholar 

  • Cheverst, K., Davies, N., Mitchell, K., Smith, P.: Providing tailored (context-aware) information to city visitors. In: Brusilovsky, P., Stock, O., Strapparava, C. (eds.) AH. Lecture Notes in Computer Science, vol. 1892, pp. 73–85 (2000)

  • Clark, K.: Inspired 3D Character Animation. Premier Press (2002)

  • Clark H.H., Schaefer E.F.: Contributing to discourse. Cogn. Sci. 13, 259–294 (1989)

    Article  Google Scholar 

  • Cohen, P.R., Levesque, H.J.: Rational interaction as the basis for communication. In: Cohen, P.R., Morgan, J., Pollack, M.E. (eds.) Intentions in communication, pp. 221–255. MIT Press (1990)

  • Cramer, H., Evers, V., Ramlal, S., van Someren, M., Wielinga, B., Rutledge, L., Stash, N., Aroyo, L.: The effects of transparency on trust in and acceptance of a content-based art recommender (2008, this issue)

  • Damiano, R., Galia, C., Lombardo, V.: Virtual tours across different media in DramaTour project. In: Proceedings of the First European Workshop on Intelligent Technologies for Cultural Heritage Exploitation (Ecai 2006). Riva del Garda, Italy, pp. 31–35 (2006a)

  • Damiano R., Lombardo V., Pizzo A., Nunnari F.: Dramatization meets narrative presentations. In: Brewka, G., Coradeschi, S., Perini, A., Traverso, P.(eds) ECAI, pp. 31–35. Riva Del Garda, Italy (2006)

    Google Scholar 

  • Damiano R., Lombardo V., Nunnari F., Pizzo A.: Ontological domain coding for cultural heritage mediation. In: Lesmo, L., Borgo, S.(eds) Proceedings of FOMI 08 Frontiers in Artificial Intelligence and Applications, vol 174, pp. 88–99. Turin, Italy (2008)

    Google Scholar 

  • Dourish P.: Where the action is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)

    Google Scholar 

  • Dybkjær, H., Dybkjær, L.: Design and first tests of a chatter. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS. Lecture Notes in Computer Science, vol. 3068, pp. 166–177 (2004)

  • Esslin M.: 1988 The field of drama. Methuen, London (1987)

    Google Scholar 

  • Gennari J., Musen M., Fergerson R., Grosso W., Crubézy M., Eriksson H., Noy N., Tu S.: The evolution of Protégé: an environment for knowledge-based systems development. Int. J. Hum.-Comput. Stud. 58(1), 89–123 (2003)

    Article  Google Scholar 

  • Gershon N., Page W.: What storytelling can do for information visualization. Commun. ACM 44(8), 31–37 (2001)

    Article  Google Scholar 

  • Geurts, J., Bocconi, S., van Ossenbruggen, J., Hardman, L.: Towards ontology-driven discourse: from semantic graphs to multimedia presentations. In: Fensel, D., Sycara, K.P., Mylopoulos, J. (eds.) International Semantic Web Conference. Lecture Notes in Computer Science, vol. 2870, pp. 597–612 (2003)

  • Goodwin C.: Conversational organization: Interaction between Speakers and Hearers. Academic Press, New York (1981)

    Google Scholar 

  • Grosz B.J., Sidner C.L.: Attention, intentions, and the structure of discourse. Comput. Linguist. 12, 175–204 (1986)

    Google Scholar 

  • Grosz, B.J., Sidner, C.L.: Plans for discourse. In: Cohen, P.R., Morgan, J., Pollack, M.E. (eds.) Intentions in Communication, pp. 417–443. MIT Press (1990)

  • Gustafson, J., Lindberg, N., Lundeberg, M.: The August spoken dialogue system. In: Proceedings of Eurospeech’99, pp. 1211–1214. Budapest, Hungary (1999)

  • Haeberlen, A., Flannery, E., Ladd, A.M., Rudys, A., Wallach, D.S., Kavraki, L.E.: Practical robust localization over large-scale 802.11 wireless networks. In: MobiCom ’04: Proceedings of the 10th Annual International Conference on Mobile Computing and Networking, pp. 70–84. New York, NY, USA (2004)

  • Hajicova E., Partee B.H., Sgall P.: Topic-focus articulation, tripartite structures, and semantic content. Kluwer, Dordrecht (1998)

    Google Scholar 

  • Hardman, L.: Canonical processes of media production. In: MHC ’05: Proceedings of the ACM Workshop on Multimedia for Human Communication, pp. 1–6. New York, NY, USA (2005)

  • Hoffmann P., Herczeg M.: Distributed storytelling for narrative in spacious areas. In: Goebel, S., Braun, N., Spierling, U., Dechau, J., Diener, H.(eds) Technologies for interactive digital storytelling and entertainment 2003, pp. 346–350. Frauenhofer, Stuttgart (2003)

    Google Scholar 

  • Huang, Z.: Extensions to the K-means algorithm for clustering large datasets with categorical values. In: Data Mining and Knowledge Discovery, vol. 2, pp. 283–304 (1998)

  • Ieronutti L., Chittaro L.: Employing virtual humans for education and training in X3D/VRML worlds. Comput. Educ. 49(1), 93–109 (2007)

    Article  Google Scholar 

  • Jakobson, R.: The speech event and the functions of language. In: Waugh, L., Monville-Burston, M. (eds.) On Language. Harvard University Press (1990)

  • Johnson, B.: Place-based storytelling tools: a new look at Monticello. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2005: Proceedings. http://www.archimuse.com/mw2005/papers/johnsonB/johnsonB.html (2004). Accessed May, 2008

  • Keppel, G., Saufley, W.H., Tokunaga, H.: Introduction to design and analysis, a student’s handbook. W. H. Freeman and Co. (1998)

  • Kobsa A., Koenemann J., Pohl W.: Personalized hypermedia presentation techniques for improving online customer relationships. Knowl. Eng. Rev. 16(2), 111–155 (2001)

    Article  MATH  Google Scholar 

  • Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A conversational agent as museum guide—design and evaluation of a real-world application. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds.) IVA. Lecture Notes in Computer Science, vol. 3661, pp. 329–343 (2005)

  • Kuflik, T., Callaway, C.B., Goren-Bar, D., Rocchi, C., Stock, O., Zancanaro, M.: Non-intrusive user modeling for a multimedia museum visitors guide system. In: Ardissono, L., Brna, P., Mitrovic, A. (eds.) User Modeling. Lecture Notes in Computer Science, vol. 3538, pp. 236–240 (2005)

  • Laurel B.: Computer as Theater. Addison Wesley Longman, Reading, MA (1993)

    Google Scholar 

  • Leon, J., Fisher, M.: The use of virtual characters to generate teachable moments. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006: Proceedings, Toronto. http://www.archimuse.com/mw2006/papers/leon/leon.html (2006). Accessed May, 2008

  • Lester J.C., Towns S.G., Callaway C.B., Voerman J.L., FitzGerald P.J.: Deictic and emotive communication in animated pedagogical agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E.(eds) Embodied Conversational Agents, pp. 123–154. The MIT Press, Cambridge (2000)

    Google Scholar 

  • Lombardo, V., Biral, F., Damiano, R., Pizzo, A.: Cyrano goes to hollywood: a drama-based metaphor for information presentation. In: Krueger, A. (ed.) AIMS 03 Workshop (Artificial Intelligence in Mobile Systems), pp. 17–24. Seattle (2003)

  • Maestri, G.: Digital Character Animation. New Riders (1996)

  • Mann W.C.: Dialogue games. Conventions of human interaction. Argumentation 2, 511–532 (1988)

    Article  Google Scholar 

  • Mateas, M., Senger, P.: Narrative intelligence: an introduction to the NI symposium. In: Mateas, M., Senger, P. (eds.) Working notes of the Narrative Intelligence Symposium. http://www-2.cs.cmu.edu/afs/cs.cmu.edu/user/michaelm/www/nidocs/MateasSengers.pdf (1999). Accessed May, 2008

  • Maudet N., Chaib-draa B.: Trends in agent communication language. Comput. Intell. 18(2), 89–101 (2002)

    Article  Google Scholar 

  • McKee R.: Story. Harper Collins, New York (1997)

    Google Scholar 

  • Murray J.: Hamlet on the holodeck. The Future of Narrative in Cyberspace. The MIT Press, Cambridge, MA (1998)

    Google Scholar 

  • Nunnari, F., Lombardo, V., Damiano, R., Pizzo, A., Gena, C.: The canonical processes of a dramtized approach to information presenation. In: Multimedia Systems. Special Issue on the Canonical Processes of Multimedia Production. (2008, Forthcoming)

  • Pechenizkiy, M., Calders, T.: A framework for guiding the museum tours personalization. In: Aroyo, L., Kuflik, T., Stock, O., Zancanaro, M. (eds.) Proceeding of PATCH Workshop on Personalized Access to Cultural Heritage. Corfu, Greece. http://www.iit.demokritos.gr/um2007/UM2007_WS3_PATCH.pdf (2007). Accessed May, 2008

  • Pelachaud, C.: Multimodal expressive embodied conversational agents. In: ACM Multimedia, pp. 683–689 (2005)

  • Petrelli, D., Angeli, A.D., Convertino, G.: A user-centered approach to user modeling. In: UM ’99: Proceedings of the Seventh International Conference on User Modeling, pp. 255–264. Secaucus, NJ, USA (1999a)

  • Petrelli, D., Not, E., Sarini, M., Stock, O., Strapparava, C., Zancanaro, M.: HyperAudio: location-awareness + adaptivity. In: CHI ’99: CHI ’99 Extended Abstracts on Human Factors in Computing Systems, pp. 21–22. New York, NY, USA (1999b)

  • Picard, R.: Affective Computing. MIT Press (1997)

  • Pospischil, G., Umlauft, M., Michlmayr, E.: Designing LoL@, a mobile tourist guide for UMTS’. In: Paternò, F. (ed.) Mobile HCI. Lecture Notes in Computer Science, vol. 2411, pp. 140–154 (2002)

  • Proctor, N.: Off base or On target? Wireless and location-aware applications in the museum. In: Proceedings of International Cultural Heritage Informatics Meeting (ICHIM 05). Paris. http://ichim05.ichim.org/ichim05/contenu/PDF/S09-Proctor.pdf (2005). Accessed May, 2008

  • Raptis, D., Tselios, N., Avouris, N.: Context-based design of mobile applications for museums: a survey of existing practices. In: Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services Table of Contents, pp. 153–160. Salzburg, Austria (2005)

  • Schegloff E.A., Sacks H.: Opening up closings. Semiotica 4(7), 289–327 (1973)

    Article  Google Scholar 

  • Searle J.: Speech acts: an essay in the Philosophy of Language. Cambridge University Press, Cambridge (UK) (1969)

    Google Scholar 

  • Seger L.: Creating Unforgettable Characters. Henry Holt and Company, New York (1990)

    Google Scholar 

  • Sirkin, M.: Statistics for the social sciences. Sage Publications (2005)

  • Solon, A., McKevitt, P., Curran, K.: Mobile multiModal presentation. In: Schulzrinne, H., Dimitrova, N., Sasse, M.A., Moon, S.B., Lienhart, R. (eds.) ACM Multimedia, pp. 440–443 (2004)

  • Sparacino, F.: The museum wearable: real-time sensor-driven understanding of visitors’ interests for personalized visually-augmented museum experiences. In: Bearman, D., Trant, J., Sparacino, F. (eds.) Proceedings of Museums and the Web 2002, pp. 17–20. (2002)

  • Springer, J., Kajder, S., Brazas, J.B.: Digital storytelling at the national gallery of arts. In: Trant, J., Bearman, D. (eds.) Proceedings of Museums and the Web 2004. http://www.archimuse.com/mw2004/papers/springer/springer.html (2004). Accessed May, 2008

  • Stock, O., Zancanaro, M.: Multimodal intelligent information presentation. Springer (2005)

  • Strauss A., Corbin J.: Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Newbury Park, Calif. (1990)

    Google Scholar 

  • van Ossenbruggen, J., Amin, A., Hardman, L., Hildebrand, M., van Assem, M., Omelayenko, B., Schreiber, G., Tordai, A., de Boer, V., Wielinga, B., Wielemaker, J., de Niet, M., Taekema, J., van Orsouw, M., Teesing, A.: Searching and annotating virtual heritage collections with semantic-web techniques. In: Trant, J., Bearman, D. (eds.) Museums on the web. San Francisco, CA. http://www.archimuse.com/mw2007/abstracts/prg_325000959.html (2007). Accessed May, 2008

  • Waterfield, G.: The modern visitor and the historical palace: is an understanding possible? In: Abitare la storia. Turin, Italy. Conference Papers (1999)

  • Zancanaro, M., Kuflik, T., Boger, Z., Goren-Bar, D., Goldwasser, D.: Analyzing museum visitors’ behavior patterns. In: Conati, C., McCoy, K.F., Paliouras, G. (eds.) User modeling. Lecture Notes in Computer Science, vol. 4511, pp. 238–246 (2007)

  • Zimmermann, A., Lorenz, A.: LISTEN: a user-adaptive audio-augmented museum guide (2008, this issue)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rossana Damiano.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Damiano, R., Gena, C., Lombardo, V. et al. A stroll with Carletto: adaptation in drama-based tours with virtual characters. User Model User-Adap Inter 18, 417–453 (2008). https://doi.org/10.1007/s11257-008-9053-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-008-9053-1

Keywords

Navigation