Journal of Computers in Education

, Volume 6, Issue 1, pp 79–116 | Cite as

How to play storytelling games with masterpieces: from art galleries to hybrid board games

  • Maria VayanouEmail author
  • Yannis Ioannidis
  • George Loumos
  • Antonis Kargas


In this article we explore how to play storytelling games with collections of artworks. First we propose a generic storytelling game, titled “Find the artwork behind the story!”, and we present the results of a user study that investigates the game’s affordances in different environments and setups, ranging from large exhibitions at a cultural center, to a casual home setting. We report a series of game-testing sessions, highlighting the differences between on-site and remote experiences and we reflect upon critical aspects of the game design, identifying key opportunities and requirements in each case. Then we focus on the “home game scenario” and we describe how we re-designed the game experience so as to address the increased interactivity and learning requirements revealed in this setting. We propose a hybrid board game experience that combines analogue and digital media, orchestrating the use of physical “Artwork Cards” along with digital narratives displayed on the players’ personal mobile or tablet devices. We present the game-authoring platform and the mobile client application that we have developed to support the creation and provision of the proposed game experiences. Finally, following a user-centered design approach, we report preliminary evaluation results of the game prototype using the focus group methodology.


Game design Computer–human interaction Interactive technologies User-centered design Cultural heritage applications 



This research has been co-funded, originally by the EMOTIVE project, that has received funding from the European Union’s Horizon 2020 research and innovation programme under Grant Agreement No. 727188, and in the following by the ΠΙΣΕΤΟ project that has received funding from the General Secretariat for Research & Technology of Greece (ΤΙΕΔΚ-05362).


  1. Andrukaniec, E., Franken, C., Kirchhof, D., Kraus, T., Schöndorff, F., & Geiger, C. (2013). OUTLIVE—An augmented reality multi-user board game played with a mobile device. In D. Reidsma, H. Katayose, & A. Nijholt (Eds.), Advances in computer entertainment (pp. 501–504). Cham: Springer.CrossRefGoogle Scholar
  2. Antoniou, A., Lepouras, G., Bampatzia, S., & Almpanoudi, H. (2013). An approach for serious game development for cultural heritage: Case study for an archaeological site and museum. Journal on Computing and Cultural Heritage (JOCCH), 6(4), 1–19.CrossRefGoogle Scholar
  3. Arjoranta, J., Kankainen, V., & Nummenmaa, T. (2016). Blending in hybrid games: Understanding hybrid games through experience. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology, Article No. 26.Google Scholar
  4. Ballagas, R., Kuntze, A., & Walz, S. (2008). Gaming tourism: Lessons from evaluating explorer, a pervasive game for tourists. In Pervasive Computing, LNCS 5013 (pp. 244, 261).Google Scholar
  5. Belinky, I., Lanir, J., & Kuflik, T. (2012). Using handheld devices and situated displays for collaborative planning of a museum visit. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis ‘12), ACM, Article 19.Google Scholar
  6. Callaway, C., Stock, O., & Dekoven, E. (2014). Experiments with mobile drama in an instrumented museum for inducing conversation in small groups. ACM Transactions on Interactive Intelligent Systems. Scholar
  7. Cheverst, K., Davies, N., Mitchell, K., & Friday, A. (2000). Experiences of developing and deploying a context-aware tourist guide: The GUIDE project. In Proceedings of the 6th Annual International Conference on Mobile Computing and Networking (pp. 20–31).Google Scholar
  8. Coenen, T., Mostmans, L., & Naessens, K. (2013). MuseUs: Case study of a pervasive cultural heritage serious game. ACM Journal on Computing and Cultural Heritage. Scholar
  9. Cosley, D., Baxter, J., Lee, S., Alson, B., Nomura, S., Adams, P., Sarabu, C., & Gay, G. (2009). A tag in the hand: Supporting semantic, social, and spatial navigation in museums. In Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI) (pp. 1953–1962).Google Scholar
  10. Cosley, D., Lewenstein, J., Herman, A., Holloway, J., Baxter, J., Nomura, S., Boehner, K., & Andgay, G. (2008). ArtLinks: Fostering social awareness and reflection in museums. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI) (pp. 403–412).Google Scholar
  11. Huynh, D. T. Raveendran, K., Xu, Y., Spreen, K., & MacIntyre, B. (2009). Art of defense: a collaborative handheld augmented reality board game. In Proceedings of the ACM SIGGRAPH Symposium on Video Games, 2009 (pp. 135–142).Google Scholar
  12. De Lima, E. S., Feijó, B., Barbosa, S. D., Furtado, A. L., Ciarlini, A. E., & Pozzer, C. T. (2014). Draw your own story: Paper and pencil interactive storytelling. Entertainment computing, 5(1), 33–41.CrossRefGoogle Scholar
  13. Dionisio, M., Gujaran, A., Pinto, M., & Esteves, A. (2015). Fall of humans: Interactive tabletop games and transmedia storytelling. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (pp. 401–404). ACM.Google Scholar
  14. Falk, J. H. (2009). Identity and the museum visitor experience. Walnut Creek, CA: Left Coast Press Inc.Google Scholar
  15. Falk, J., & Dierking, L. (2008). Enhancing visitor interactions and learning with mobile technologies. In L. Tallon & K. Walker (Eds.), Digital technologies and the museum experience: Handheld guides and other media. Lanham: AltaMira Press.Google Scholar
  16. Fosh, L., Benford, S., Reeves, S., Koleva, B., & Brundell, P. (2013). See me, feel me, touch me, hear me: Trajectories and interpretation in a sculpture garden. In Proceedings of the CHI ’13 (pp. 149–115). ACM Press.Google Scholar
  17. Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467.CrossRefGoogle Scholar
  18. Grinter, R. E., Aoki, P. M., Szymanski, M. H., Thornton, J. D., Woodruff, A., & Hurst, A. (2002). Revisiting the visit: Understanding how technology can shape the museum visit. In Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work (pp. 146–155).Google Scholar
  19. Heath, C., & vom Lehn, D. (2008). Configuring ‘interactivity’: Enhancing engagement in science centres and museums. Social Studies of Science, 38(1), 63–91.CrossRefGoogle Scholar
  20. Hood, M. (1989). Leisure criteria of family participation and non-participation in museums. In B. Butler & M. Sussman (Eds.), Museum visits and activities for family life enrichment (pp. 151–167). New York: Haworth Press.Google Scholar
  21. Ijsselsteijn, W., de Kort, Y. and Poels, K. (2007) Characterising and Measuring User Experiences in Digital Games. In ACE Conference’07.Google Scholar
  22. Jafari, A., Taheri, B., & vom Lehn, D. (2013). Cultural consumption, interactive sociality, and the museum. Journal of Marketing Management, 29(15–16), 1729–1752.CrossRefGoogle Scholar
  23. Katifori, A., Kourtis, V., Perry, S., Pujol, L., Vayanou, & M., Chrysanthi, A. (2016). Cultivating mobile-mediated social interaction in the museum: Towards group-based digital storytelling experiences. In MW2016: Museums and the Web 2016.Google Scholar
  24. Lanir, J., Wecker, A., & Kuflik., T. (2013). Supporting collaborative use of a mobile museum guide for small groups of visitors. Designing Mobile Face-to-Face Group Interactions. In First International Workshop in conjunction with ECSCW’13 (pp. 443–460). Cyprus, Greece.Google Scholar
  25. Lischke, L., Dingler, T., Schneegass, S., Van Der Vaart, M., Wozniak, P., & Schmidt, A. (2014). Parallel exhibits: Combining physical and virtual exhibits. Nodem, 2014, 149–156.Google Scholar
  26. Lombardo, V., & Damiano, R. (2012). Storytelling on mobile devices for cultural heritage. The New Review of Hypermedia and Multimedia, 18(1–2), 11–35.CrossRefGoogle Scholar
  27. Luyten, K., Van Loon, H., Teunkens, D., Gabriëls, K., Coninx, K., & Manshoven, E. (2006). ARCHIE: Disclosing a museum by a socially-aware mobile guide. The E-Volution of IC Technology in Cultural Heritage, Papers from the Joint Event CIPA/VAST/EG/EuroMed.Google Scholar
  28. Marshall, M., Dulake, N., Ciolfi, L., Duranti, D., & Petrelli, D. (2016). Using tangible smart replicas as controls for an interactive museum exhibition. In Proceedings of TEI 2016Tenth Anniversary Conference on Tangible, Embedded and Embodied Interaction (pp. 159–167), New York: ACM.Google Scholar
  29. McManus, P. (1992). Topics in museums and science education. Studies in Science Education, 20, 157–182.CrossRefGoogle Scholar
  30. Nicholson, S. (2012). Strategies for meaningful gamification: Concepts behind transformative play and participatory museums. In Meaningful Play. Google Scholar
  31. Paliokas, I., & Sylaiou, S. (2016). The use of serious games in museum visits and exhibitions: A systematic mapping study. In Proceedings of the 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games) (pp. 1–8).Google Scholar
  32. Pau, S. (2017). Audio that moves you: experiments with location-aware storytelling in the SFMOMA app. In MW2017: Museums and the Web 2017 (GLAMi nomination).Google Scholar
  33. Petrelli, D., & Not, E. (2005). User-centred design of flexible hypermedia for a mobile guide: Reflections on the HyperAudio experience. User Modelling and User Adapted Interaction, 15, 303–338.CrossRefGoogle Scholar
  34. Reid, J., Clayton, B., Melamed, T., Hull, R., Stenton, P., Peirce, A., Gidlow, C., & Holmes, S. (2008). The design of prisoner escape from the tower: An interactive location aware historical game. In Tate 2008 Handheld Conference, London, 2008.Google Scholar
  35. Roussou, M., & Katifori, A. (2018). Flow, staging, wayfinding, personalization: Evaluating user experience with mobile museum narratives. Multimodal Technologies and Interaction, 2(2), 32.CrossRefGoogle Scholar
  36. Roussou, M., Pujol, L., Katifori, A. Chrysanthi, A., Perry, S., & Vayanou, M. (2015). The museum as digital storyteller: Collaborative participatory creation of interactive digital experiences. In MW2015: Museums and the Web 2015. Published January 31, 2015.Google Scholar
  37. Schell, J. (2012). What games are good at. In Presentation at the 9th Annual Games for Change Festival, New York City, NY.Google Scholar
  38. Silverman, L. (1995). Visitor meaning-making in museums for a new age Curator 38 (3) pp. 161–170. New York: American Museum of Natural History.Google Scholar
  39. Umiker-Sebeok, J. (1994). Behavior in a museum: A semio-cognitive approach to museum consumption experiences. Signifying behavior. Journal of Research in Semiotics, Communication Theory, and Cognitive Science, 1(1), 52–100.Google Scholar
  40. Van Der Vaart, M., & Damala, A. (2015). Through the Loupe: Visitor engagement with a primarily text-based handheld AR application. Digital Heritage, 2015, 565–572.CrossRefGoogle Scholar
  41. Vayanou, M., Katifori, A., Antoniou, A., & Chrysanthi, A. (2016). Collocated interaction in cultural storytelling experiences: How to coordinate visitor actions? In Proceedings of the Workshop Collocated Interaction: New Challenges in ‘Same Time, Same Place’ Research, CSCW Conference 2016. Google Scholar
  42. Vayanou, M., Katifori, A., Karvounis, M., Kourtis, V., Kyriakidi, M., Roussou, M., Tsangaris, M., Ioannidis, Y., Balet, O., Keil, J., Engelke, T., & Pujol. L. (2014). Authoring personalized interactive museum stories. In A. Mitchell (Ed.), The Seventh International Conference on Interactive Digital Storytelling (ICIDS 2014), LNCS 8832 (pp. 37–48). Springer: New York.Google Scholar
  43. Vayanou, M., Katifori, A., Kourtis, V., Karvounis, M., Ioannidis, Y., Bomers, E., & de Jong, N. (2015). Interactive experiences in the Stedelijk museum: A living lab experiment with the CHESS framework.In Proceedings of the 2015 Digital Heritage International Congress.Google Scholar
  44. Zhou, Z., Cheok, A. D., Tedjokusumo, J., & Omer, G. S. (2008). wIzQubes—A novel tangible interface for interactive storytelling in mixed reality. International Journal of Virtual Reality, 7(4), 9–15.Google Scholar

Copyright information

© Beijing Normal University 2018

Authors and Affiliations

  1. 1.Dept. of Informatics & TelecommunicationsUniversity of AthensAthensGreece
  2. 2.“Athena” Research and Innovation CenterAthensGreece
  3. 3.Content Management in Culture P.C.AthensGreece

Personalised recommendations