Backend Infrastructure Supporting Audio Augmented Reality and Storytelling

  • Kari SaloEmail author
  • Diana Giova
  • Tommi Mikkonen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9735)


Today, museums are looking for new ways to attract and engage audience. These include virtual exhibitions, augmented reality and 3D modelling based applications, and interactive digital storytelling. The target of all these activities is to provide better experiences for audiences that are very familiar with the digital world. In augmented reality (AR) and interactive digital storytelling (IDS) systems, visual presentation has been dominant. In contrast to this trend, we have chosen to concentrate on auditory presentation. A key element for this is a backend service supporting different client applications. This paper discusses our experiences from designing a portable open source based audio digital asset management system (ADAM), which supports interaction with smart phones and tablets containing audio augmented reality and audio story applications. We have successfully implemented ADAM system and evaluated it in the Museum of Technology in Helsinki, Finland.


Digital asset management Metadata Open source DAM Audio augmented reality Soundscape 



We thank Outi Putkonen and Riina Linna from the Museum of Technology for all the support. The work is co-funded by EU, Creative Europe Programme, The People’s Smart Sculpture project ( We thank the project partners for inspiring discussions.


  1. 1.
    Ardissono, L., Kuflik, T., Petrelli, D.: Personalization in cultural heritage: the road travelled and the one ahead. User Model. User-Adap. Inter. 22(1–2), 73–99 (2012)CrossRefGoogle Scholar
  2. 2.
    Rizvic, S., Sadzak, A., Hulusic, V., Karahasanovic, A.: Interactive digital storytelling in the Sarajevo survival tools virtual environment. In: Proceedings of the 28th Spring Conference on Computer Graphics, SCCG 2012, pp. 109–116. ACM, New York (2012)Google Scholar
  3. 3.
    Demiris, A.M., Vlahakis, V., Ioannidis, N.: System and infrastructure considerations for the successful introduction of augmented reality guides in cultural heritage sites. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 2006, pp. 141–144. ACM, New York (2006)Google Scholar
  4. 4.
    De Sa, M., Churchill, E.: Mobile augmented reality: exploring design and prototyping techniques. In: Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2012, pp. 221–230. ACM, New York (2012)Google Scholar
  5. 5.
    Blythe, M., McCarthy, J., Wright, P., Petrelli, D.: History and experience: storytelling and interaction design. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, BCS-HCI 2011, pp. 395–404. British Computer Society, Swinton (2011)Google Scholar
  6. 6.
    Tilastokeskus, Internetin käytön yleiset muutokset (in Finnish).
  7. 7.
    Drechsler, A., Raffaseder, H., Rubisch, B.: Klang.Reise: new scientific approaches through an artistic soundscape installation? In: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound, AM 2012, New York, NY, USA, pp. 44–46 (2012)Google Scholar
  8. 8.
    Väänänen-Vainio-Mattila, K., Suhonen, K., Laaksonen, J., Kildal, J., Tahiroğlu, K.: User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environment. In: Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces, DPPI 2013, pp. 67–76. ACM, New York (2013)Google Scholar
  9. 9.
    Pugliese, R., Politis, A., Takala, T.: ATSI: augmented and tangible sonic interaction. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2015, pp. 97–104. ACM, New York (2015)Google Scholar
  10. 10.
    Heller, F., Krämer, A., Borchers, J.: Simplifying orientation measurement for mobile audio augmented reality applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 615–624. ACM, New York (2014)Google Scholar
  11. 11.
    Schaefer, R.M.: The Soundscape: Our Sonic Environment and the Tuning of the World. Inner Traditions International/Destiny Books, Rochester (1993)Google Scholar
  12. 12.
    Casu, M., Koutsomichalis, M., Valle, A.: Imaginary soundscapes: the SoDA project. In: Proceedings of the 9th Audio Mostly: A Conference on Interaction with Sound, AM 2014. ACM, New York (2014). Article no. 5Google Scholar
  13. 13.
    Peinado, F., Navarro, Á., Gervás, P.: A testbed environment for interactive storytellers. In: Proceedings of the 2nd International Conference on INtelligent TEchnologies for Interactive Entertainment, INTETAIN 2008. ICST, Brussels (2008). Article no. 3Google Scholar
  14. 14.
    Jacobsen, J., Schlenker, T., Edwards, L.: Implementing a Digital Asset Management System: For Animation, Computer Games, and Web Development. Focal Press, Burlington (2005)Google Scholar
  15. 15.
    De Sutter, R., Notebaert, S., Van de Walle, R.: Evaluation of metadata standards in the context of digital audio-visual libraries. In: Gonzalo, J., Thanos, C., Verdejo, M., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 220–231. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  16. 16.
    Open Archives Initiative Protocol for Metadata Harvesting.
  17. 17.
    Dublin Core Metadata Element Set, Version 1.1.
  18. 18.
    AES60-2011: AES standard for audio metadata - Core audio metadata.
  19. 19.
    Ebu Core Metadata Set, Specification v. 1.6.
  20. 20.
    ISO/IEC 15938-4:2002(en) Information technology — Multimedia content description interface — Part 4: Audio.
  21. 21.
    AES57-2011: AES standard for audio metadata - Audio object structures for preservation and restoration.
  22. 22.
    Fillon, T., Simonnot, J., Mifune, M., Khoury, S., Pellerin, G., Le Coz, M.: Telemeta: an open-source web framework for ethnomusicological audio archives management and automatic analysis. In: Proceedings of the 1st International Workshop on Digital Libraries for Musicology, DLfM 2014, pp. 1–8. ACM, New York (2014)Google Scholar
  23. 23.
    Woitek, P., Bräuer, P., Grossmann, H.: A novel tool for capturing conceptualized audio annotations. In: Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound, AM 2010. ACM, New York (2010). Article no. 15Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Helsinki Metropolia University of Applied SciencesHelsinkiFinland
  2. 2.Tampere University of TechnologyTampereFinland

Personalised recommendations