Designing an Interactive and Collaborative Experience in Audio Augmented Reality

  • Valentin BauerEmail author
  • Anna NageleEmail author
  • Chris Baume
  • Tim Cowlishaw
  • Henry Cooke
  • Chris Pike
  • Patrick G. T. Healey
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11883)


Audio Augmented Reality (AAR) consists of adding spatial audio entities into the real environment. Existing mobile applications and technologies open questions around interactive and collaborative AAR. This paper proposes an experiment to examine how spatial audio can prompt and support actions in interactive AAR experiences; how distinct auditory information influence collaborative tasks and group dynamics; and how gamified AAR can enhance participatory storytelling. We are developing an interactive multiplayer experience in AAR using the Bose “Frames” audio sunglasses. Four participants at a time will go through a gamified story that attempts to interfere with group dynamics. In this paper we present our AAR platform and collaborative game in terms of experience design, and detail the testing methodology and analysis that we will conduct to answer our research questions.


Audio Augmented Reality Collaboration 3D audio Audio game Storytelling Experience design 


  1. 1.
    Audiojack Homepage. Accessed 3 Jul 2019
  2. 2.
    Barde, A., Helton, W.S., Lee, G., Billinghurst, M.: Binaural spatialization over a bone conduction headset: minimum discernable angular difference. In: Proceedings of the 140th Convention of the Audio Engineering Society (2016)Google Scholar
  3. 3.
    Begault, D.-R.: 3-D Sound for Virtual Reality and Multimedia. Academic Press Professional, San Diego (1994)Google Scholar
  4. 4.
    Boal, A.: Games for Actors and Non-actors, 2nd edn. Taylor and Francis e-Library, Abingdon (2005)Google Scholar
  5. 5.
    BOSE Frames Homepage. Accessed 3 Jul 2019
  6. 6.
    Brungart, D.S., Kordik, A.J., Simpson, B.D.: Effects of headtracker latency in virtual audio displays. J. Audio Eng. Soc. 54(1), 13 (2006)Google Scholar
  7. 7.
    Chatzidimitris, T., Gavalas, D., Michael, D.: SoundPacman: audio augmented reality in location-based games. In: 18th Mediterranean Electrotechnical Conference (MELECON), Lemesos, Cyprus, pp. 1–6 (2016)Google Scholar
  8. 8.
    Cooke, H.: Audio AR: Sound Walk Research The Missing Voice (2019). Accessed 3 Jul 2019
  9. 9.
    Darkfield Homepage. Accessed 3 Jul 2019
  10. 10.
    Dead Drop Desperados App Store Preview. Accessed 3 Jul 2019
  11. 11.
    Ekman, I.: Sound-based gaming for sighted audiences- experiences from a mobile multiplayer location aware game. In: Proceedings on 2nd Audio Mostly, Germany (2007)Google Scholar
  12. 12.
    Gorzel, M., Allen, A., Kelly, I., Kammerl, J., Gungormusler, A., Yeh, H.: Efficient encoding and decoding of binaural sound with resonance audio. In: Audio Engineering Society Convention 12 (2019)Google Scholar
  13. 13.
    Härmä, A., et al.: Augmented reality audio for mobile and wearable appliances. J. Audio Eng. Soc. 52(6), 618–639 (2004)Google Scholar
  14. 14.
    Hololens Homepage. Accessed 28 Jul 2019
  15. 15.
    Kochhar-Lindgren, K.: Towards a communal body of art: the exquisite corpse and Augusto Boal’s theatre. Angelaki: J. Theor. Hum. 7(1), 217–226 (2002). Scholar
  16. 16.
    Lyons, K., Gandy, M., Starner, T.: Guided by voices: an audio augmented reality system. In: Online Proceedings of the International Conference on Auditory Display, Georgia Institute of Technology Atlanta, Georgia, USA (2000)Google Scholar
  17. 17.
    Mariette, N., Katz, B.: SoundDelta - large scale, multiuser audio augmented reality. In: EAA Symposium on Auralization, Espoo, Finland (2009)Google Scholar
  18. 18.
    Tikander, M.: Usability issues in listening to natural sounds with an augmented reality headset. J. Audio Eng. Soc. 57(6), 430–441 (2009)Google Scholar
  19. 19.
    Traverse Homepage. Accessed 3 Jul 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Valentin Bauer
    • 1
    Email author
  • Anna Nagele
    • 1
    Email author
  • Chris Baume
    • 2
  • Tim Cowlishaw
    • 2
  • Henry Cooke
    • 2
  • Chris Pike
    • 2
  • Patrick G. T. Healey
    • 1
  1. 1.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK
  2. 2.BBC Research and DevelopmentLondonUK

Personalised recommendations