Supporting Audiography: Design of a System for Sentimental Sound Recording, Classification and Playback

  • Tijs DuelEmail author
  • David M. Frohlich
  • Christian Kroos
  • Yong Xu
  • Philip J. B. Jackson
  • Mark D. Plumbley
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 850)


It is now commonplace to capture and share images in photography as triggers for memory. In this paper we explore the possibility of using sound in the same sort of way, in a practice we call audiography. We report an initial design activity to create a system called Audio Memories comprising a ten second sound recorder, an intelligent archive for auto-classifying sound clips, and a multi-layered sound player for the social sharing of audio souvenirs around a table. The recorder and player components are essentially user experience probes that provide tangible interfaces for capturing and interacting with audio memory cues. We discuss our design decisions and process in creating these tools that harmonize user interaction and machine listening to evoke rich memories and conversations in an exploratory and open-ended way.


Audiography Sound souvenirs Design Machine listening 



This work was funded by a grant from the Engineering and Physical Sciences Research Council, as part of the Making Sense of Sounds Project (EP/N014111/1). We would like to thank our other colleagues on that project for their input to the design ideas in this paper.


  1. 1.
    Aslam S.: Facebook by the numbers: stats, demographics and fun facts. Omnicore online magazine (2018).
  2. 2.
    Bijsterveld, K., van Dijck, J. (eds.): Sound Souvenirs: Audio Technologies, Memory and Cultural Practices, vol. 2. Amsterdam University Press, Amsterdam (2009)Google Scholar
  3. 3.
    Bones, O.C., Cox, T.J., Davies, W.J.: Toward an evidence-based taxonomy of everyday sounds. J. Acoust. Soc. Am. 140(4), 3266 (2016)CrossRefGoogle Scholar
  4. 4.
    Dib, L., Petrelli, D., Whittaker, S.: Sonic souvenirs: exploring the paradoxes of recorded sound for family remembering. In: Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work, pp. 391–400. ACM (2010)Google Scholar
  5. 5.
    Frohlich, D.M.: Audiophotography: Bringing Photos to Life with Sounds. Springer, New York (2004). Scholar
  6. 6.
    Frohlich, D.M.: Fast Design, Slow Innovation: Audiophotography Ten Years On. Springer, Cham (2015). Scholar
  7. 7.
    Frohlich, D.M., Wall, S., Kiddle, G.: Rediscovery of forgotten images in domestic photo collections. Pers. Ubiquit. Comput. 17(4), 729–740 (2013)CrossRefGoogle Scholar
  8. 8.
    Odom, W.T., Sellen, A.J., Banks, R., Kirk, D.S., Regan, T., Selby, M., Zimmerman, J.: Designing for slowness, anticipation and re-visitation: a long term field study of the photobox. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1961–1970. ACM, April 2014Google Scholar
  9. 9.
    Oleksik, G., Frohlich, D., Brown, L.M., Sellen, A.: Sonic interventions: understanding and extending the domestic soundscape. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1419–1428. ACM (2008)Google Scholar
  10. 10.
    Oleksik, G., Brown, L.M.: Sonic gems: exploring the potential of audio recording as a form of sentimental memory capture. In: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, vol. 1, pp. 163–172. British Computer Society (2008)Google Scholar
  11. 11.
    Petrelli, D., Villar, N., Kalnikaite, V., Dib, L., Whittaker, S.: FM radio: family interplay with sonic mementos. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2371–2380. ACM, April 2010Google Scholar
  12. 12.
    Sarvas, R., Frohlich, D.M.: From Snapshots to Social Media-The Changing Picture of Domestic Photography. Springer, London (2011). Scholar
  13. 13.
    Whittaker, S., Bergman, O., Clough, P.: Easy on that trigger dad: a study of long term family photo retrieval. Pers. Ubiquit. Comput. 14(1), 31–43 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Tijs Duel
    • 1
  • David M. Frohlich
    • 1
  • Christian Kroos
    • 1
  • Yong Xu
    • 1
  • Philip J. B. Jackson
    • 1
  • Mark D. Plumbley
    • 1
  1. 1.University of SurreyGuildfordUK

Personalised recommendations