Interacting with Sound

  • Max Meier
  • Gilbert Beyer
Part of the Human-Computer Interaction Series book series (HCIS)


In this chapter we present future opportunities for using sound within pervasive advertising. We focus on current trends of interacting with sound, which we believe will have a strong influence on sound branding in the near future. We start giving an overview on the topics of sound branding and music making. Then we outline requirements, application areas and design issues for interactive music systems from an advertising and musicological perspective. From the advertising point of view, the benefit of music is that it is a strong vehicle to convey a memorable message to the target group. Originally used as jingle in radio and television ads or as background component in shopping malls, nowadays sounds are also used within interactive media in the internet and in digital signage. Yet, there have been only very limited attempts to include sound itself to the interactive experience. We describe in detail an approach that enables users to control advertising sounds by the interaction, utilizing a novel technique of algorithmic composition based on soft constraints. That followed, we present a public display prototype for interactive advertising music, and close with first results from a user study.


Hand Gesture Soft Constraint Public Display Background Music Musical Style 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Adamowsky, N.: Homo Ludens – Whale enterprise: Zur Verbindung von Spiel, Technik und den Künsten. In: Poser, S., Zachmann, K. (eds.) Homo faber ludens: Geschichte zu Wechselbeziehungen von Technik u. Spiel. Peter Lang Verlag, Frankfurt (2003)Google Scholar
  2. 2.
    Bistarelli, S., Montanari, U., Rossi, F.: Semiring-based constraint satisfaction and optimization. J. ACM 44(2), 201–236 (1997)MathSciNetMATHCrossRefGoogle Scholar
  3. 3.
    Buss, A.: Internet-Marketing: Erfolg planen, gestalten, umsetzen. Markt & Technik, München (2009)Google Scholar
  4. 4.
    Chadabe, J.: Interactive music composition and performance system. US Patent 4526078 (1985)Google Scholar
  5. 5.
    Codeplex Website: Accessed 23 Mar 2011
  6. 6.
    Diederichs, F.A., Stonat, C.: Musik und Werbung. Marketing mit Emotionen. In: Moser, R., Scheuermann, A. (eds.) Handbuch der Musikwirtschaft, p. 416. Josef Keller Verlag, Starnberg und München (2003)Google Scholar
  7. 7.
    Essl, K.: Algorithmic composition. In: Collins, N., d’Escrivan, J. (eds.) Cambridge Companion to Electronic Music. Cambridge University Press, Cambridge (2007)Google Scholar
  8. 8.
    Farbood, M., Schoner, B.: Analysis and synthesis of palestrina-style counterpoint using Markov chains. In: Proceedings of the International Computer Music Conference, Havana (2001)Google Scholar
  9. 9.
    Groves, J.: A short history of sound branding. In: Bronner, K., Hirt, R. (eds.) Audio Branding – Entwicklung, Anwendung, Wirkung akustischer Identitäten in Werbung, Medien und Gesellschaft, pp. 40–51. Nomos Verlagsgesell, Baden-Baden (2009)Google Scholar
  10. 10.
    Hölzl, M., Meier, M., Wirsing, M.: Which soft constraints do you prefer? In: Proceedings of Workshop on Rewriting Logic and Its Applications (WRLA 2008), Budapest (2008)Google Scholar
  11. 11.
    Hölzl, M., Denker, G., Meier, M., Wirsing, M.: Constraint-muse: a soft-constraint based system for music therapy. In: Proceedings of Third International Conference on Algebra and Coalgebra in Computer Science (CALCO’09), Udine, pp. 423–432. Springer, Heidelberg (2009)Google Scholar
  12. 12.
    Ip, H., Law, K., Kwong, B.: Cyber composer: hand gesture-driven intelligent music composition and generation. In: Proceedings of 11th International Multimedia Modelling Conference (MMM ’05), Melbourne, pp. 46–52 (2005)Google Scholar
  13. 13.
    Iwai T, Indies Zero, Nintendo (2005) Electroplankton. NintendoGoogle Scholar
  14. 14.
    Jubran, F.: Sound generating device for use by people with disabilities. US Patent 2007/0241918 A1 (2007)Google Scholar
  15. 15.
    Kellaris, J., Cox, A., Cox, D.: The effect of background music on ad processing: a contingency explanation. J. Market. 57(4), 114–125 (1993)CrossRefGoogle Scholar
  16. 16.
    Kilian, K.: Von der Markenidentität zum Markenklang als Markenelement. In: Bronner, K., Hirt, R. (eds.) Audio Branding – Entwicklung, Anwendung, Wirkung akustischer Identitäten in Werbung, Medien und Gesellschaft, p. 66. Nomos Verlagsgesellschaft, Baden-Baden (2009)Google Scholar
  17. 17.
    Kroeber-Riel, W., Esch, F.-R.: Strategie und Technik der Werbung. In: Diller, H., Köhler, R. (eds.) Verhaltenswissenschaftliche Ansätze, vol. 6. Kohlhammer, Stuttgart (2004)Google Scholar
  18. 18.
    Meier, M., RechNet, GmbH: Musiksystem. German Patent DE102009017204A1 (2009)Google Scholar
  19. 19.
    Nelson, M.R.: Recall of brand placements in computer/video games. J. Advert. Res. 42(2), 80–92 (2002)Google Scholar
  20. 20.
    Nierhaus, G.: Algorithmic Composition. Springer, Heidelberg (2008)Google Scholar
  21. 21.
    Nishitani, Y., Ishida, K., Kobayashi, E., Yamaha Corporation: System of processing music performance for personalized management of and evaluation of sampled data. US Patent 7297857 (2007)Google Scholar
  22. 22.
    OpenCV website: Accessed 23 Mar 2011
  23. 23.
    Pachet, F.: The continuator: musical interaction with style. In: Proceedings of the International Computer Music Conference, Goteborg, pp. 211–218. ICMA, Gotheborg (2002)Google Scholar
  24. 24.
    Pachet, F., Roy, P.: Musical harmonization with constraints: a survey. Constraints 6(1), 7–19 (2001)MathSciNetMATHCrossRefGoogle Scholar
  25. 25.
    Scott, L.: Understanding jingles and needledrop: a rhetorical approach to music in advertising. J. Consum. Res. 17(2), 223–36 (1990)CrossRefGoogle Scholar
  26. 26.
    Steiner, P.: Sound Branding – Grundlagen der akustischen Markenführung. Gabler, Wiesbaden (2009)Google Scholar
  27. 27.
    Wheaton, J.A., Wold, E., Sutter, A.J., Yamaha corporation: position-based controller for electronic musical instrument. US Patent 5541358 (1996)Google Scholar
  28. 28.
    Wiest, P.: Verfahren zur Akustisierung körpereigener physikalischer Werte und Vorrichtung zur Durchführung des Verfahrens. German Patent 19522958 C2 (1999)Google Scholar
  29. 29.
    Wirsing, M., Denker, G., Talcott, C., Poggio, A., Briesemeister, L.: A rewriting logic framework for soft constraints. In: Proceedings of Workshop on Rewriting Logic and its Applications (WRLA 2006), Vienna (2006)Google Scholar
  30. 30.
    Wirsing, M., Clark, A., Gilmore, S., Hölzl, M., Knapp, A., Koch, N., Schroeder, A.: Semantic-based development of service-oriented systems. In: Najm, E., Pradat-Peyre, J.-F., Donzeau-Gouge, V.V. (eds.) FORTE 2006. LNCS, vol. 4229, pp. 24–45. Springer, Heidelberg (2006)Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.Ludwig-Maximilians-UniversityMunichGermany

Personalised recommendations