Abstract
For decades, researchers have spurred research on sonification, the use of non-speech audio to convey information [1]. With ‘interaction’ and ‘user experience’ being pervasive, interactive sonification [2], an emerging interdisciplinary area, has been introduced and its role and importance have rapidly increased in the auditory display community. From this background, we have devised a novel platform, “iISoP” (immersive Interactive Sonification Platform) for location, movement, and gesture-based interactive sonification research, by leveraging the existing Immersive Visualization Studio (IVS) at Michigan Tech. Projects in each developmental phase and planned research are discussed with a focus on “design research” and “interactivity”.
Chapter PDF
Similar content being viewed by others
References
Jeon, M., Gupta, S., Davison, B.K., Walker, B.N.: Auditory menus are not just spoken visual menus: A case study of “unavailable” menu items. Journal of the Audio Engineering Society 60(7/8), 505–518 (2012)
Kramer, G., Walker, B.N., Bonebright, T., Cook, P., Flowers, J., Miner, N.E.A.: The sonification report: Status of the field and research agenda. Report prepared for the National Science Foundation by Members of the International Community for Auditory Display. International Community for Auditory Display (ICAD), Santa Fe (1999)
Kramer, G.: An introduction to auditory display. In: Kramer, G. (ed.) Auditory Display: Sonificaiton, Audification, and Auditory Interfaces, pp. 1–77. Addison-Wesley, MA (1994)
Hermann, T.: Taxonomy and definitions for sonification and auditory display. In: Proceedings of the 14th International Conference on Auditory Display (ICAD 2008), Paris, France (2008)
Hermann, T., Hunt, A., Neuhoff, J.G.E.: The Sonification Handbook. Logos Publishing House, Berlin (2011)
Walker, B.N., Kramer, G.: Sonification. In: Karwowski, W. (ed.) International Encyclopedia of Ergonomics and Human Factors, 2nd edn., pp. 1254–1256. CRC Press, New York (2006)
Walker, B.N., Kramer, G.: Auditory displays, alarms, and auditory interfaces. In: Karwowski, W. (ed.) International Encyclopedia of Ergonomics and Human Factors, 2nd edn., pp. 1021–1025. CRC Press, New York (2006)
Hermann, T., Hunt, A.: The discipline of interactive sonification. In: Proceedings of the International Workshop on Interactive Sonification, Bielefeld, Germany (2004)
Hermann, T., Hunt, A.: An introduction to Interactive Sonification. IEEE Multimedia 12(2), 20–24 (2005)
Walker, B.N., Kim, J., Pendse, A.: Musical soundscapes for an accessible aquarium: Bringing dynamic exhibits to the visually impaired. In: Proceedings of the International Computer Music Conference (ICMC 2007), Copenhagen, Denmark, August 27-30 (2007)
Jeon, M., Winton, R.J., Henry, A.G., Oh, S., Bruce, C.M., Walker, B.N.: Designing interactive sonification for live aquarium exhibits. In: Stephanidis, C. (ed.) HCII 2013, Part I. CCIS, vol. 373, pp. 332–336. Springer, Heidelberg (2013)
Jeon, M., Walker, B.N., Bruce, C.M.: Science or art? “Sonification in the age of biocybernetic reproduction”: A case study of the accessible aquarium project. In: Proceedings of the International Conference on Auditory Display (ICAD 2013), July 6-10 (2013)
Malizia, A., Bellucci, A.: The artificiality of natural user interfaces. Communications of the ACM 55(3), 36–38 (2012)
Jeon, M., Winton, R.J., Yim, J.-B., Bruce, C.M., Walker, B.N.: AquariumFugue: Interactive sonification for children and visually impaired audience in informal learning environments. In: Proceedings of the 18th International Conference on Auditory Display, ICAD 2012 (2012)
Zhao, H., Smith, B.K., Norman, K., Plaisant, C., Shneiderman, B.: Interactive sonification of choropleth maps. IEEE Multimedia 12(2), 26–35 (2005)
Hermann, T., Bovermann, T., Riedenklau, E., Ritter, H.: Tangible computing for interactive sonification of multivariate data. In: International Workshop on Interactive Sonification (ISon), York, UK. (2007)
Stockman, T.: Interactive sonification of spreadsheets. In: Proceedings of the International Conference on Auditory Dislay (ICAD 2005), Limerick, Ireland, pp. 134–139 (2005)
Fernström, M., Brazil, E., Bannon, L.: HCI Design and interactive sonification for fingers and ears. IEEE Multimedia 12(2), 36–44 (2005)
Antle, A.N., Droumeva, M., Corness, G.: Playing with the sound maker: Do embodied metaphors help children learn? In: Proceedings of the Conference on Interaction Design and Children, Chicago, IL, USA, pp. 178–185 (2008)
Ferguson, S.: Learning musical instrument skills through interactive sonification. In: International Conference on New Interfaces for Musical Expression (NIME 2006), pp. 384–389 (2006)
Howison, M., Trninic, D., Reinholz, D., Abrahamson, D.: The mathematical imagery trainer: From embodied interaction to conceptual learning. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), Vancouver, BC, Canada, pp. 1989–1998 (2011)
Hermann, T., Zehe, S.: Sonified aerobics: Interactive sonification of coordinated body movements. In: Proceedings of the International Conference on Auditory Display (ICAD 2011), Budapest, Hungary (2011)
Schaffert, N., Mattes, K., Effenberg, A.O.: The sound of rowing stroke cycles as acoustic feedback. In: Proceedings of the International Conference on Auditory Display (ICAD 2011), Budapest, Hungary (2011)
Walker, B.N., Godfrey, M.T., Orlosky, J.E., Bruce, C., Sanford, J.: Aquarium sonification: Soundscapes for accessible dynamic informal learning environments. In: Proceedings of the Conference on Auditory Display (ICAD 2006), London, UK, pp. 238–241 (2006)
Rafaeli, S.: Interactivity: From new media to communication. Sage Annual Review of Communication Research: Advancing Communication Science 16, 110–134 (1988)
Landry, S., Jeon, M., Ryan, J.: A broad spectrum of sonic interactions at immersive interactive sonification platform (iISoP). In: Proceedings of the 21st IEEE Virtual Reality Conference (Workshop in Sonic Interactions in Virtual Environments), Minneapolis, Minnesota (2014)
Roddy, S., Furlong, D.: Emobided cognition in auditory display. In: Proceedings of the International Conference on Auditory Display (ICAD 2013), Lodz, Poland (2013)
Camurri, A., Lagerlöf, I., Volpe, G.: Recognizing emotion from dance movement: Comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies 59, 213–225 (2003)
Neuhart, J., Neuhart, M., Eames, R.: Eames Design: The work of the office of Charles and Ray Eames. Harry N. Abrams, New York (1989)
Jeon, M.: Two or three things you need to know about AUI design or designers. In: Proceedings of the International Conference on Auditory Display (ICAD 2010), Washington D.C. (2010)
Faste, T., Faste, H.: Demystifying “design research”: Design is not research, research is design. In: Proceedings of the IDSA (2012)
Le Groux, S., Manzolli, J., Verschure, P.F.M.J.: Interactive sonification of the spatial behavior of human and synthetic characters in a mixed-reality environment. In: Proceedings of the 10th Annual International Workshop on Presence, pp. 27/388–34/388 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Jeon, M., Smith, M.T., Walker, J.W., Kuhl, S.A. (2014). Constructing the Immersive Interactive Sonification Platform (iISoP). In: Streitz, N., Markopoulos, P. (eds) Distributed, Ambient, and Pervasive Interactions. DAPI 2014. Lecture Notes in Computer Science, vol 8530. Springer, Cham. https://doi.org/10.1007/978-3-319-07788-8_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-07788-8_32
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07787-1
Online ISBN: 978-3-319-07788-8
eBook Packages: Computer ScienceComputer Science (R0)