Skip to main content
SpringerLink
Log in

Sonification and HCI

  • Chapter
  • First Online:
New Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies

Part of the book series: Human–Computer Interaction Series ((HCIS))

  • 1307 Accesses

Abstract

This chapter investigates the second and third wave HCI design processes for an auditory display design and proposes a multifaceted framework. The purpose of using such a framework in a participatory context is to provide the possibility to create shared design knowledge in sonification and building new sonification designs on top of the prior work. From the early stages of the project involving the domain scientists in the process seemed to be an obvious choice. The process works in the sense that we gathered a diverse set of data analysis problems, solutions, and methods that work for data scientists within a sonification framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    As stated by HCI pioneer Douglas Engelbart: If ease of use was the only valid criterion, people would stick to tricycles and never try bicycles.

References

  • Alais D, Burr D (2004) The ventriloquist effect results from near optimal bimodal integration. Curr Biol 14(3):257–262

    Article  Google Scholar 

  • Alexander RL, O’Modhrain S, Roberts DA et al (2014) The bird’s ear view of space physics: audification as a tool for the spectral analysis of time series data. J Geophys Res Space Phys 119(7):5259–5271

    Article  Google Scholar 

  • Anderson RJ (1994) Representations and requirements: the value of ethnography in system design. Human Comput Interact 9(3):151–182

    Article  Google Scholar 

  • Barrass S (1996) Tada! Demonstrations of auditory information design. Unpublished PhD thesis

    Google Scholar 

  • Barrass S (2003) Sonification design patterns. In: Proceedings of International conference on auditory display, Boston

    Google Scholar 

  • Ben-Tal O, Berger J, Cook B et al (2002) The sonification application research toolbox. In: Proceedings of International conference on auditory display, Kyoto

    Google Scholar 

  • Bieusheuvel S (1947) Psychological tests and their application to non-European peoples. In: Yearbook of education. Evans, London, pp 185–207

    Google Scholar 

  • Bregman AS (1994) Auditory scene analysis: the perceptual organization of sound. MIT Press, Cambridge

    Google Scholar 

  • Brewster S (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. Unpublished PhD thesis

    Google Scholar 

  • Candey RM, Schertenleib AM, Merced WL (2006) Xsonify sonification tool for space physics. In: Proceedings of International conference on auditory display, London

    Google Scholar 

  • Carroll JM, Chin G, Rosson MB, et al (2000) The development of cooperation: five years of participatory design in the virtual school. In: Proceedings on designing interactive systems: processes, practices, methods, and techniques. Association for Computing Machinery, New York, pp 239–251

    Google Scholar 

  • Dahl L, Herrera J, Wilkerson C (2011) Tweetdreams: making music with the audience and the world using real-time twitter data. In: Jensenius AR, Tveit A, Godøy RI et al (eds) Proceedings of the international conference on new interfaces for musical expression (NIME) Oslo, pp 272–275

    Google Scholar 

  • de Campo A (2007). A data sonification design space map. In: Proceedings of the 2nd International workshop on interactive sonification, York

    Google Scholar 

  • de Campo A, Daye C, Frauenberger C et al (2006) Sonification as an interdisciplinary working process. In: Proceedings of International conference on auditory display, London

    Google Scholar 

  • Dombois F (2001) Using audification in planetary seismology. In: Hiipakka J, Zacharov N, Takala T (eds) Proceedings of the 7th International conference on auditory display, Espoo, pp 227–230

    Google Scholar 

  • Droumeva M, Wakkary R (2006). The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence audio display. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the international conference on auditory display, London, pp 36–43

    Google Scholar 

  • Fischer G (1993) Beyond human computer interaction: designing useful and usable computational environments. In: People and computers VIII: proceedings of the HCI’93 conference (Loughborough, England), Cambridge University Press, Cambridge, UK, pp 17–31

    Google Scholar 

  • Fischer G (1994) Putting the owners of problems in charge with domain-oriented design environments. In: Gilmore D, Winder R, Detienne F (eds) User-centered requirements for software engineering environments. Springer, Heidelberg, pp 297–306

    Chapter  Google Scholar 

  • Fischer G, Giaccardi E (2006) Meta-design: a framework for the future of end-user development. In: Lieberman H, Paternò F, Wulf V (eds) End user development. Springer, Dordrecht, pp 427–457

    Chapter  Google Scholar 

  • Flowers JH (2005) Thirteen years of reflection on auditory graphing: promises, pitfalls, and potential new directions. In: Brazil E (ed) Proceedings of International conference on auditory display, Limerick

    Google Scholar 

  • Flowers JH, Turnage KD, Buhman DC (2005) Desktop data sonification: comments on flowers et al ICAD 1996. ACM Trans Appl Percept 2(4):473–476

    Article  Google Scholar 

  • Frauenberger C, Stockman T (2009) Auditory display design—an investigation of a design pattern approach. Int J Hum Comput Stud 67(11):907–922

    Article  Google Scholar 

  • Gaver W (1993) How in the world do we hear? Explorations in ecological acoustics. Ecol Psychol 5:283–313

    Google Scholar 

  • Gaver W (1994) Using and creating auditory icons. In: Kramer G (ed) Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Publishing, Reading, pp 417–446

    Google Scholar 

  • Gaver W, Smith RB, O’Shea T (1991) Effective sounds in complex systems: the ARKola simulation. In: Robertson S, Olson G, Olson JS (eds) Proceedings of the SIGCHI conference on human factors in computing systems, New Orleans, pp 85–90

    Google Scholar 

  • Giaccardi E, Fischer G (2008) Creativity and evolution: a metadesign perspective. Digital Creativity 19(1):19–32

    Article  Google Scholar 

  • Gregory J (2003) Scandinavian approaches to participatory design. Int J Eng Educ 19(1):62–74

    MathSciNet  Google Scholar 

  • Grinstein G, Smith S (1990) The perceptualization of scientific data. In: Proceedings of the SPIE/SPSE conference on electronic imaging, pp 190–199

    Google Scholar 

  • Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems, San Jose, California, USA, pp 1–18

    Google Scholar 

  • Henneman RH, Long ER (1954) A comparison of the visual and auditory senses as channels for data presentation. In: Technical report 54(363). Wright Air Development Center, Dayton

    Google Scholar 

  • Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Universität Bielefeld

    Google Scholar 

  • Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: Susini OW (ed) Proceedings of the 14th International conference on auditory display, Paris

    Google Scholar 

  • Hermann T, Baier G, Stephani U, et al (2006) Vocal Sonification of pathologic EEG features. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the 12th International conference on auditory display, London

    Google Scholar 

  • Hermann T, Nehls AV, Eitel F et al (2012) Tweetscapes: Real-time sonification of twitter data streams for radio broadcasting. In: Nees MA, Walker BN, Freeman J (eds) Proceedings of ICAD, Atlanta

    Google Scholar 

  • Holmquist LE (2008) Bootlegging: multidisciplinary brainstorming with cut-ups. In: Simonsen J, Roberston T (eds) Proceedings of the tenth anniversary conference on participatory design. Indiana University, pp 158–161

    Google Scholar 

  • Janata P, Childs E (2004) MarketBuzz: a Sonification of real-time financial data. In: Barrass S, Vickers P (eds) Proceedings of the tenth international conference on auditory display, Sydney

    Google Scholar 

  • Kim R, Peters MA, Shams L (2012) 0+ 1> 1 how adding non-informative sound improves performance on a visual task. Psychol Sci 23(1):6–12

    Article  Google Scholar 

  • Kramer G, Walker B, Bonebright T et al (1999) Sonification report: status of the field and research agenda, report prepared for the National Science Foundation by members of the International Community for Auditory Display, available via http://www.icad.org/websiteV2.0/References/nsf.html. Accessed 1 Jan 2018

  • Kramer G, Walker B, Bonebright T et al (2000) Sonification report: Status of the field and research agenda, available via http://digitalcommons.unl.edu/psychfacpub/444/. Accessed 01 Jan 2018

  • Lennox PP, Myatt T, Vaughan JM (1999) From surround to true 3-d. In: 16th International Audio Engineering Society conference on spatial sound reproduction, Rovaniemi, Finland

    Google Scholar 

  • Mackay WE (2002) Video to support interaction design, DVD. ACM, New York. ISBN: 1-58113-516-5

    Google Scholar 

  • Mynatt ED (1997) Auditory icons. In: Hearst MA (ed) Dissonance on audio interfaces. IEEE Intelligent Systems, vol 12, pp 10–16

    Google Scholar 

  • Norman DA, Draper SW (1986) User centered system design. L. Erlbaum Associates, Hillsdale

    Google Scholar 

  • Numa K, Toriumi K, Tanaka K et al (2008) Knowledge-based intelligent information and engineering systems. Springer, Berlin, pp 823–830

    Book  Google Scholar 

  • Oulasvirta A, Kurvinen E, Kankainen T (2003) Understanding contexts by being there: case studies in bodystorming. Pers Ubiquit Comput 7(2):125–134

    Article  Google Scholar 

  • Perrott DR, Saberi K, Brown K et al (1990) Auditory psychomotor coordination and visual search performance. Percept Psychophys 48(3):214–226

    Article  Google Scholar 

  • Rogers Y, Preece J, Sharp H (2002) Interaction design: beyond human-computer interaction. Wiley, New York

    Google Scholar 

  • Sanderson P, Anderson J, Watson M (2000) Extending ecological interface design to auditory displays. In: Proceedings of the 10th Australasian conference on computer-human interaction, Sydney

    Google Scholar 

  • Schoon A, Dombois F (2009) Sonification in music. In: International conference on auditory display, Copenhagen

    Google Scholar 

  • Schuler D, Namioka A (1993) Participatory design: principles and practices. L. Erlbaum Associates, Hillsdale

    Google Scholar 

  • Soto-Faraco S, Spence C, Kingstone A (2004) Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. J Exp Psychol Hum Percept Perform 30:330–345

    Article  Google Scholar 

  • Spinuzzi C (2005) The methodology of participatory design. Tech Commun 52(2):163–174

    Google Scholar 

  • Svanaes, D, Seland G (2004) Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proceedings of the SIGCHI conference on Human factors in computing systems, Vienna

    Google Scholar 

  • TaxĂ©n G (2004) Introducing participatory design in museums. In: Proceedings of the eighth conference on participatory design: artful integration: interweaving media, materials and practices, Toronto

    Google Scholar 

  • Walker BN, Cothran JT (2003) Sonification sandbox: a graphical toolkit for auditory graphs. In: Proceedings of International conference on auditory display, Boston

    Google Scholar 

  • Ware C (2000) Information visualization: perception for design. Morgan Kaufman, San Francisco

    Google Scholar 

  • Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638

    Article  Google Scholar 

  • Worrall D (2009) The use of sonic articulation in identifying correlation in capital market trading data. In: Proceedings of the 15th International conference on auditory display, Copenhagen

    Google Scholar 

  • Worrall D (2015) Realtime sonification and visualisation of network metadata. In Proceedings of the 21st International conference on auditory display, Graz

    Google Scholar 

  • Worrall D, Bylstra M, Barrass S et al (2007) The design of an extendable software framework for sonification research and auditory display. In: Proceedings of International conference on auditory display, Montreal

    Google Scholar 

  • Yamauchi Y, Swanson EB (2010) Local assimilation of an enterprise system: situated learning by means of familiarity pockets. Inf Organ 20(3–4):187–206

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Audio Arts and Acoustics, Columbia College Chicago, Chicago, IL, USA

    Visda Goudarzi

Authors
  1. Visda Goudarzi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Visda Goudarzi .

Editor information

Editors and Affiliations

  1. School of Interactive Arts & Technology, Simon Fraser University, Surrey, British Columbia, Canada

    Michael Filimowicz

  2. School of Communications, Simon Fraser University, Burnaby, British Columbia, Canada

    Veronika Tzankova

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Goudarzi, V. (2018). Sonification and HCI. In: Filimowicz, M., Tzankova, V. (eds) New Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-73356-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73356-2_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73355-5

  • Online ISBN: 978-3-319-73356-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation