Abstract
This paper discusses the concept of self-produced sound and its importance in understanding audio-haptic interaction. Self-produced sound is an important stimulus in understanding audio-haptic interaction because of the tight binding between the two modalities. This paper provides background on this type of sound, a brief review of the asynchrony and neurophysiology research that has addressed the cross-modality interaction, and examples of research into self-produced sound, including a unique but common instance: sound produced when consuming food.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Truax, B.: Acoustic Communication. Ablex, Norwood, NJ (1984)
Gibson, J.J.: The Senses Considered as Perceptual Systems. Houghton Mifflin, Boston (1966)
Orgs, G., Lange, K., Dombrowski, J., Heil, M.: Is conceptual priming for environmental sounds obligatory? International Journal of Psychophysiology 65, 162–166 (2007)
Levitin, D.J., MacLean, K., Mathews, M., Chu, L., Jensen, E.: The perception of cross-modal simultaneity (Or ”The Greenwich Observatory Problem” Revisited). In: Computing Anticipatory Systems: CASYS 1999 - Third International Conference, pp. 323–329 (2000)
Adelstein, B.D., Begault, D.R., Anderson, M.R., Wenzel, E.M.: Sensitivity to Haptic-Audio Asynchrony. In: 5th International Conference on Multimodal Interfaces, Vancouver, Canada, pp. 73–76. ACM Press, New York (2003)
Martens, W.L., Woszczyk, W.: Perceived Synchrony in a Bimodal Display: Optimal Intermodal Delay for Coordinated Auditory and Haptic Reproduction. In: Proceedings of ICAD 04-Tenth Meeting of the International Conference on Auditory Display, Sydney, Australia (2004)
Kanold, P.O., Young, E.O.: Proprioceptive Information from the Pinna Provides Somatosensory Input to Cat Dorsal Cochlear Nucleus. The Journal of Neuroscience 21, 7848–7858 (2001)
Fu, K.G., Johnston, T.A., Shah, A.S., Arnold, L., Smiley, J., Hackett, T.A., Garraghty, P.E., Schroeder, C.E.: Auditory Cortical Neurons Respond to Somatosensory Stimulation. J. Neuroscience 23, 7510–7515 (2003)
Kayser, C., Petkov, C.I., Augath, M., Logothetis, N.K.: Integration of Touch and Sound in Auditory Cortex. Neuron 48, 373–384 (2005)
Schafer, R.M.: Our Sonic Environment and the Soundscape: The Tuning of the World. Destiny Books, Rochester, Vermont (1994)
Ballas, J.A.: Common Factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology: Human Perception and Performance 19, 250–267 (1993)
Luyten, H., Vliet, T.V.: Acoustic Emission, Fracture Behavior and Morphology of Dry Crispy Foods: A Discussion Article. Journal of Texture Studies 37, 221–240 (2006)
Barreiro, P., Ortiz, C., Ruiz-Altisent, M., De Smedt, V., Schotte, S., Andani, Z., Wakeling, I., Beyts, P.K.: Comparison between Sensory and Instrumental Measurements for Mealiness Assessment in Apples. A Collaborative Test. Journal of Texture Studies 29, 509–525 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ballas, J.A. (2007). Self-produced Sound: Tightly Binding Haptics and Audio. In: Oakley, I., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2007. Lecture Notes in Computer Science, vol 4813. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76702-2_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-76702-2_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76701-5
Online ISBN: 978-3-540-76702-2
eBook Packages: Computer ScienceComputer Science (R0)