Abstract
Psychological research on cross-modal auditory-visual perception has focused on the manipulation of sensory information predominantly by visual information. There are relatively few studies of the way auditory stimuli may affect other sensory information.
The Sound-induced Illusory Flash is one illusory paradigm that involves the auditory system biasing other senses. However, little is known about the cross-modal illusion. More research is needed into the structure of the illusion that investigates the different conditions under which the Sound-induced Illusory Flash manifests and is enhanced or reduced.
The experiment reported here investigates the effect of new auditory stimulus variables on the Sound-induced Illusory Flash. The variables to be discussed concern forming a contrast in the auditory stimulus to emphasise the illusory percept. The auditory contrasts used were single pitched beeps versus those alternating in pitch by an octave, and the presentation of sound monaurally versus binaurally.
The ultimate aim is to develop the illusory effect as a basis for new intermedia techniques and creative applications for the temporal manipulation and spatialisation of visual objects.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alais, D., Burr, D.: The ventriloquist effect results from near-optimal bi-modal integration. Current Biology 14, 257–262 (2004)
Bhattacharya, J., Shams, L., Shimojo, S.: Sound-induced Illusory Flash Perception: Role of Gamma Band Responses. Cognitive Neuroscience and Neuropsychology 13, 14 (2002)
Bregman, A.: Auditory Scene Analysis. The MIT Press, Cambridge Massachusetts (1999)
Dean, R.T., Whitelaw, M., Smith, H., Worrall, D.: The mirage of real-time algorithmic synaesthesia: Some compositional mechanisms and research agendas in computer music and sonification. Contemporary Music Review 25, 311–327 (2006)
Deutsch, D.: An auditory illusion. Nature 251, 307–309 (1974)
Deutsch, D.: Two-channel listening to musical scales. Journal of the Acoustical Society of America 57, 1156–1160 (1975)
Deutsch, D.: The octave illusion and auditory perceptual integration. Hearing Research and Theory 1, 99–142 (1981)
Deutsch, D.: The octave illusion in relation to handedness and familial handedness background. Neuropsychologia 21, 289–293 (1983)
Deutsch, D.: A musical paradox. Music Perception 3, 27–280 (1986)
Deutsch, D.: The semitone paradox. Music Perception 6(2), 115–132 (1988)
Grove, R.: Thinking in Four Dimensions. Melbourne University Press, Melbourne (2005)
Marks, L.: On the associations of light and sound: the mediation of brightness, pitch, and loudness. American journal of psychology 87 (1974)
McGurk, H., Macdonald, J.: Hearing lips and seeing voices. Nature 264, 746–748 (1976)
Risset, J.-C.: Musical Acoustics. IRCAM, Paris (1972)
Risset, J.-C.: Pitch and rhythm paradoxes: Comments on ’Auditory paradox based on fractal waveform’. The journal of the Acoustical Society of America 80(3), 961–962 (1986)
Roads, C.: The Computer Music Tutorial. The MIT Press, Cambridge (1996)
Roads, C.: Microsound. The MIT Press, Cambridge (2001)
Shams, L.: Integration in the brain - the subconscious alteration of visual perception by cross-modal integration. Science and Consciousness Review 1, 1–4 (2002)
Shams, L., Iwaki, S., Chawla, A., Bhattacharya, J.: Early modulation of visual cortex by sound: an MEG study. Neuroscience Letters 378, 76–81 (2005)
Shams, L., Kamitani, Y., Shimojo, S.: What you see is what you hear. Nature 408, 788 (2000)
Shams, L., Kamitani, Y., Shimojo, S.: Visual illusion induced by sound. Cognitive Brain Research 14, 147–152 (2002)
Shams, L., Ma, W.J., Beierholm, U.: Sound-induced flash illusion as an optimal percept. Neuroreport 16, 17 (2005)
Shepard, R.: Circularity in judgements of relative pitch. Journal of the Acoustical Society of America 36, 2346–2353 (1964)
Shimojo, S., Scheier, C., Nijhawan, R., Shams, L., Kamitani, Y., Watanabe, K.: Beyond perceptual modality: auditory effects on visual perception. Acoustic Science and Technology 22(2), 61–67 (2001)
Shimojo, S., Shams, L.: Sensory modalities are not separate modalities: plasticity and interactions. Current opinion in neurobiology 11, 505–509 (2001)
Shipley, T.: Auditory flutter driving of visual flicker. Science 145, 1328–1330 (1964)
Sinex, D.G.: Cross-modality temporal resolution for auditory, vibrotactile and visual stimuli. Journal of the Acoustical Society of America 63(suppl. 1), 52 (1978)
van Noorden, L.P.A.S.: Minimum differences of level and frequency for perceptual fission of tone sequences ABAB. Journal of the Acoustical Society of America 61(4), 1041–1056 (1977)
Zele, A.J., Vingrys, A.J.: Cathode-ray-tube monitor artefacts in neurophysiology. Journal of Neuroscience Methods 141, 1–7 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wilkie, S., Stevens, C., Dean, R. (2008). Psychoacoustic Manipulation of the Sound-Induced Illusory Flash. In: Kronland-Martinet, R., Ystad, S., Jensen, K. (eds) Computer Music Modeling and Retrieval. Sense of Sounds. CMMR 2007. Lecture Notes in Computer Science, vol 4969. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85035-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-85035-9_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85034-2
Online ISBN: 978-3-540-85035-9
eBook Packages: Computer ScienceComputer Science (R0)