Skip to main content
SpringerLink
Log in
Book cover

Multisensory Object Perception in the Primate Brain pp 71–82Cite as

Cortical Oscillations and Multisensory Interactions in Humans

  • Chapter
  • First Online:

Abstract

Oscillatory activity in the higher (gamma) frequency range in electro- or magnetoencephalogram (EEG or MEG, respectively) has been proposed as a correlate of cortical network synchronization. This chapter reviews the evidence for an involvement of gamma-band activity in multisensory integration. The relevant studies are grouped by the level at which oscillatory EEG or MEG data were analyzed. The first section describes reports of topographically unspecific or widespread spectral activity. The second part focuses on studies demonstrating topographically local activity both at the electrode/sensor level and at the cortical source level. Finally, reports of cortico-cortical interactions as suggested by EEG/MEG coherence or phase synchrony are summarized. Gamma-band activity increases have been reported for temporally, spatially, or semantically matching bimodal stimulation. Some studies, however, have reported enhanced oscillatory signals also to incongruent stimuli, suggesting an important role of task requirements and attentional factors.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ (2005) Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166:559–571

    Article  PubMed  CAS  Google Scholar 

  • Bauer M, Oostenveld R, Fries P (2009) Tactile stimulation accelerates behavioral responses to visual stimuli through enhancement of occipital gamma-band activity. Vision Res 49:931–942

    Article  PubMed  Google Scholar 

  • Bauer M, Oostenveld R, Peeters M, Fries P (2006) Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas. J Neurosci 26:490–501

    Article  PubMed  CAS  Google Scholar 

  • Beauchamp MS (2005) See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 15:145–153

    Article  PubMed  CAS  Google Scholar 

  • Beauchamp MS, Lee KE, Argall BD, Martin A (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809–823

    Article  PubMed  CAS  Google Scholar 

  • Bhattacharya J, Shams L, Shimojo S (2002) Sound-induced illusory flash perception: role of gamma band responses. Neuroreport 13:1727–1730

    Article  PubMed  Google Scholar 

  • Busch NA, Herrmann CS, Müller MM, Lenz D, Gruber T (2006) A cross-laboratory study of event-related gamma activity in a standard object recognition paradigm. Neuroimage 33:1169–1177

    Article  PubMed  Google Scholar 

  • Doehrmann O, Naumer MJ (2008) Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration. Brain Res 1242:136–150

    Article  PubMed  CAS  Google Scholar 

  • Doehrmann O, Naumer MJ, Volz S, Kaiser J, Altmann CF (2008) Probing category selectivity for environmental sounds in the human auditory brain. Neuropsychologia 46:2776–2786

    Article  PubMed  Google Scholar 

  • Doesburg SM, Emberson LL, Rahi A, Cameron D, Ward LM (2008) Asynchrony from synchrony: long-range gamma-band neural synchrony accompanies perception of audiovisual speech asynchrony. Exp Brain Res 185:11–20

    Article  PubMed  Google Scholar 

  • Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57:11–23

    Article  PubMed  CAS  Google Scholar 

  • Eckhorn R, Bauer R, Jordan W, Brosch M, Kruse W, Munk M, Reitboeck HJ (1988) Coherent oscillations: a mechanism of feature linking in the visual cortex? Multiple electrode and correlation analyses in the cat. Biol Cybern 60:121–130

    Article  PubMed  CAS  Google Scholar 

  • Engel AK, Singer W (2001) Temporal binding and the neural correlates of sensory awareness. Trends Cogn Sci 5:16–25

    Article  PubMed  Google Scholar 

  • Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM (2002) Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol 88:540–543

    PubMed  Google Scholar 

  • Fries P (2005) A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci 9:474–480

    Article  PubMed  Google Scholar 

  • Fries P, Nikolic D, Singer W (2007) The gamma cycle. Trends Neurosci 30:309–316

    Article  PubMed  CAS  Google Scholar 

  • Fries P, Roelfsema PR, Engel AK, König P, Singer W (1997) Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry. Proc Natl Acad Sci U S A 94:12699–12704

    Article  PubMed  CAS  Google Scholar 

  • Ghazanfar AA, Schroeder CE (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278–285

    Article  PubMed  Google Scholar 

  • Ghazanfar AA, Chandrasekaran C, Logothetis NK (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28:4457–4469

    Article  PubMed  CAS  Google Scholar 

  • Gray CM, König P, Engel AK, Singer W (1989) Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338:334–337

    Article  PubMed  CAS  Google Scholar 

  • Gruber T, Müller MM, Keil A, Elbert T (1999) Selective visual-spatial attention alters induced gamma band responses in the human EEG. Clin Neurophysiol 110:2074–2085

    Article  PubMed  CAS  Google Scholar 

  • Gruber T, Tsivilis D, Montaldi D, Müller MM (2004) Induced gamma band responses: an early marker of memory encoding and retrieval. Neuroreport 15:1837–1841

    Article  PubMed  Google Scholar 

  • Hein G, Doehrmann O, Muller NG, Kaiser J, Muckli L, Naumer MJ (2007) Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci 27:7881–7887

    Article  PubMed  CAS  Google Scholar 

  • Herrmann CS, Munk MH, Engel AK (2004) Cognitive functions of gamma-band activity: memory match and utilization. Trends Cogn Sci 8:347–355

    Article  PubMed  Google Scholar 

  • Hummel F, Gerloff C (2005) Larger interregional synchrony is associated with greater behavioral success in a complex sensory integration task in humans. Cereb Cortex 15:670–678

    Article  PubMed  Google Scholar 

  • Jensen O, Kaiser J, Lachaux JP (2007) Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci 30:317–324

    Article  PubMed  CAS  Google Scholar 

  • Jokisch D, Jensen O (2007) Modulation of gamma and alpha activity during a working memory task engaging the dorsal or ventral stream. J Neurosci 27:3244–3251

    Article  PubMed  CAS  Google Scholar 

  • Kaiser J, Lutzenberger W, Ackermann H, Birbaumer N (2002) Dynamics of gamma-band activity induced by auditory pattern changes in humans. Cereb Cortex 12:212–221

    Article  PubMed  Google Scholar 

  • Kaiser J, Ripper B, Birbaumer N, Lutzenberger W (2003) Dynamics of gamma-band activity in human magnetoencephalogram during auditory pattern working memory. Neuroimage 20:816–827

    Article  PubMed  Google Scholar 

  • Kaiser J, Hertrich I, Ackermann H, Lutzenberger W (2006) Gamma-band activity over early sensory areas predicts detection of changes in audiovisual speech stimuli. Neuroimage 30:1376–1382

    Article  PubMed  Google Scholar 

  • Kaiser J, Lutzenberger W, Preissl H, Ackermann H, Birbaumer N (2000) Right-hemisphere dominance for the processing of sound-source lateralization. J Neurosci 20:6631–6639

    PubMed  CAS  Google Scholar 

  • Kaiser J, Hertrich I, Ackermann H, Mathiak K, Lutzenberger W (2005) Hearing lips: gamma-band activity during audiovisual speech perception. Cereb Cortex 15:646–653

    Article  PubMed  Google Scholar 

  • Kaiser J, Heidegger T, Wibral M, Altmann CF, Lutzenberger W (2008) Distinct gamma-band components reflect the short-term memory maintenance of different sound lateralization angles. Cereb Cortex 18:2286–2295

    Article  PubMed  Google Scholar 

  • Kanayama N, Ohira H (2009) Multisensory processing and neural oscillatory responses: separation of visuotactile congruency effect and corresponding electroencephalogram activities. Neuroreport 20:289–293

    Article  PubMed  Google Scholar 

  • Kanayama N, Sato A, Ohira H (2007) Crossmodal effect with rubber hand illusion and gamma-band activity. Psychophysiology 44:392–402

    Article  PubMed  Google Scholar 

  • Kayser C, Petkov CI, Logothetis NK (2008) Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560–1574

    Article  PubMed  Google Scholar 

  • Kayser C, Petkov CI, Augath M, Logothetis NK (2005) Integration of touch and sound in auditory cortex. Neuron 48:373–384

    Article  PubMed  CAS  Google Scholar 

  • Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279–292

    Article  PubMed  CAS  Google Scholar 

  • Lewis JW, Wightman FL, Brefczynski JA, Phinney RE, Binder JR, DeYoe EA (2004) Human brain regions involved in recognizing environmental sounds. Cereb Cortex 14:1008–1021

    Article  PubMed  Google Scholar 

  • Lutzenberger W, Pulvermüller F, Elbert T, Birbaumer N (1995) Visual stimulation alters local 40-Hz responses in humans: an EEG-study. Neurosci Lett 183:39–42

    Article  PubMed  CAS  Google Scholar 

  • Lutzenberger W, Ripper B, Busse L, Birbaumer N, Kaiser J (2002) Dynamics of gamma-band activity during an audiospatial working memory task in humans. J Neurosci 22:5630–5638

    PubMed  CAS  Google Scholar 

  • Maier JX, Chandrasekaran C, Ghazanfar AA (2008) Integration of bimodal looming signals through neuronal coherence in the temporal lobe. Curr Biol 18:963–968

    Article  PubMed  CAS  Google Scholar 

  • McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748

    Article  PubMed  CAS  Google Scholar 

  • Merabet LB, Swisher JD, McMains SA, Halko MA, Amedi A, Pascual-Leone A, Somers DC (2007) Combined activation and deactivation of visual cortex during tactile sensory processing. J Neurophysiol 97:1633–1641

    Article  PubMed  Google Scholar 

  • Meredith MA (2002) On the neuronal basis for multisensory convergence: a brief overview. Cogn Brain Res 14:31–40

    Article  Google Scholar 

  • Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389–391

    Article  PubMed  CAS  Google Scholar 

  • Mesulam MM (1998) From sensation to cognition. Brain 121:1013–1052

    Article  PubMed  Google Scholar 

  • Mishra J, Martinez A, Sejnowski TJ, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131

    Article  PubMed  CAS  Google Scholar 

  • Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115–128

    Article  Google Scholar 

  • Müller MM, Keil A (2004) Neuronal synchronization and selective color processing in the human brain. J Cogn Neurosci 16:503–522

    Article  PubMed  Google Scholar 

  • Noppeney U, Josephs O, Hocking J, Price CJ, Friston KJ (2008) The effect of prior visual information on recognition of speech and sounds. Cereb Cortex 18:598–609

    Article  PubMed  Google Scholar 

  • Osipova D, Takashima A, Oostenveld R, Fernandez G, Maris E, Jensen O (2006) Theta and gamma oscillations predict encoding and retrieval of declarative memory. J Neurosci 26:7523–7531

    Article  PubMed  CAS  Google Scholar 

  • Sakowitz OW, Quiroga RQ, Schurmann M, Basar E (2001) Bisensory stimulation increases gamma-responses over multiple cortical regions. Cogn Brain Res 11:267–279

    Article  CAS  Google Scholar 

  • Sakowitz OW, Quian Quiroga R, Schurmann M, Basar E (2005) Spatio-temporal frequency characteristics of intersensory components in audiovisually evoked potentials. Cogn Brain Res 23:316–326

    Article  Google Scholar 

  • Schneider TR, Debener S, Oostenveld R, Engel AK (2008) Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. Neuroimage 42:1244–1254

    Article  PubMed  Google Scholar 

  • Schroeder CE, Smiley J, Fu KG, McGinnis T, O'Connell MN, Hackett TA (2003) Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int J Psychophysiol 50:5–17

    Article  PubMed  Google Scholar 

  • Senkowski D, Talsma D, Herrmann CS, Woldorff MG (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp Brain Res 166:411–426

    Article  PubMed  Google Scholar 

  • Senkowski D, Molholm S, Gomez-Ramirez M, Foxe JJ (2006) Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study. Cereb Cortex 16:1556–1565

    Article  PubMed  Google Scholar 

  • Senkowski D, Schneider TR, Foxe JJ, Engel AK (2008) Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31:401–409

    Article  PubMed  CAS  Google Scholar 

  • Senkowski D, Schneider TR, Tandler F, Engel AK (2009) Gamma-band activity reflects multisensory matching in working memory. Exp Brain Res 198:363–372

    Article  PubMed  Google Scholar 

  • Senkowski D, Talsma D, Grigutsch M, Herrmann CS, Woldorff MG (2007) Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 45:561–571

    Article  PubMed  Google Scholar 

  • Shams L, Kamitani Y, Shimojo S (2000) What you see is what you hear. Nature 408:788

    Article  PubMed  CAS  Google Scholar 

  • Singer W, Engel AK, Kreiter A, Munk MHJ, Neuenschwander S, Roelfsema PR (1997) Neuronal assemblies: necessity, signature and detectability. Trends Cogn Sci 1:252–261

    Article  PubMed  CAS  Google Scholar 

  • Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge, MA

    Google Scholar 

  • Tallon-Baudry C, Bertrand O, Delpuech C, Pernier J (1996) Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J Neurosci 16:4240–4249

    PubMed  CAS  Google Scholar 

  • Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J (1998) Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci 18:4244–4254

    PubMed  CAS  Google Scholar 

  • Wallace MT, Meredith MA, Stein BE (1998) Multisensory integration in the superior colliculus of the alert cat. J Neurophysiol 80:1006–1010

    PubMed  CAS  Google Scholar 

  • Widmann A, Gruber T, Kujala T, Tervaniemi M, Schroger E (2007) Binding symbols and sounds: evidence from event-related oscillatory gamma-band activity. Cereb Cortex 17:2696–2702

    Article  PubMed  Google Scholar 

  • Womelsdorf T, Schoffelen JM, Oostenveld R, Singer W, Desimone R, Engel AK, Fries P (2007) Modulation of neuronal interactions through neuronal synchronization. Science 316:1609–1612

    Article  PubMed  CAS  Google Scholar 

  • Wyart V, Tallon-Baudry C (2008) Neural dissociation between visual awareness and spatial attention. J Neurosci 28:2667–2679

    Article  PubMed  CAS  Google Scholar 

  • Yuval-Greenberg S, Deouell LY (2007) What you see is not (always) what you hear: induced gamma band responses reflect cross-modal interactions in familiar object recognition. J Neurosci 27:1090–1096

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Medical Psychology, Faculty of Medicine, Goethe University, Heinrich-Hoffmann-Str. 10, 60528, Frankfurt am Main, Germany

    Jochen Kaiser & Marcus J. Naumer

Authors
  1. Jochen Kaiser
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marcus J. Naumer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jochen Kaiser .

Editor information

Editors and Affiliations

  1. Inst. Medizinische Psychologie (IMP), Universität Frankfurt, Heinrich-Hoffmann-Str. 10, Frankfurt, 60528, Germany

    Jochen Kaiser

  2. Abt. Neurophysiologie, MPI für Hirnforschung, Deutschordenstr. 46, Frankfurt/Main, 60528, Germany

    Marcus Johannes Naumer

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Science + Business Media, LLC

About this chapter

Cite this chapter

Kaiser, J., Naumer, M.J. (2010). Cortical Oscillations and Multisensory Interactions in Humans. In: Kaiser, J., Naumer, M. (eds) Multisensory Object Perception in the Primate Brain. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-5615-6_5

Download citation

Publish with us

Policies and ethics

Search

Navigation