Brain Electric Microstate and Perception of Simultaneously Audiovisual Presentation
Associations between picture and sound form the basis of reading. Learning the correspondences between them is a crucial step in reading acquisition. This study was designed to investigate whether task-related processing of audio and visual features was independent or task-related processing in one modality might influence the processing of the other. The present study employed simultaneous audio-visual stimulus in the oddball paradigm to re-examine the effects of attention on audio, visual and audio-visual perception in the non-musician brain. Electroencephalographic (EEG) was recorded from 28 normal participants. None of them had more than three years of formal musical training and none had any musical training within the past five years. Chinese and Korean subjects were presented with tones (auditory: A), pictures (visual: V), and simultaneous tones and pictures (audio-visual: AV). The neural basis of this interaction was investigated by subtracting the event-related potentials (ERPs) to the A and the V stimuli alone from the ERP to the combined AV stimuli (i.e. interaction = AV - (A+V)). The Korean group showed larger mean interaction amplitude and longer in time than the Chinese group. This reveals that experience influences the early cortical automatic processing of linguistically relevant suprasegmental pitch contour. These results suggest that efficient processing of associations between pictures and sounds relies on neural mechanisms similar to those naturally evolved for integrating audiovisual perception.
KeywordsBrain Audiovisual perception Cognition Event-related potential (ERP) Microstate
Unable to display preview. Download preview PDF.
- 4.Alho, K., Tervaniemi, M., Huotilainen, M., Lavikainen, J., Tiitinen, H., Ilmoniemi, R.J., Knuutila, J., Näätänen, R.: Processing of complex sounds in the human auditory cortex as revealed by magnetic brain responses. Psychophysiology 33, 396–375 (1996)Google Scholar
- 5.Scherg, M., Vajsar, J., Picton, T.W.: A source analysis of the late human auditory evoked potentials. J. Cogn. Neurosci. 5, 363–370 (1989)Google Scholar
- 6.Näätänen, R.: Attention and Brain Function. Erlbaum, Hillsdale (1992)Google Scholar
- 17.Pazo-Alvarez, P., Cadaveira, F., Amenedo, E.: MMN in the visual modality: a review. Biol. Psychology 63, 1999–1236 (2003)Google Scholar
- 22.Lehmann, D., Skrandies, W.: Segmentation of evoked potentials based on spatial field configuration in multichannel recordings. In: McCallum, W.C., Zappoli, R., Denoth, F. (eds.) Cerebral Psychophysiology: Studies in Event-Related Potentials. Electroencephalography and Clinical Neurophysiology (suppl. 38), pp. 506–512 (1986)Google Scholar