Crossmodal Integration of Emotional Stimuli in Alcohol Dependence

  • Pierre Maurage
  • Scott Love
  • Fabien D’Hondt


Face–voice integration has been extensively explored among healthy participants during the last decades. Nevertheless, while binding alterations constitute a core feature of many psychiatric diseases, these crossmodal processing have been very little explored in these populations. This chapter presents three studies offering an integrative use of behavioural, electrophysiological and neuroimaging techniques to explore the audio–visual integration of emotional stimuli in alcohol dependence. These results constitute a preliminary step towards a multidisciplinary exploration of crossmodal processing in psychiatry, extending to other stimulations, sensorial modalities and populations. The exploration of impaired crossmodal abilities could renew the knowledge on “normal” audio–visual integration and could lead to innovative therapeutic programs.


Alcohol Dependence Emotional Facial Expression Emotional Prosody Visual Integration Emotional Impairment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



Pierre Maurage is Senior Research Assistant at the National Fund for Scientific Research (F.N.R.S., Belgium). This work was supported by grants from the French Ministry of Research.


  1. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14:257–262PubMedGoogle Scholar
  2. Barbeau EJ, Pariente J, Felician O, Puel M (2010) Visual recognition memory: A double anatomo-functional dissociation. Hippocampus 21(9):929–934PubMedGoogle Scholar
  3. Barkhuysen P, Krahmer E, Swerts M (2010) Crossmodal and incremental perception of audiovisual cues to emotional speech. Language and Speech 53(1):3–30PubMedGoogle Scholar
  4. Baron-Cohen S, Wheelwright S (2004) The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. Journal of Autism and Developmental Disorders 34(2):163–175PubMedGoogle Scholar
  5. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I (2001) The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry 42(241):251Google Scholar
  6. Barone P (2010) Is the primary visual cortex multisensory? Comment on “Crossmodal influences on visual perception” by Prof. Ladan Shams. Physical Life Review 7(3):291–292Google Scholar
  7. Bartek JK, Lindeman M, Hawks JH (1999) Clinical validation of characteristics of the alcoholic family. Nurse Diagnostic 10:158–168Google Scholar
  8. Basile B, Mancini F, Macaluso E, Caltagirone C, Frackowiak RS, Bozzali M (2011) Deontological and altruistic guilt: Evidence for distinct neurobiological substrates. Human Brain Mapping 32(2):229–239PubMedGoogle Scholar
  9. Beatty WW, Tivis R, Stott D, Nixon SJ, Parsons OA (2000) Neuropsychological deficits in sober alcoholics: Influences of chronicity and recent alcohol consumption. Alcoholism, Clinical and Experimental Research 24:149–154PubMedGoogle Scholar
  10. Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE (2001) Decision making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39:376–389PubMedGoogle Scholar
  11. Bernstein LE, Auer ET Jr, Wagner M, Ponton CW (2008) Spatiotemporal dynamics of audiovisual speech processing. NeuroImage 39:423–435PubMedGoogle Scholar
  12. Bhatara A, Quintin EM, Levy B, Bellugi U, Fombonne E, Levitin DJ (2010) Perception of emotion in musical performance in adolescents with autism spectrum disorders. Autism Research 3(5):214–225PubMedGoogle Scholar
  13. Blusewicz MJ, Dustman RE, Schenkenberg T, Beck EC (1977) Neuropsychological correlates of chronic alcoholism and aging. Journal of Nervous and Mental Disorders 165:348–355Google Scholar
  14. Brooks PJ (2000) Brain atrophy and neuronal loss in alcoholism: A role for DNA damage? Neurochemistry International 37:403–412PubMedGoogle Scholar
  15. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS (1999) Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport 10:2619–2623PubMedGoogle Scholar
  16. Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of auditory visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14:427–438PubMedGoogle Scholar
  17. Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends in Cognitive Sciences 11:535–543PubMedGoogle Scholar
  18. Campanella S, Bruyer R, Froidbise S, Rossignol M, Joassin F, Kornreich C et al (2010) Is two better than one? A cross-modal oddball paradigm reveals greater sensitivity of the P300 to emotional face–voice associations. Clinical Neurophysiology 121:1855–1862PubMedGoogle Scholar
  19. Campanella S, Philippot P (2006) Insights from ERPs into emotional disorders: An affective neuroscience perspective. Psychologica Belgica 46:37–53Google Scholar
  20. Carton JS, Kessler EA, Pape CL (1999) Nonverbal decoding skills and relationship wellbeing in adults. Journal of Nonverbal Behavior 23:91–100Google Scholar
  21. Chanraud S, Martelli C, Delain F, Kostogianni N, Douaud G, Aubin HJ et al (2007) Brain morphometry and cognitive performance in detoxified alcoholdependents with preserved psychosocial functioning. Neuropsychopharmacology 32:429–438PubMedGoogle Scholar
  22. Clark US, Oscar-Berman M, Shagrin B, Pencina M (2007) Alcoholism and judgments of affective stimuli. Neuropsychology 21:346–362PubMedGoogle Scholar
  23. Cohn M, Moscovitch M, Davidson PS (2010) Double dissociation between familiarity and recollection in Parkinson’s disease as a function of encoding tasks. Neuropsychologia 48(14):4142–4417PubMedGoogle Scholar
  24. Cordovil de Susa Uva M, de Timary P, Cortesi M, Mikolajczak M, Du Roy de Blicquy P, Luminet O (2010) Moderating effect of emotional intelligence on the role of negative affect in the motivation to drink in alcohol-dependent subjects. Personality and Individual Differences 48:16–21Google Scholar
  25. Cowen MS, Chen F, Lawrence AJ (2004) Neuropeptides: Implications for alcoholism. Journal of Neurochemistry 89:273–285PubMedGoogle Scholar
  26. Davis MH (1983) Measuring individual differences in empathy: Evidence from a multidimensional approach. Journal of Personality and Social Psychology 44:113–126Google Scholar
  27. De Bellis MD, Narasimhan A, Thatcher DL, Keshavan MS, Soloff P, Clark DB (2005) Prefrontal cortex, thalamus, and cerebellar volumes in adolescents and young adults with adolescent-onset alcohol use disorders and comorbid mental disorders. Alcoholism, Clinical and Experimental Research 29:1590–1600PubMedGoogle Scholar
  28. De Gelder B, Vroomen J, de Jong SJ, Masthoff ED, Trompenaars FJ, Hodiamont P (2005) Multisensory integration of emotional faces and voices in schizophrenics. Schizophrenia Research 72(2–3):195–203PubMedGoogle Scholar
  29. De Jong JJ, Hodiamont PP, Van den Stock J, de Gelder B (2009) Audiovisual emotion recognition in schizophrenia: Reduced integration of facial and vocal affect. Schizophrenia Research 107(2–3):286–293PubMedGoogle Scholar
  30. DiClemente CC, Jordan L, Marinilli AS, Nidecker M (2003) Psychotherapy in alcoholism treatment. In: Johnson BA, Ruiz P, Galanter M (eds) Handbook of clinical alcoholism treatment. Lippincott, Williams, & Wilkins, Baltimore, MD, pp 102–110Google Scholar
  31. Driver J, Spence C (2000) Multisensory perception: Beyond modularity and convergence. Current Biology 10:731–735Google Scholar
  32. Ellis HD, Jones DM, Mosdell N (1997) Intra- and inter-modal repetition priming of familiar faces and voices. British Journal of Psychology 88:143–156PubMedGoogle Scholar
  33. Enoch MA (2006) Genetic and environmental influences on the development of alcoholism: Resilience vs risk. Annals of the New York Academy of Sciences 1094:193–201PubMedGoogle Scholar
  34. Ethofer T, Pourtois G, Wildgruber D (2006) Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research 156:345–361PubMedGoogle Scholar
  35. Fein G, Bachman L, Fischer S, Davenport L (1990) Cognitive impairments in abstinent alcoholics. West Journal of Medicine 152:531–537Google Scholar
  36. Fein G, Landman B, Tran H, McGillivray S, Finn P, Barakos J et al (2006) Brain atrophy in long-term abstinent alcoholics who demonstrate impairment on a simulated gambling task. NeuroImage 32:1465–1471PubMedGoogle Scholar
  37. Feldman RS, Philippot P, Custrini RJ (1991) Social competence and non-verbal behaviour. In: Feldman RS (ed) Fundamentals of non-verbal behavior. Cambridge University Press, New York, pp 329–350Google Scholar
  38. Flannery B, Fishbein D, Krupitsky E, Langevin D, Verbitskaya E, Bland C et al (2007) Gender differences in neurocognitive functioning among alcohol-dependent Russian patients. Alcoholism, Clinical and Experimental Research 31:745–754PubMedGoogle Scholar
  39. Foisy, M.L. (2005). La reconnaissance des expressions faciales émotionnelles dans l’alcoolisme: Spécification de la nature et de l’origine des biais évaluatifs. Unpublished PhD Thesis, Catholic University of Louvain, Louvain-la-Neuve, Belgique.Google Scholar
  40. Foisy ML, Kornreich C, Fobe A, D’Hondt L, Pelc I, Hanak C et al (2007a) Impaired emotional facial expression recognition in alcohol dependence: Do these deficits persist with midterm abstinence? Alcoholism, Clinical and Experimental Research 31:404–410PubMedGoogle Scholar
  41. Foisy ML, Kornreich C, Petiau C, Parez A, Hanak C, Verbanck P et al (2007b) Impaired emotional facial expression recognition in alcoholics: Are these deficits specific to emotional cues? Psychiatry Research 150:33–41PubMedGoogle Scholar
  42. Frens MA, Van Opstal AJ, Van der Willigen RF (1995) Spatial and temporal factors determine auditory–visual interactions in human saccadic eye movements. Perception & Psychophysics 57:802–816Google Scholar
  43. Frigerio E, Burt DM, Montagne B, Murray LK, Perrett DI (2002) Facial affect perception in alcoholics. Psychiatry Research 113:161–171PubMedGoogle Scholar
  44. Friston KJ, Frith CD (1995) Schizophrenia: A disconnection syndrome? Clinical Neuroscience 3(2):89–97PubMedGoogle Scholar
  45. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multi-sensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 25(20):5004–5012PubMedGoogle Scholar
  46. Giancola PR (2002) Alcohol-related aggression during the college years: Theories, risk factors and policy implications. Journal of Studies on Alcohol 14:129–139Google Scholar
  47. Goebel R, van Atteveldt N (2009) Multisensory functional magnetic resonance imaging: A future perspective. Experimental Brain Research 198:153–164Google Scholar
  48. Gottfried JA, Dolan RJ (2003) The nose smells what the eye sees: Crossmodal visual facilitation of human olfactory perception. Neuron 39:375–386PubMedGoogle Scholar
  49. Greimel E, Macht M, Krumhuber E, Ellgring H (2006) Facial and affective reactions to tastes and their modulation by sadness and joy. Physiology and Behavior 89:261–269PubMedGoogle Scholar
  50. Hanley JR, Smith ST, Hadfield J (1998) I recognise you but I can’t place you: An investigation of familiar-only experiences during tests of voice and face recognition. Quarterly Journal of Experimental Psychology 51:179–195Google Scholar
  51. Hanley JR, Turner JM (2000) Why are familiar-only experiences more frequent for voices than for faces? Quarterly Journal of Experimental Psychology 53:1105–1116PubMedGoogle Scholar
  52. Hansenne M (2006) Event-related brain potentials in psychopathology: Clinical and cognitive perspectives. Psychologica Belgica 46:5–36Google Scholar
  53. Harper C (2007) The neurotoxicity of alcohol. Human and Experimental Toxicology 26:251–257PubMedGoogle Scholar
  54. Harper C, Matsumoto I (2005) Ethanol and brain damage. Current Opinion in Pharmacology 5:73–78PubMedGoogle Scholar
  55. Heinz A, Wrase J, Kahnt T, Beck A, Bromand Z, Grüsser SM et al (2007) Brain activation elicited by affectively positive stimuli is associated with a lower risk of relapse in detoxified alcoholic subjects. Alcoholism, Clinical and Experimental Research 31:1138–1147PubMedGoogle Scholar
  56. Hutcherson CA, Gross JJ (2011) The moral emotions: A social-functionalist account of anger, disgust, and contempt. Journal of Personality and Social Psychology 100(4):719–737PubMedGoogle Scholar
  57. Joassin F, Maurage P, Bruyer R, Crommelinck M, Campanella S (2004) When audition alters vision: An eventrelated potential study of the cross-modal interactions between faces and voices. Neuroscience Letters 369(2):132–137PubMedGoogle Scholar
  58. Joassin F, Maurage P, Campanella S (2011a) The neural network sustaining the crossmodal processing of human gender from faces and voices: An fMRI study. NeuroImage 54(2):1654–1661PubMedGoogle Scholar
  59. Joassin F, Pesenti M, Maurage P, Verreckt E, Bruyer R, Campanella S (2011b) Cross-modal interactions between human faces and voices involved in person recognition. Cortex 47(3):367–376PubMedGoogle Scholar
  60. Kareken DA, Claus ED, Sabri M, Dzemidzic M, Kosobud AEK, Radnovich AJ et al (2004) Alcohol-related olfactory cues activate the nucleus accumbens and the ventrotemental area in high-risk drinkers: Preliminary findings. Alcoholism, Clinical and Experimental Research 28(4):550–557PubMedGoogle Scholar
  61. Karno MP, Longabaugh R (2005) An examination of how therapist directiveness interacts with patient anger and reactance to predict alcohol use. Journal of Studies on Alcohol 66:825–832PubMedGoogle Scholar
  62. Kathmann N, Soyka M, Bickel R, Engel RR (1996) ERP changes in alcoholics with and without alcohol psychosis. Biological Psychiatry 39:873–881PubMedGoogle Scholar
  63. Kornreich C, Blairy S, Philippot P, Dan B, Foisy ML, Hess U et al (2001) Impaired emotional facial expression recognition in alcoholism compared with obsessive–compulsive disorder and normal controls. Psychiatry Research 102:235–248PubMedGoogle Scholar
  64. Kornreich C, Philippot P, Foisy ML, Blairy S, Raynaud E, Dan B et al (2002) Impaired emotional facial expression recognition is associated with interpersonal problems in alcoholism. Alcohol and Alcoholism 37:394–400PubMedGoogle Scholar
  65. Kramer JH, Blusewicz MJ, Robertson LC, Preston K (1989) Effects of chronic alcoholism on perception of hierarchical visual stimuli. Alcoholism, Clinical and Experimental Research 13:240–245PubMedGoogle Scholar
  66. Kreifelts B, Ethofer T, Grodd W, Erb M, Wildgruber D (2007) Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage 37(4):1445–1456PubMedGoogle Scholar
  67. Kril JJ, Halliday GM, Svoboda MD, Cartwright H (1997) The cerebral cortex is damaged in chronic alcoholics. Neuroscience 79:983–998PubMedGoogle Scholar
  68. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Frontiers in Integrative Neuroscience 4(129):1–11Google Scholar
  69. Latinus M, VanRullen R, Taylor M (2010) Top-down and bottom-up modulation in processing bimodal face/voice stimuli. BMC Neuroscience 11:36PubMedGoogle Scholar
  70. Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Experimental Brain Research 166:289–297Google Scholar
  71. Leppänen JM, Hietanen JK (2003) Affect and face perception: Odors modulate the recognition advantage of happy faces. Emotion 3:315–326PubMedGoogle Scholar
  72. Lieberman DZ (2000) Children of alcoholics: An update. Current Opinions in Pediatry 12(4):336–340Google Scholar
  73. Listerud J, Powers C, Moore P, Libon DJ, Grossman M (2009) Neuropsychological patterns in magnetic resonance imaging-defined subgroups of patients with degenerative dementia. Journal of International Neuropsychological Society 15(3):459–470Google Scholar
  74. Little HJ, Stephens DN, Ripley TL, Borlikova G, Duka T, Schubert M et al (2005) Alcohol withdrawal and conditioning. Alcohol, Clinical and Experimental Research 29(3):453–464Google Scholar
  75. Love S, Pollick FE, Latinus M (2011) Cerebral correlates and statistical criteria of cross-modal face and voice integration. Seeing and Perceiving 24(4):351–367PubMedGoogle Scholar
  76. Marinkovic K, Oscar-Berman M, Urban T, O’Reilly CE, Howard JA, Sawyer K et al (2009) Alcoholism and dampened temporal limbic activation to emotional faces. Alcoholism, Clinical and Experimental Research 33:1880–1892PubMedGoogle Scholar
  77. Martinotti G, Di Nicola M, Tedeschi D, Cundari S, Janiri L (2009) Empathy ability is impaired in alcohol-dependent patients. The American Journal on Addictions 18(2):157–161PubMedGoogle Scholar
  78. Massida, Z., Belin, P., James, C., Rouger, J., Fraysse, B., Barone, P., et al. (2010). Voice discrimination in cochlear-implanted deaf subjects. Hear Research, in press.Google Scholar
  79. Maurage, P., Callot, C., Rombaux, P., Philippot, P., & de Timary, P. Olfactory impairment is correlated with confabulation in alcoholism: Towards a multimodal testing of orbitofrontal cortex. Submitted a.Google Scholar
  80. Maurage, P., Callot, C., Rombaux, P., Philippot, P., & de Timary, P. Chemosensory event related potentials in alcoholism: A specific impairment for olfactory function. Submitted b.Google Scholar
  81. Maurage, P., Joassin, F., Pesenti, M., Speth, A., Modave, J., Philippot, P., et al. Cerebral effects of binge drinking: Respective influences of global alcohol intake and consumption pattern. Submitted c.Google Scholar
  82. Maurage P, Campanella C, Philippot P, Charest I, Martin S, de Timary P (2009a) Impaired emotional facial expression decoding in alcoholism is also present for emotional prosody and body postures. Alcohol and Alcoholism 44(5):476–485PubMedGoogle Scholar
  83. Maurage P, Campanella S, Philippot P, Martin S, de Timary P (2008a) Face processing in chronic alcoholism: A specific deficit for emotional features. Alcoholism, Clinical and Experimental Research 32(4):600–606PubMedGoogle Scholar
  84. Maurage P, Campanella S, Philippot P, Pham T, Joassin F (2007a) The crossmodal facilitation effect is disrupted in alcoholism: A study with emotional stimuli. Alcohol and Alcoholism 42(6):552–559PubMedGoogle Scholar
  85. Maurage P, Campanella S, Philippot P, Vermeulen N, Constant E, Luminet O et al (2008b) Electrophysiological correlates of the disrupted processing of anger in alcoholism. International Journal of Psychophysiology 70(1):50–62PubMedGoogle Scholar
  86. Maurage, P., Grynberg, D., Noël, X., Joassin, F., Hanak, C., Verbanck, P., et al. The “Reading the Mind in the Eyes” test as a new way to explore complex emotions decoding in alcoholism. Psychiatry Research, in press a.Google Scholar
  87. Maurage, P., Grynberg, D., Noël, X., Joassin, F., Philippot, P., Hanak, C., et al. Dissociation between affective and cognitive empathy in alcoholism: A specific deficit for the emotional dimension. Alcoholism, Clinical and Experimental Research, in press b.Google Scholar
  88. Maurage, P., Joassin, F., & de Timary, P. The cross-modal processing of emotional face voice pairs is seriously impaired in alcoholdependence: An fMRI study. In Preparation.Google Scholar
  89. Maurage P, Joassin F, Philippot P, Campanella S (2007b) A validated battery of vocal emotional expressions. Neuropsychological Trends 2:63–74Google Scholar
  90. Maurage P, Pesenti M, Philippot P, Joassin F, Campanella S (2009b) Latent deleterious effects of binge drinking over a short period of time revealed by electrophysiological measures only. Journal of Psychiatry & Neuroscience 34(2):111–118Google Scholar
  91. Maurage P, Philippot P, Joassin F, Pauwels L, Alonso Prieto E, Palmero Soler E et al (2008c) The auditory–visual integration of anger is impaired in alcoholism: An ERP study. Journal of Psychiatry & Neuroscience 33(2):111–122Google Scholar
  92. Maurage P, Philippot P, Verbanck P, Noel X, Kornreich C, Hanak C et al (2007c) Is the P300 deficit in alcoholism associated with early visual impairments (P100, N170)? An oddball paradigm. Clinical Neurophysiology 118(3):633–644PubMedGoogle Scholar
  93. McCarty CA, Ebel BE, Garrison MM, DiGiuseppe DL, Christakis DA, Rivara FP (2004) Continuity of binge and harmful drinking from late adolescence to early adulthood. Pediatrics 114(3):714–719PubMedGoogle Scholar
  94. McGurk H, McDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748PubMedGoogle Scholar
  95. McIntosh C, Chick J (2004) Alcohol and the nervous system. Journal of Neurology, Neurosurgery, and Psychiatry 75:16–21Google Scholar
  96. Mejias S, Rossignol M, Debatisse D, Streel E, Servais L, Guérit JM et al (2005) Event-related potentials (ERPs) in ecstasy (MDMA) users during a visual oddball task. Biological Psychology 69(3):333–352PubMedGoogle Scholar
  97. Melillo R, Leisman G (2009) Autistic spectrum disorders as functional disconnection syndrome. Reviews in Neuroscience 20(2):111–131Google Scholar
  98. Mendlewicz L, Linkowski P, Bazelmans C, Philippot P (2005) Decoding emotional facial expressions in depressed and anorexic patients. Journal of Affective Disorders 89(1–3):195–199PubMedGoogle Scholar
  99. Monnot M, Lovallo WR, Nixon SJ, Ross E (2002) Neurological basis of deficits in affective prosody comprehension among alcoholics and fetal alcohol-exposed adults. The Journal of Neuropsychiatry and Clinical Neurosciences 14:321–328PubMedGoogle Scholar
  100. Monnot M, Nixon S, Lovallo W, Ross E (2001) Altered emotional perception in alcoholics: Deficits in affective prosody comprehension. Alcoholism, Clinical and Experimental Research 25:362–369PubMedGoogle Scholar
  101. Montagne B, Kessels RP, Wester AJ, de Haan EH (2006) Processing of emotional facial expressions in Korsakoff’s syndrome. Cortex 42:705–710PubMedGoogle Scholar
  102. Noël X, Van der Linden M, Schmidt N, Sferrazza R, Hanak C, Le Bon O et al (2001) Supervisory attentional system in nonamnesic alcoholic men. Archives of General Psychiatry 58:1152–1158PubMedGoogle Scholar
  103. Ogura C, Miyazato Y (1991) Cognitive dysfunctions of alcohol dependence using event related potentials. Arukoru KenkyutoYakubutsu Ison 26:331–340Google Scholar
  104. Oscar-Berman M, Hancock M, Mildworf B, Hutner N, Weber DA (1990) Emotional perception and memory in alcoholism and aging. Alcoholism, Clinical and Experimental Research 14:383–393PubMedGoogle Scholar
  105. Oscar-Berman M, Kirkley SM, Gansler DA, Couture A (2004) Comparisons of Korsakoff and non-Korsakoff alcoholics on neuropsychological tests of prefrontal brain functioning. Alcoholism, Clinical and Experimental Research 28:667–675PubMedGoogle Scholar
  106. Oscar-Berman M, Marinkovic K (2003) Alcoholism and the brain: An overview. Alcohol Research & Health 27:125–133Google Scholar
  107. Pearl D, Yodashkin-Porat D, Katz N, Valevski A, Aizenberg D, Sigler M et al (2009) Differences in audiovisual integration, as measured by McGurk phenomenon, among adult and adolescent patients with schizophrenia and age-matched healthy control groups. Comprehensive Psychiatry 50(2):186–192PubMedGoogle Scholar
  108. Petrini K, Crabbe F, Sheridan C, Pollick FE (2011) The music of your emotions: Neural substrates involved in detection of emotional correspondence between auditory and visual music actions. PLoS One 6(4)Google Scholar
  109. Petrini K, McAleer P, Pollick FE (2010) Audiovisual integration of emotional signals from music improvisation does not depend on temporal correspondence. Brain Research 1323:139–148PubMedGoogle Scholar
  110. Philippot P, Kornreich C, Blairy S, Baerts I, Den Dulk A, Le Bon O et al (1999) Alcoholics’ deficits in the decoding of emotional facial expression. Alcoholism, Clinical and Experimental Research 23:1031–1038PubMedGoogle Scholar
  111. Philippot, P., & Power, M. (2010) FaceTales.
  112. Pitel AL, Beaunieux H, Witkowski T, Vabret F, Guillery-Girard B, Quinette P et al (2007) Genuine episodic memory deficits and executive dysfunctions in alcoholic subjects early in abstinence. Alcoholism, Clinical and Experimental Research 31:1169–1178PubMedGoogle Scholar
  113. Polich J (2004) Clinical application of the P300 event-related brain potential. Physical Medicine and Rehabilitation Clinics of North America 15:133–161PubMedGoogle Scholar
  114. Porjesz B, Rangaswamy M, Kamarajan C, Jones KA, Padmanabhapillai A, Begleiter H (2005) The utility of neurophysiological markers in the study of alcoholism. Clinical Neurophysiology 116(5):993–1018PubMedGoogle Scholar
  115. Rämä P, Courtney SM (2005) Functional topography of working memory for face or voice identity. NeuroImage 24:224–234PubMedGoogle Scholar
  116. Riley H, Schutte NS (2003) Low emotional intelligence as a predictor of substance-use problems. Journal of Drug Education 33:391–398PubMedGoogle Scholar
  117. Rossignol M, Philippot P, Douilliez C, Crommelinck M, Campanella S (2005) The perception of fearful and happy facial expression is modulated by anxiety: An event-related potential study. Neuroscience Letters 377(2):115–120PubMedGoogle Scholar
  118. Rupp CI (2010) Olfactory function and schizophrenia: An update. Current Opinion in Psychiatry 23:97–102PubMedGoogle Scholar
  119. Rupp CI, Fleischhacker W, Drexler A, Hausmann A, Hinterhuber H, Kurz M (2006) Executive function and memory in relation to olfactory deficits in alcohol-dependent patients. Alcoholism, Clinical and Experimental Research 30:1355–1362PubMedGoogle Scholar
  120. Rupp CI, Fleischhacker W, Hausmann H, Mair D, Hinterhubern H, Kurz M (2004) Olfactory functioning in patients with alcohol dependence: Impairments in odor judgments. Alcohol and Alcoholism 39:514–519PubMedGoogle Scholar
  121. Rupp CI, Kurz M, Kemmler G, Mair D, Hausmann A, Hinterhuber H et al (2003) Reduced olfactory sensitivity, discrimination, and identification in patients with alcohol dependence. Alcoholism, Clinical and Experimental Research 27:432–439PubMedGoogle Scholar
  122. Salloum JB, Ramchandani VA, Bodurka J, Rawlings R, Momenan R, George D et al (2007) Blunted rostral anterior cingulate response during a simplified decoding task of negative emotional facial expressions in alcoholic patients. Alcoholism, Clinical and Experimental Research 31:1490–1504PubMedGoogle Scholar
  123. Schiffman M (1997) Taste and smell losses in normal aging and disease. Journal of the American Medical Association 278:1357–1362PubMedGoogle Scholar
  124. Schulte T, Mũller-Oehring EM, Pfefferbaum A, Sullivan EV (2010) Neurocircuitry of emotion and cognition in alcoholism: Contributions from white matter fiber tractography. Dialogues in Clinical Neuroscience 12(4):554–560PubMedGoogle Scholar
  125. Schweinberger SR, Herholz A, Sommer W (1997) Recognizing famous voices: Influence of stimulus duration and different types of retrieval cues. Journal of Speech, Language, and Hearing Research 40:453–463PubMedGoogle Scholar
  126. Seubert J, Kellermann T, Loughead J, Boers F, Brensinger C, Schneider F et al (2010a) Processing of disgusted faces is facilitated by odor primes: A functional MRI study. NeuroImage 53(2):746–756PubMedGoogle Scholar
  127. Seubert J, Loughead J, Kellermann T, Boers F, Brensinger CM, Habel U (2010b) Multisensory integration of emotionally valenced olfactory–visual information in patients with schizophrenia and healthy controls. Journal of Psychiatry & Neuroscience 35(3):185–194Google Scholar
  128. Shepherd GM (2006) Smell images and the flavour system in the human brain. Nature 444:316–321PubMedGoogle Scholar
  129. Small DA (2004) Crossmodal integration – insights from the chemical senses. Trends in Neuroscience 27:123–124Google Scholar
  130. Smith ME, Oscar-Berman M (1992) Resource-limited information processing in alcoholism. Journal of Studies on Alcohol 53:514–518PubMedGoogle Scholar
  131. Spitzer JB (1981) Auditory effects of chronic alcoholism. Drug and Alcohol Dependence 8:317–335PubMedGoogle Scholar
  132. Spitzer JB, Ventry IM (1980) Central auditory dysfunction among chronic alcoholics. Archives of Otolaryngology 106:224–229PubMedGoogle Scholar
  133. Sullivan EV, Mathalon DH, Zipursky RB, Kersteen-Tucker Z, Knight RT, Pfefferbaum A (1993) Factors of the Wisconsin Card Sorting Test as measures of frontal lobe function in schizophrenia and in chronic alcoholism. Psychiatry Research 46:175–199PubMedGoogle Scholar
  134. Szabo Z, Owonikoko T, Peyrot M, Varga J, Mathews WB, Ravert HT et al (2004) Positron emission tomography imaging of the serotonin transporter in subjects with a history of alcoholism. Biological Psychiatry 55:766–771PubMedGoogle Scholar
  135. Szczepanska L, Baran J, Mikolaszek-Boba M (2004) Connection between personality and emotional intelligence in groups of patients after suicidal attempts and ethanol dependent persons. Przeglev Lekvi 61:287–291Google Scholar
  136. Szycik GR, Münte TF, Dillo W, Mohammadi B, Samii A, Emrich HM et al (2009) Audiovisual integration of speech is disturbed in schizophrenia: An fMRI study. Schizophrenia Research 110(1–3):111–118PubMedGoogle Scholar
  137. Taieb O, Corcos M, Loas G, Speranza M, Guilbaud O, Perez-Diaz F et al (2002) Alexithymia and alcohol dependence. Annales de Médecine Interne 153:51–60Google Scholar
  138. Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audiovisual crossmodal integration by means of event-related potentials (ERP) recordings. Cognitive Brain Research 14:106–114PubMedGoogle Scholar
  139. Townshend JM, Duka T (2003) Mixed emotions: Alcoholics’ impairments in the recognition of specific emotional facial expressions. Neuropsychologia 41:773–782PubMedGoogle Scholar
  140. Townshend JM, Duka T (2005) Binge drinking, cognitive performance and mood in a population of young social drinkers. Alcoholism, Clinical and Experimental Research 29:317–325PubMedGoogle Scholar
  141. Turetsky BI, Hahn CG, Borgmann-Winter K, Moberg PJ (2009) Scents and nonsense: Olfactory dysfunction in schizophrenia. Schizophrenia Bulletin 35:1117–1131PubMedGoogle Scholar
  142. Uekermann J, Channon S, Winkel K, Schlebusch P, Daum I (2007) Theory of mind, humour processing and executive functioning in alcoholism. Addiction 102:232–240PubMedGoogle Scholar
  143. Uekermann J, Daum I (2008) Social cognition in alcoholism: A link to prefrontal cortex dysfunction? Addiction 103(5):726–735PubMedGoogle Scholar
  144. Uekermann J, Daum I, Schlebusch P, Trenckmann U (2005) Processing of affective stimuli in alcoholism. Cortex 41:189–194PubMedGoogle Scholar
  145. Uzun O, Ats A, Cansever A, Ozsahin A (2003) Alexithymia in male alcoholics: Study in a Turkish sample. Comprehensive Psychiatry 44:349–352PubMedGoogle Scholar
  146. Van der Stelt O, Gunning WB, Snel J, Zeef E, Kok A (1994) Children of alcoholics: Attention, information processing and event-related brain potentials. Acta Paediatrica 404(4):6Google Scholar
  147. Vatakis A, Spence C (2006) Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task. Neuroscience Letters 393(1):40–44PubMedGoogle Scholar
  148. Wagner U, N’diaye K, Ethofer T, Vuilleumier P (2011) Guilt-specific processing in the prefrontal cortex. Cerebral Cortex 21(11):2461–2470PubMedGoogle Scholar
  149. Winston JS, Gottfried JA, Kilner JM, Dolan RJ (2005) Integrated neural representations of odor intensity and affective valence in human amygdala. Journal of Neuroscience 25:8903–8907PubMedGoogle Scholar
  150. Zeigler DW, Wang CC, Yoast RA, Dickinson BD, McCaffree MA, Robinowitz CB et al (2005) The neurocognitive effects of alcohol on adolescents and college students. Preventive Medicine 40:23–32PubMedGoogle Scholar
  151. Zupan B, Sussman JE (2009) Auditory preferences of young children with and without hearing loss for meaningful auditory–visual compound stimuli. Journal of Communication Disorders 42(6):381–396PubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Neuroscience, Systems and Cognition (NEUROCS), and Health and Psychological Development (CSDP) Research Units, Institute of PsychologyCatholic University of LouvainLouvain-la-NeuveBelgium
  2. 2.Department of Psychological and Brain SciencesIndiana UniversityBloomingtonUSA
  3. 3.Lille Nord de France UniversityLilleFrance
  4. 4.Functional Neurosciences and Pathology LabUDSLLilleFrance

Personalised recommendations