Skip to main content
SpringerLink
Log in
Book cover

Integrating Face and Voice in Person Perception pp 271–298Cite as

Crossmodal Integration of Emotional Stimuli in Alcohol Dependence

  • Chapter
  • First Online:

  • 1913 Accesses

Abstract

Face–voice integration has been extensively explored among healthy participants during the last decades. Nevertheless, while binding alterations constitute a core feature of many psychiatric diseases, these crossmodal processing have been very little explored in these populations. This chapter presents three studies offering an integrative use of behavioural, electrophysiological and neuroimaging techniques to explore the audio–visual integration of emotional stimuli in alcohol dependence. These results constitute a preliminary step towards a multidisciplinary exploration of crossmodal processing in psychiatry, extending to other stimulations, sensorial modalities and populations. The exploration of impaired crossmodal abilities could renew the knowledge on “normal” audio–visual integration and could lead to innovative therapeutic programs.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14:257–262

    PubMed  CAS  Google Scholar 

  • Barbeau EJ, Pariente J, Felician O, Puel M (2010) Visual recognition memory: A double anatomo-functional dissociation. Hippocampus 21(9):929–934

    PubMed  Google Scholar 

  • Barkhuysen P, Krahmer E, Swerts M (2010) Crossmodal and incremental perception of audiovisual cues to emotional speech. Language and Speech 53(1):3–30

    PubMed  Google Scholar 

  • Baron-Cohen S, Wheelwright S (2004) The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. Journal of Autism and Developmental Disorders 34(2):163–175

    PubMed  Google Scholar 

  • Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I (2001) The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry 42(241):251

    Google Scholar 

  • Barone P (2010) Is the primary visual cortex multisensory? Comment on “Crossmodal influences on visual perception” by Prof. Ladan Shams. Physical Life Review 7(3):291–292

    Google Scholar 

  • Bartek JK, Lindeman M, Hawks JH (1999) Clinical validation of characteristics of the alcoholic family. Nurse Diagnostic 10:158–168

    CAS  Google Scholar 

  • Basile B, Mancini F, Macaluso E, Caltagirone C, Frackowiak RS, Bozzali M (2011) Deontological and altruistic guilt: Evidence for distinct neurobiological substrates. Human Brain Mapping 32(2):229–239

    PubMed  Google Scholar 

  • Beatty WW, Tivis R, Stott D, Nixon SJ, Parsons OA (2000) Neuropsychological deficits in sober alcoholics: Influences of chronicity and recent alcohol consumption. Alcoholism, Clinical and Experimental Research 24:149–154

    PubMed  CAS  Google Scholar 

  • Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE (2001) Decision making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39:376–389

    PubMed  CAS  Google Scholar 

  • Bernstein LE, Auer ET Jr, Wagner M, Ponton CW (2008) Spatiotemporal dynamics of audiovisual speech processing. NeuroImage 39:423–435

    PubMed  Google Scholar 

  • Bhatara A, Quintin EM, Levy B, Bellugi U, Fombonne E, Levitin DJ (2010) Perception of emotion in musical performance in adolescents with autism spectrum disorders. Autism Research 3(5):214–225

    PubMed  Google Scholar 

  • Blusewicz MJ, Dustman RE, Schenkenberg T, Beck EC (1977) Neuropsychological correlates of chronic alcoholism and aging. Journal of Nervous and Mental Disorders 165:348–355

    CAS  Google Scholar 

  • Brooks PJ (2000) Brain atrophy and neuronal loss in alcoholism: A role for DNA damage? Neurochemistry International 37:403–412

    PubMed  CAS  Google Scholar 

  • Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS (1999) Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport 10:2619–2623

    PubMed  CAS  Google Scholar 

  • Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of auditory visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14:427–438

    PubMed  CAS  Google Scholar 

  • Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends in Cognitive Sciences 11:535–543

    PubMed  Google Scholar 

  • Campanella S, Bruyer R, Froidbise S, Rossignol M, Joassin F, Kornreich C et al (2010) Is two better than one? A cross-modal oddball paradigm reveals greater sensitivity of the P300 to emotional face–voice associations. Clinical Neurophysiology 121:1855–1862

    PubMed  Google Scholar 

  • Campanella S, Philippot P (2006) Insights from ERPs into emotional disorders: An affective neuroscience perspective. Psychologica Belgica 46:37–53

    Google Scholar 

  • Carton JS, Kessler EA, Pape CL (1999) Nonverbal decoding skills and relationship wellbeing in adults. Journal of Nonverbal Behavior 23:91–100

    Google Scholar 

  • Chanraud S, Martelli C, Delain F, Kostogianni N, Douaud G, Aubin HJ et al (2007) Brain morphometry and cognitive performance in detoxified alcoholdependents with preserved psychosocial functioning. Neuropsychopharmacology 32:429–438

    PubMed  Google Scholar 

  • Clark US, Oscar-Berman M, Shagrin B, Pencina M (2007) Alcoholism and judgments of affective stimuli. Neuropsychology 21:346–362

    PubMed  Google Scholar 

  • Cohn M, Moscovitch M, Davidson PS (2010) Double dissociation between familiarity and recollection in Parkinson’s disease as a function of encoding tasks. Neuropsychologia 48(14):4142–4417

    PubMed  Google Scholar 

  • Cordovil de Susa Uva M, de Timary P, Cortesi M, Mikolajczak M, Du Roy de Blicquy P, Luminet O (2010) Moderating effect of emotional intelligence on the role of negative affect in the motivation to drink in alcohol-dependent subjects. Personality and Individual Differences 48:16–21

    Google Scholar 

  • Cowen MS, Chen F, Lawrence AJ (2004) Neuropeptides: Implications for alcoholism. Journal of Neurochemistry 89:273–285

    PubMed  CAS  Google Scholar 

  • Davis MH (1983) Measuring individual differences in empathy: Evidence from a multidimensional approach. Journal of Personality and Social Psychology 44:113–126

    Google Scholar 

  • De Bellis MD, Narasimhan A, Thatcher DL, Keshavan MS, Soloff P, Clark DB (2005) Prefrontal cortex, thalamus, and cerebellar volumes in adolescents and young adults with adolescent-onset alcohol use disorders and comorbid mental disorders. Alcoholism, Clinical and Experimental Research 29:1590–1600

    PubMed  Google Scholar 

  • De Gelder B, Vroomen J, de Jong SJ, Masthoff ED, Trompenaars FJ, Hodiamont P (2005) Multisensory integration of emotional faces and voices in schizophrenics. Schizophrenia Research 72(2–3):195–203

    PubMed  Google Scholar 

  • De Jong JJ, Hodiamont PP, Van den Stock J, de Gelder B (2009) Audiovisual emotion recognition in schizophrenia: Reduced integration of facial and vocal affect. Schizophrenia Research 107(2–3):286–293

    PubMed  Google Scholar 

  • DiClemente CC, Jordan L, Marinilli AS, Nidecker M (2003) Psychotherapy in alcoholism treatment. In: Johnson BA, Ruiz P, Galanter M (eds) Handbook of clinical alcoholism treatment. Lippincott, Williams, & Wilkins, Baltimore, MD, pp 102–110

    Google Scholar 

  • Driver J, Spence C (2000) Multisensory perception: Beyond modularity and convergence. Current Biology 10:731–735

    Google Scholar 

  • Ellis HD, Jones DM, Mosdell N (1997) Intra- and inter-modal repetition priming of familiar faces and voices. British Journal of Psychology 88:143–156

    PubMed  Google Scholar 

  • Enoch MA (2006) Genetic and environmental influences on the development of alcoholism: Resilience vs risk. Annals of the New York Academy of Sciences 1094:193–201

    PubMed  Google Scholar 

  • Ethofer T, Pourtois G, Wildgruber D (2006) Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research 156:345–361

    PubMed  Google Scholar 

  • Fein G, Bachman L, Fischer S, Davenport L (1990) Cognitive impairments in abstinent alcoholics. West Journal of Medicine 152:531–537

    CAS  Google Scholar 

  • Fein G, Landman B, Tran H, McGillivray S, Finn P, Barakos J et al (2006) Brain atrophy in long-term abstinent alcoholics who demonstrate impairment on a simulated gambling task. NeuroImage 32:1465–1471

    PubMed  Google Scholar 

  • Feldman RS, Philippot P, Custrini RJ (1991) Social competence and non-verbal behaviour. In: Feldman RS (ed) Fundamentals of non-verbal behavior. Cambridge University Press, New York, pp 329–350

    Google Scholar 

  • Flannery B, Fishbein D, Krupitsky E, Langevin D, Verbitskaya E, Bland C et al (2007) Gender differences in neurocognitive functioning among alcohol-dependent Russian patients. Alcoholism, Clinical and Experimental Research 31:745–754

    PubMed  Google Scholar 

  • Foisy, M.L. (2005). La reconnaissance des expressions faciales émotionnelles dans l’alcoolisme: Spécification de la nature et de l’origine des biais évaluatifs. Unpublished PhD Thesis, Catholic University of Louvain, Louvain-la-Neuve, Belgique.

    Google Scholar 

  • Foisy ML, Kornreich C, Fobe A, D’Hondt L, Pelc I, Hanak C et al (2007a) Impaired emotional facial expression recognition in alcohol dependence: Do these deficits persist with midterm abstinence? Alcoholism, Clinical and Experimental Research 31:404–410

    PubMed  Google Scholar 

  • Foisy ML, Kornreich C, Petiau C, Parez A, Hanak C, Verbanck P et al (2007b) Impaired emotional facial expression recognition in alcoholics: Are these deficits specific to emotional cues? Psychiatry Research 150:33–41

    PubMed  Google Scholar 

  • Frens MA, Van Opstal AJ, Van der Willigen RF (1995) Spatial and temporal factors determine auditory–visual interactions in human saccadic eye movements. Perception & Psychophysics 57:802–816

    CAS  Google Scholar 

  • Frigerio E, Burt DM, Montagne B, Murray LK, Perrett DI (2002) Facial affect perception in alcoholics. Psychiatry Research 113:161–171

    PubMed  Google Scholar 

  • Friston KJ, Frith CD (1995) Schizophrenia: A disconnection syndrome? Clinical Neuroscience 3(2):89–97

    PubMed  CAS  Google Scholar 

  • Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multi-sensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 25(20):5004–5012

    PubMed  CAS  Google Scholar 

  • Giancola PR (2002) Alcohol-related aggression during the college years: Theories, risk factors and policy implications. Journal of Studies on Alcohol 14:129–139

    Google Scholar 

  • Goebel R, van Atteveldt N (2009) Multisensory functional magnetic resonance imaging: A future perspective. Experimental Brain Research 198:153–164

    Google Scholar 

  • Gottfried JA, Dolan RJ (2003) The nose smells what the eye sees: Crossmodal visual facilitation of human olfactory perception. Neuron 39:375–386

    PubMed  CAS  Google Scholar 

  • Greimel E, Macht M, Krumhuber E, Ellgring H (2006) Facial and affective reactions to tastes and their modulation by sadness and joy. Physiology and Behavior 89:261–269

    PubMed  CAS  Google Scholar 

  • Hanley JR, Smith ST, Hadfield J (1998) I recognise you but I can’t place you: An investigation of familiar-only experiences during tests of voice and face recognition. Quarterly Journal of Experimental Psychology 51:179–195

    Google Scholar 

  • Hanley JR, Turner JM (2000) Why are familiar-only experiences more frequent for voices than for faces? Quarterly Journal of Experimental Psychology 53:1105–1116

    PubMed  CAS  Google Scholar 

  • Hansenne M (2006) Event-related brain potentials in psychopathology: Clinical and cognitive perspectives. Psychologica Belgica 46:5–36

    Google Scholar 

  • Harper C (2007) The neurotoxicity of alcohol. Human and Experimental Toxicology 26:251–257

    PubMed  CAS  Google Scholar 

  • Harper C, Matsumoto I (2005) Ethanol and brain damage. Current Opinion in Pharmacology 5:73–78

    PubMed  CAS  Google Scholar 

  • Heinz A, Wrase J, Kahnt T, Beck A, Bromand Z, Grüsser SM et al (2007) Brain activation elicited by affectively positive stimuli is associated with a lower risk of relapse in detoxified alcoholic subjects. Alcoholism, Clinical and Experimental Research 31:1138–1147

    PubMed  Google Scholar 

  • Hutcherson CA, Gross JJ (2011) The moral emotions: A social-functionalist account of anger, disgust, and contempt. Journal of Personality and Social Psychology 100(4):719–737

    PubMed  Google Scholar 

  • Joassin F, Maurage P, Bruyer R, Crommelinck M, Campanella S (2004) When audition alters vision: An eventrelated potential study of the cross-modal interactions between faces and voices. Neuroscience Letters 369(2):132–137

    PubMed  CAS  Google Scholar 

  • Joassin F, Maurage P, Campanella S (2011a) The neural network sustaining the crossmodal processing of human gender from faces and voices: An fMRI study. NeuroImage 54(2):1654–1661

    PubMed  Google Scholar 

  • Joassin F, Pesenti M, Maurage P, Verreckt E, Bruyer R, Campanella S (2011b) Cross-modal interactions between human faces and voices involved in person recognition. Cortex 47(3):367–376

    PubMed  Google Scholar 

  • Kareken DA, Claus ED, Sabri M, Dzemidzic M, Kosobud AEK, Radnovich AJ et al (2004) Alcohol-related olfactory cues activate the nucleus accumbens and the ventrotemental area in high-risk drinkers: Preliminary findings. Alcoholism, Clinical and Experimental Research 28(4):550–557

    PubMed  Google Scholar 

  • Karno MP, Longabaugh R (2005) An examination of how therapist directiveness interacts with patient anger and reactance to predict alcohol use. Journal of Studies on Alcohol 66:825–832

    PubMed  Google Scholar 

  • Kathmann N, Soyka M, Bickel R, Engel RR (1996) ERP changes in alcoholics with and without alcohol psychosis. Biological Psychiatry 39:873–881

    PubMed  CAS  Google Scholar 

  • Kornreich C, Blairy S, Philippot P, Dan B, Foisy ML, Hess U et al (2001) Impaired emotional facial expression recognition in alcoholism compared with obsessive–compulsive disorder and normal controls. Psychiatry Research 102:235–248

    PubMed  CAS  Google Scholar 

  • Kornreich C, Philippot P, Foisy ML, Blairy S, Raynaud E, Dan B et al (2002) Impaired emotional facial expression recognition is associated with interpersonal problems in alcoholism. Alcohol and Alcoholism 37:394–400

    PubMed  Google Scholar 

  • Kramer JH, Blusewicz MJ, Robertson LC, Preston K (1989) Effects of chronic alcoholism on perception of hierarchical visual stimuli. Alcoholism, Clinical and Experimental Research 13:240–245

    PubMed  CAS  Google Scholar 

  • Kreifelts B, Ethofer T, Grodd W, Erb M, Wildgruber D (2007) Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage 37(4):1445–1456

    PubMed  Google Scholar 

  • Kril JJ, Halliday GM, Svoboda MD, Cartwright H (1997) The cerebral cortex is damaged in chronic alcoholics. Neuroscience 79:983–998

    PubMed  CAS  Google Scholar 

  • Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Frontiers in Integrative Neuroscience 4(129):1–11

    Google Scholar 

  • Latinus M, VanRullen R, Taylor M (2010) Top-down and bottom-up modulation in processing bimodal face/voice stimuli. BMC Neuroscience 11:36

    PubMed  Google Scholar 

  • Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Experimental Brain Research 166:289–297

    Google Scholar 

  • Leppänen JM, Hietanen JK (2003) Affect and face perception: Odors modulate the recognition advantage of happy faces. Emotion 3:315–326

    PubMed  Google Scholar 

  • Lieberman DZ (2000) Children of alcoholics: An update. Current Opinions in Pediatry 12(4):336–340

    CAS  Google Scholar 

  • Listerud J, Powers C, Moore P, Libon DJ, Grossman M (2009) Neuropsychological patterns in magnetic resonance imaging-defined subgroups of patients with degenerative dementia. Journal of International Neuropsychological Society 15(3):459–470

    Google Scholar 

  • Little HJ, Stephens DN, Ripley TL, Borlikova G, Duka T, Schubert M et al (2005) Alcohol withdrawal and conditioning. Alcohol, Clinical and Experimental Research 29(3):453–464

    Google Scholar 

  • Love S, Pollick FE, Latinus M (2011) Cerebral correlates and statistical criteria of cross-modal face and voice integration. Seeing and Perceiving 24(4):351–367

    PubMed  Google Scholar 

  • Marinkovic K, Oscar-Berman M, Urban T, O’Reilly CE, Howard JA, Sawyer K et al (2009) Alcoholism and dampened temporal limbic activation to emotional faces. Alcoholism, Clinical and Experimental Research 33:1880–1892

    PubMed  Google Scholar 

  • Martinotti G, Di Nicola M, Tedeschi D, Cundari S, Janiri L (2009) Empathy ability is impaired in alcohol-dependent patients. The American Journal on Addictions 18(2):157–161

    PubMed  Google Scholar 

  • Massida, Z., Belin, P., James, C., Rouger, J., Fraysse, B., Barone, P., et al. (2010). Voice discrimination in cochlear-implanted deaf subjects. Hear Research, in press.

    Google Scholar 

  • Maurage, P., Callot, C., Rombaux, P., Philippot, P., & de Timary, P. Olfactory impairment is correlated with confabulation in alcoholism: Towards a multimodal testing of orbitofrontal cortex. Submitted a.

    Google Scholar 

  • Maurage, P., Callot, C., Rombaux, P., Philippot, P., & de Timary, P. Chemosensory event related potentials in alcoholism: A specific impairment for olfactory function. Submitted b.

    Google Scholar 

  • Maurage, P., Joassin, F., Pesenti, M., Speth, A., Modave, J., Philippot, P., et al. Cerebral effects of binge drinking: Respective influences of global alcohol intake and consumption pattern. Submitted c.

    Google Scholar 

  • Maurage P, Campanella C, Philippot P, Charest I, Martin S, de Timary P (2009a) Impaired emotional facial expression decoding in alcoholism is also present for emotional prosody and body postures. Alcohol and Alcoholism 44(5):476–485

    PubMed  Google Scholar 

  • Maurage P, Campanella S, Philippot P, Martin S, de Timary P (2008a) Face processing in chronic alcoholism: A specific deficit for emotional features. Alcoholism, Clinical and Experimental Research 32(4):600–606

    PubMed  CAS  Google Scholar 

  • Maurage P, Campanella S, Philippot P, Pham T, Joassin F (2007a) The crossmodal facilitation effect is disrupted in alcoholism: A study with emotional stimuli. Alcohol and Alcoholism 42(6):552–559

    PubMed  CAS  Google Scholar 

  • Maurage P, Campanella S, Philippot P, Vermeulen N, Constant E, Luminet O et al (2008b) Electrophysiological correlates of the disrupted processing of anger in alcoholism. International Journal of Psychophysiology 70(1):50–62

    PubMed  Google Scholar 

  • Maurage, P., Grynberg, D., Noël, X., Joassin, F., Hanak, C., Verbanck, P., et al. The “Reading the Mind in the Eyes” test as a new way to explore complex emotions decoding in alcoholism. Psychiatry Research, in press a.

    Google Scholar 

  • Maurage, P., Grynberg, D., Noël, X., Joassin, F., Philippot, P., Hanak, C., et al. Dissociation between affective and cognitive empathy in alcoholism: A specific deficit for the emotional dimension. Alcoholism, Clinical and Experimental Research, in press b.

    Google Scholar 

  • Maurage, P., Joassin, F., & de Timary, P. The cross-modal processing of emotional face voice pairs is seriously impaired in alcoholdependence: An fMRI study. In Preparation.

    Google Scholar 

  • Maurage P, Joassin F, Philippot P, Campanella S (2007b) A validated battery of vocal emotional expressions. Neuropsychological Trends 2:63–74

    Google Scholar 

  • Maurage P, Pesenti M, Philippot P, Joassin F, Campanella S (2009b) Latent deleterious effects of binge drinking over a short period of time revealed by electrophysiological measures only. Journal of Psychiatry & Neuroscience 34(2):111–118

    Google Scholar 

  • Maurage P, Philippot P, Joassin F, Pauwels L, Alonso Prieto E, Palmero Soler E et al (2008c) The auditory–visual integration of anger is impaired in alcoholism: An ERP study. Journal of Psychiatry & Neuroscience 33(2):111–122

    Google Scholar 

  • Maurage P, Philippot P, Verbanck P, Noel X, Kornreich C, Hanak C et al (2007c) Is the P300 deficit in alcoholism associated with early visual impairments (P100, N170)? An oddball paradigm. Clinical Neurophysiology 118(3):633–644

    PubMed  CAS  Google Scholar 

  • McCarty CA, Ebel BE, Garrison MM, DiGiuseppe DL, Christakis DA, Rivara FP (2004) Continuity of binge and harmful drinking from late adolescence to early adulthood. Pediatrics 114(3):714–719

    PubMed  Google Scholar 

  • McGurk H, McDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748

    PubMed  CAS  Google Scholar 

  • McIntosh C, Chick J (2004) Alcohol and the nervous system. Journal of Neurology, Neurosurgery, and Psychiatry 75:16–21

    Google Scholar 

  • Mejias S, Rossignol M, Debatisse D, Streel E, Servais L, Guérit JM et al (2005) Event-related potentials (ERPs) in ecstasy (MDMA) users during a visual oddball task. Biological Psychology 69(3):333–352

    PubMed  CAS  Google Scholar 

  • Melillo R, Leisman G (2009) Autistic spectrum disorders as functional disconnection syndrome. Reviews in Neuroscience 20(2):111–131

    Google Scholar 

  • Mendlewicz L, Linkowski P, Bazelmans C, Philippot P (2005) Decoding emotional facial expressions in depressed and anorexic patients. Journal of Affective Disorders 89(1–3):195–199

    PubMed  Google Scholar 

  • Monnot M, Lovallo WR, Nixon SJ, Ross E (2002) Neurological basis of deficits in affective prosody comprehension among alcoholics and fetal alcohol-exposed adults. The Journal of Neuropsychiatry and Clinical Neurosciences 14:321–328

    PubMed  CAS  Google Scholar 

  • Monnot M, Nixon S, Lovallo W, Ross E (2001) Altered emotional perception in alcoholics: Deficits in affective prosody comprehension. Alcoholism, Clinical and Experimental Research 25:362–369

    PubMed  CAS  Google Scholar 

  • Montagne B, Kessels RP, Wester AJ, de Haan EH (2006) Processing of emotional facial expressions in Korsakoff’s syndrome. Cortex 42:705–710

    PubMed  Google Scholar 

  • Noël X, Van der Linden M, Schmidt N, Sferrazza R, Hanak C, Le Bon O et al (2001) Supervisory attentional system in nonamnesic alcoholic men. Archives of General Psychiatry 58:1152–1158

    PubMed  Google Scholar 

  • Ogura C, Miyazato Y (1991) Cognitive dysfunctions of alcohol dependence using event related potentials. Arukoru KenkyutoYakubutsu Ison 26:331–340

    CAS  Google Scholar 

  • Oscar-Berman M, Hancock M, Mildworf B, Hutner N, Weber DA (1990) Emotional perception and memory in alcoholism and aging. Alcoholism, Clinical and Experimental Research 14:383–393

    PubMed  CAS  Google Scholar 

  • Oscar-Berman M, Kirkley SM, Gansler DA, Couture A (2004) Comparisons of Korsakoff and non-Korsakoff alcoholics on neuropsychological tests of prefrontal brain functioning. Alcoholism, Clinical and Experimental Research 28:667–675

    PubMed  Google Scholar 

  • Oscar-Berman M, Marinkovic K (2003) Alcoholism and the brain: An overview. Alcohol Research & Health 27:125–133

    Google Scholar 

  • Pearl D, Yodashkin-Porat D, Katz N, Valevski A, Aizenberg D, Sigler M et al (2009) Differences in audiovisual integration, as measured by McGurk phenomenon, among adult and adolescent patients with schizophrenia and age-matched healthy control groups. Comprehensive Psychiatry 50(2):186–192

    PubMed  Google Scholar 

  • Petrini K, Crabbe F, Sheridan C, Pollick FE (2011) The music of your emotions: Neural substrates involved in detection of emotional correspondence between auditory and visual music actions. PLoS One 6(4)

    Google Scholar 

  • Petrini K, McAleer P, Pollick FE (2010) Audiovisual integration of emotional signals from music improvisation does not depend on temporal correspondence. Brain Research 1323:139–148

    PubMed  CAS  Google Scholar 

  • Philippot P, Kornreich C, Blairy S, Baerts I, Den Dulk A, Le Bon O et al (1999) Alcoholics’ deficits in the decoding of emotional facial expression. Alcoholism, Clinical and Experimental Research 23:1031–1038

    PubMed  CAS  Google Scholar 

  • Philippot, P., & Power, M. (2010) FaceTales. http://www.ipsp.ucl.ac.be/recherche/projets/FaceTales/en/Home.htm.

  • Pitel AL, Beaunieux H, Witkowski T, Vabret F, Guillery-Girard B, Quinette P et al (2007) Genuine episodic memory deficits and executive dysfunctions in alcoholic subjects early in abstinence. Alcoholism, Clinical and Experimental Research 31:1169–1178

    PubMed  Google Scholar 

  • Polich J (2004) Clinical application of the P300 event-related brain potential. Physical Medicine and Rehabilitation Clinics of North America 15:133–161

    PubMed  Google Scholar 

  • Porjesz B, Rangaswamy M, Kamarajan C, Jones KA, Padmanabhapillai A, Begleiter H (2005) The utility of neurophysiological markers in the study of alcoholism. Clinical Neurophysiology 116(5):993–1018

    PubMed  Google Scholar 

  • Rämä P, Courtney SM (2005) Functional topography of working memory for face or voice identity. NeuroImage 24:224–234

    PubMed  Google Scholar 

  • Riley H, Schutte NS (2003) Low emotional intelligence as a predictor of substance-use problems. Journal of Drug Education 33:391–398

    PubMed  Google Scholar 

  • Rossignol M, Philippot P, Douilliez C, Crommelinck M, Campanella S (2005) The perception of fearful and happy facial expression is modulated by anxiety: An event-related potential study. Neuroscience Letters 377(2):115–120

    PubMed  CAS  Google Scholar 

  • Rupp CI (2010) Olfactory function and schizophrenia: An update. Current Opinion in Psychiatry 23:97–102

    PubMed  Google Scholar 

  • Rupp CI, Fleischhacker W, Drexler A, Hausmann A, Hinterhuber H, Kurz M (2006) Executive function and memory in relation to olfactory deficits in alcohol-dependent patients. Alcoholism, Clinical and Experimental Research 30:1355–1362

    PubMed  Google Scholar 

  • Rupp CI, Fleischhacker W, Hausmann H, Mair D, Hinterhubern H, Kurz M (2004) Olfactory functioning in patients with alcohol dependence: Impairments in odor judgments. Alcohol and Alcoholism 39:514–519

    PubMed  Google Scholar 

  • Rupp CI, Kurz M, Kemmler G, Mair D, Hausmann A, Hinterhuber H et al (2003) Reduced olfactory sensitivity, discrimination, and identification in patients with alcohol dependence. Alcoholism, Clinical and Experimental Research 27:432–439

    PubMed  Google Scholar 

  • Salloum JB, Ramchandani VA, Bodurka J, Rawlings R, Momenan R, George D et al (2007) Blunted rostral anterior cingulate response during a simplified decoding task of negative emotional facial expressions in alcoholic patients. Alcoholism, Clinical and Experimental Research 31:1490–1504

    PubMed  Google Scholar 

  • Schiffman M (1997) Taste and smell losses in normal aging and disease. Journal of the American Medical Association 278:1357–1362

    PubMed  CAS  Google Scholar 

  • Schulte T, Mũller-Oehring EM, Pfefferbaum A, Sullivan EV (2010) Neurocircuitry of emotion and cognition in alcoholism: Contributions from white matter fiber tractography. Dialogues in Clinical Neuroscience 12(4):554–560

    PubMed  Google Scholar 

  • Schweinberger SR, Herholz A, Sommer W (1997) Recognizing famous voices: Influence of stimulus duration and different types of retrieval cues. Journal of Speech, Language, and Hearing Research 40:453–463

    PubMed  CAS  Google Scholar 

  • Seubert J, Kellermann T, Loughead J, Boers F, Brensinger C, Schneider F et al (2010a) Processing of disgusted faces is facilitated by odor primes: A functional MRI study. NeuroImage 53(2):746–756

    PubMed  Google Scholar 

  • Seubert J, Loughead J, Kellermann T, Boers F, Brensinger CM, Habel U (2010b) Multisensory integration of emotionally valenced olfactory–visual information in patients with schizophrenia and healthy controls. Journal of Psychiatry & Neuroscience 35(3):185–194

    Google Scholar 

  • Shepherd GM (2006) Smell images and the flavour system in the human brain. Nature 444:316–321

    PubMed  CAS  Google Scholar 

  • Small DA (2004) Crossmodal integration – insights from the chemical senses. Trends in Neuroscience 27:123–124

    Google Scholar 

  • Smith ME, Oscar-Berman M (1992) Resource-limited information processing in alcoholism. Journal of Studies on Alcohol 53:514–518

    PubMed  CAS  Google Scholar 

  • Spitzer JB (1981) Auditory effects of chronic alcoholism. Drug and Alcohol Dependence 8:317–335

    PubMed  CAS  Google Scholar 

  • Spitzer JB, Ventry IM (1980) Central auditory dysfunction among chronic alcoholics. Archives of Otolaryngology 106:224–229

    PubMed  CAS  Google Scholar 

  • Sullivan EV, Mathalon DH, Zipursky RB, Kersteen-Tucker Z, Knight RT, Pfefferbaum A (1993) Factors of the Wisconsin Card Sorting Test as measures of frontal lobe function in schizophrenia and in chronic alcoholism. Psychiatry Research 46:175–199

    PubMed  CAS  Google Scholar 

  • Szabo Z, Owonikoko T, Peyrot M, Varga J, Mathews WB, Ravert HT et al (2004) Positron emission tomography imaging of the serotonin transporter in subjects with a history of alcoholism. Biological Psychiatry 55:766–771

    PubMed  CAS  Google Scholar 

  • Szczepanska L, Baran J, Mikolaszek-Boba M (2004) Connection between personality and emotional intelligence in groups of patients after suicidal attempts and ethanol dependent persons. Przeglev Lekvi 61:287–291

    Google Scholar 

  • Szycik GR, Münte TF, Dillo W, Mohammadi B, Samii A, Emrich HM et al (2009) Audiovisual integration of speech is disturbed in schizophrenia: An fMRI study. Schizophrenia Research 110(1–3):111–118

    PubMed  CAS  Google Scholar 

  • Taieb O, Corcos M, Loas G, Speranza M, Guilbaud O, Perez-Diaz F et al (2002) Alexithymia and alcohol dependence. Annales de Médecine Interne 153:51–60

    Google Scholar 

  • Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audiovisual crossmodal integration by means of event-related potentials (ERP) recordings. Cognitive Brain Research 14:106–114

    PubMed  Google Scholar 

  • Townshend JM, Duka T (2003) Mixed emotions: Alcoholics’ impairments in the recognition of specific emotional facial expressions. Neuropsychologia 41:773–782

    PubMed  CAS  Google Scholar 

  • Townshend JM, Duka T (2005) Binge drinking, cognitive performance and mood in a population of young social drinkers. Alcoholism, Clinical and Experimental Research 29:317–325

    PubMed  Google Scholar 

  • Turetsky BI, Hahn CG, Borgmann-Winter K, Moberg PJ (2009) Scents and nonsense: Olfactory dysfunction in schizophrenia. Schizophrenia Bulletin 35:1117–1131

    PubMed  Google Scholar 

  • Uekermann J, Channon S, Winkel K, Schlebusch P, Daum I (2007) Theory of mind, humour processing and executive functioning in alcoholism. Addiction 102:232–240

    PubMed  CAS  Google Scholar 

  • Uekermann J, Daum I (2008) Social cognition in alcoholism: A link to prefrontal cortex dysfunction? Addiction 103(5):726–735

    PubMed  Google Scholar 

  • Uekermann J, Daum I, Schlebusch P, Trenckmann U (2005) Processing of affective stimuli in alcoholism. Cortex 41:189–194

    PubMed  Google Scholar 

  • Uzun O, Ats A, Cansever A, Ozsahin A (2003) Alexithymia in male alcoholics: Study in a Turkish sample. Comprehensive Psychiatry 44:349–352

    PubMed  Google Scholar 

  • Van der Stelt O, Gunning WB, Snel J, Zeef E, Kok A (1994) Children of alcoholics: Attention, information processing and event-related brain potentials. Acta Paediatrica 404(4):6

    Google Scholar 

  • Vatakis A, Spence C (2006) Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task. Neuroscience Letters 393(1):40–44

    PubMed  CAS  Google Scholar 

  • Wagner U, N’diaye K, Ethofer T, Vuilleumier P (2011) Guilt-specific processing in the prefrontal cortex. Cerebral Cortex 21(11):2461–2470

    PubMed  Google Scholar 

  • Winston JS, Gottfried JA, Kilner JM, Dolan RJ (2005) Integrated neural representations of odor intensity and affective valence in human amygdala. Journal of Neuroscience 25:8903–8907

    PubMed  CAS  Google Scholar 

  • Zeigler DW, Wang CC, Yoast RA, Dickinson BD, McCaffree MA, Robinowitz CB et al (2005) The neurocognitive effects of alcohol on adolescents and college students. Preventive Medicine 40:23–32

    PubMed  CAS  Google Scholar 

  • Zupan B, Sussman JE (2009) Auditory preferences of young children with and without hearing loss for meaningful auditory–visual compound stimuli. Journal of Communication Disorders 42(6):381–396

    PubMed  Google Scholar 

Download references

Acknowledgments

Pierre Maurage is Senior Research Assistant at the National Fund for Scientific Research (F.N.R.S., Belgium). This work was supported by grants from the French Ministry of Research.

Author information

Authors and Affiliations

  1. Neuroscience, Systems and Cognition (NEUROCS), and Health and Psychological Development (CSDP) Research Units, Institute of Psychology, Catholic University of Louvain, Place du Cardinal Mercier, 10, B-1348, Louvain-la-Neuve, Belgium

    Pierre Maurage

  2. Department of Psychological and Brain Sciences, Indiana University, Bloomington, Indiana, USA

    Scott Love

  3. Lille Nord de France University, Lille, France

    Fabien D’Hondt

  4. Functional Neurosciences and Pathology Lab, UDSL, Lille, France

    Fabien D’Hondt

Authors
  1. Pierre Maurage
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Scott Love
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabien D’Hondt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pierre Maurage .

Editor information

Editors and Affiliations

  1. Dept. Psychology, Voice Neurocognition Lab., University of Glasgow, Glasgow, Glasgow, G12 8QB, United Kingdom

    Pascal Belin

  2. Brugmann University Hospital, Brussels, B-1020, Belgium

    Salvatore Campanella

  3. University of Tubingen, Tubingen, 72074, Germany

    Thomas Ethofer

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Maurage, P., Love, S., D’Hondt, F. (2013). Crossmodal Integration of Emotional Stimuli in Alcohol Dependence. In: Belin, P., Campanella, S., Ethofer, T. (eds) Integrating Face and Voice in Person Perception. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3585-3_14

Download citation

Publish with us

Policies and ethics

Search

Navigation