Skip to main content
SpringerLink
Log in

Integration of Face and Voice During Emotion Perception: Is There Anything Gained for the Perceptual System Beyond Stimulus Modality Redundancy?

  • Chapter
  • First Online:
Integrating Face and Voice in Person Perception

Abstract

In this chapter, we review empirical data and theoretical models which have been put forward in the affective science literature to account for the perception of emotions, when this process is simultaneously accomplished by sight and hearing. The visual component is provided by the face configuration that undergoes some geometric changes, which in turn lead to different and discrete emotion facial expressions. The auditory component is provided by the voice and its changes in pitch, duration, and/or intensity leading to different affective tones of voice. Face–voice integration during emotion perception occurs when affective information conveyed by the two sensory modalities is integrated into a unified percept, or multisensory object. Although one may assume that the rapid and mandatory combination of multiple or complementary affective cues is adaptive (i.e., it likely reduces the effects of adverse factors like drifts or intrinsic noise), the central nervous system must however show some selectivity regarding which inputs from separate senses may eventually combine, as compared with merely redundant emotion signals. Indeed, not all spatial or temporal coincidences or co-occurrences lead to the perception of unified objects. Interestingly, results of behavioral studies confirm this conjecture, and indicate that the combination of emotional facial expressions with affective prosody leads to the creation of genuinely multisensory emotional objects, which show different properties compared to the combination of an emotional facial expression with another redundant or distracting emotional facial expression, or an emotion written word. Hence, the findings and models reviewed in this chapter suggest that some selectivity can be found in the way visual and auditory information is actually combined during emotion perception. The rapid and automatic pairing of an emotional face with an affective voice might present a naturalistic situation in the sense that there is no need for mediation by higher-level cognitive, attentional or linguistic processes, which may be necessary for the efficient decoding of other stimulus categories or multisensory objects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adolphs, R., Gosselin, F., Buchanan, T. W., Tranel, D., Schyns, P., & Damasio, A. R. (2005). A mechanism for impaired fear recognition after amygdala damage. Nature, 433(7021), 68–72.

    PubMed  CAS  Google Scholar 

  • Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636.

    PubMed  CAS  Google Scholar 

  • Beale, J. M., & Keil, F. C. (1995). Categorical effects in the perception of faces. Cognition, 57(3), 217–239.

    PubMed  CAS  Google Scholar 

  • Bermant, R. I., & Welch, R. B. (1976). Effect of degree of separation of visual-auditory stimulus and eye position upon spatial interaction of vision and audition. Perceptual and Motor Skills, 43(2), 487–493.

    Google Scholar 

  • Bertelson, P. (1999). Ventriloquism: A case of crossmodal perceptual grouping. In G. Aschersleben, T. Bachman, & J. Musseler (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 347–369). Amsterdam: Elsevier Science.

    Google Scholar 

  • Bocanegra, B. R., & Zeelenberg, R. (2009a). Dissociating emotion-induced blindness and hypervision. Emotion, 9(6), 865–873.

    PubMed  Google Scholar 

  • Bocanegra, B. R., & Zeelenberg, R. (2009b). Emotion improves and impairs early vision. Psychological Science, 20(6), 707–713.

    PubMed  Google Scholar 

  • Borod, J. C., Cicero, B. A., Obler, L. K., Welkowitz, J., Erhan, H. M., Santschi, C., et al. (1998). Right hemisphere emotional perception: Evidence across multiple channels. Neuropsychology, 12(3), 446–458.

    PubMed  CAS  Google Scholar 

  • Borod, J. C., Pick, L. H., Hall, S., Sliwinski, M., Madigan, N., Obler, L. K., et al. (2000). Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition & Emotion, 14(2), 193–211.

    Google Scholar 

  • Brosch, T., Pourtois, G., & Sander, D. (2010). The perception and categorisation of emotional stimuli: A review. Cognition & Emotion, 24(3), 377–400.

    Google Scholar 

  • Burnham, D. (1999). Perceiving talking faces: From speech perception to a behavioral principle. Trends in Cognitive Sciences, 3, 487–488. reviewed by D. Burnham.

    Google Scholar 

  • Calder, A. J., Lawrence, A. D., & Young, A. W. (2001). Neuropsychology of fear and loathing. Nature reviews, 2(5), 352–363.

    PubMed  CAS  Google Scholar 

  • Calvert, G. A. (2001). Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex, 11(12), 1110–1123.

    PubMed  CAS  Google Scholar 

  • Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., & David, A. S. (1999). Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport, 10(12), 2619–2623.

    PubMed  CAS  Google Scholar 

  • Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276(5312), 593–596.

    PubMed  CAS  Google Scholar 

  • Calvert, G. A., Spence, C., & Stein, B. E. (2004). The handbook of multisensory processes. Cambridge: MIT Press.

    Google Scholar 

  • Campanella, S., & Belin, P. (2007). Integrating face and voice in person perception. Trends in Cognitive Sciences, 11(12), 535–543.

    Google Scholar 

  • Campbell, R., Dodd, B., & Burnham, D. (1998). Hearing by eye II: Advances in the psychology of speechreading and audio-visual speech. Hove, UK: Psychology Press.

    Google Scholar 

  • Cummings, K. E., & Clements, M. A. (1995). Analysis of the glottal excitation of emotionally styled and stressed speech. The Journal of the Acoustical Society of America, 98, 88–98.

    PubMed  CAS  Google Scholar 

  • Damasio, A. R. (1989). Time-locked multiregional retroactivation: A system-level proposal for the neural substrates of recall and recognition. Cognition, 33, 25–62.

    PubMed  CAS  Google Scholar 

  • Damasio, A. R. (1994). Descartes’ error: Emotion, reason and the human brain. New York: Putman Books.

    Google Scholar 

  • Darwin, C. (1871). The descent of man. London: John Murray.

    Google Scholar 

  • Darwin, C. (1872). The expression of emotions in man and animals. London: John Murray.

    Google Scholar 

  • de Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature reviews, 7(3), 242–249.

    PubMed  Google Scholar 

  • De Gelder, B., & Bertelson, P. (2003). Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences, 7(10), 460–467.

    PubMed  Google Scholar 

  • de Gelder, B., Pourtois, G., van Raamsdonk, M., Vroomen, J., & Weiskrantz, L. (2001). Unseen stimuli modulate conscious visual experience: Evidence from inter-hemispheric summation. Neuroreport, 12(2), 385–391.

    PubMed  Google Scholar 

  • de Gelder, B., Pourtois, G., Vroomen, J., & Bachoud-Levi, A. C. (2000). Covert processing of faces in prosopagnosia is restricted to facial expressions: Evidence from cross-modal bias. Brain and Cognition, 44(3), 425–444.

    PubMed  Google Scholar 

  • de Gelder, B., Pourtois, G., & Weiskrantz, L. (2002). Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proceedings of the National Academy of Sciences of the United States of America, 99(6), 4121–4126.

    PubMed  Google Scholar 

  • De Gelder, B., & Vroomen, J. (2000). Perceiving emotions by ear and by eye. Cognition & Emotion, 14(289–311).

    Google Scholar 

  • De Gelder, B., Vroomen, J., & Bertelson, P. (1998). Upright but not inverted faces modify the perception of emotion in the voice. Current Psychology of Cognition, 17, 1021–1031.

    Google Scholar 

  • de Gelder, B., Vroomen, J., & Pourtois, G. (1999). Seeing cries and hearing smiles. Crossmodal perception of emotional expressions. In G. Aschersleben, T. Bachmann, & J. MĂĽsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 425–438). Amsterdam: Elsevier.

    Google Scholar 

  • de Gelder, B., Vroomen, J., & Pourtois, G. (2004). Multisensory perception of emotion, its time course, and its neural basis. In G. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 581–597). Cambridge, MA: MIT Press.

    Google Scholar 

  • deGelder, B., Teunisse, J. P., & Benson, P. J. (1997). Categorical perception of facial expressions: Categories and their internal structure. Cognition & Emotion, 11(1), 1–23.

    Google Scholar 

  • Dodd, B., & Campbell, R. (1987). Hearing by eye: The psychology of lip-reading. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381(6577), 66–68.

    PubMed  CAS  Google Scholar 

  • Driver, J., & Spence, C. (1998a). Cross-modal links in spatial attention. Philosophical Transactions of the Royal Society of London, 353(1373), 1319–1331.

    PubMed  CAS  Google Scholar 

  • Driver, J., & Spence, C. (1998b). Crossmodal attention. Current Opinion in Neurobiology, 8(2), 245–253.

    PubMed  CAS  Google Scholar 

  • Driver, J., & Spence, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10(20), R731–R735.

    PubMed  CAS  Google Scholar 

  • Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion, 6, 169–200.

    Google Scholar 

  • Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo-Alto: Consulting Psychologists Press.

    Google Scholar 

  • Etcoff, N. L., & Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44(3), 227–240.

    PubMed  CAS  Google Scholar 

  • Ethofer, T., Pourtois, G., & Wildgruber, D. (2006). Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research, 156, 345–361.

    PubMed  Google Scholar 

  • Farah, M. J., Wong, A. B., Monheit, M. A., & Morrow, L. A. (1989). Parietal lobe mechanisms of spatial attention – Modality-specific or supramodal. Neuropsychologia, 27(4), 461–470.

    PubMed  CAS  Google Scholar 

  • Fodor, J. (1983). The modularity of mind. Cambridge, MA: MIT Press.

    Google Scholar 

  • Foxe, J. J., & Molholm, S. (2009). Ten years at the multisensory forum: Musings on the evolution of a field. Brain Topography, 21(3–4), 149–154.

    PubMed  Google Scholar 

  • Frick, R. W. (1985). Communicating emotion – The role of prosodic features. Psychological Bulletin, 97(3), 412–429.

    Google Scholar 

  • Frijda, N. (1989). The emotions. Cambridge: Cambridge University Press.

    Google Scholar 

  • Fuster, J. M., Bodner, M., & Kroger, J. K. (2000). Cross-modal and cross-temporal association in neurons of frontal cortex. Nature, 405(6784), 347–351.

    PubMed  CAS  Google Scholar 

  • Giard, M. H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11(5), 473–490.

    PubMed  CAS  Google Scholar 

  • Haith, M. M., Bergman, T., & Moore, M. J. (1977). Eye contact and face scanning in early infancy. Science, 198, 853–855.

    PubMed  CAS  Google Scholar 

  • Hay, J. C., Pick, H. L., & Ikeda, K. (1965). Visual capture produced by prism spectacles. Psychonomic Science, 2(8), 215–216.

    Google Scholar 

  • Held, R. (1965). Plasticity in sensory-motor systems. Scientific American, 213, 84–94.

    PubMed  CAS  Google Scholar 

  • Kahneman, D. (1973). Attention and effort. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology. Human Perception and Performance, 21(3), 451–468.

    PubMed  CAS  Google Scholar 

  • Lavie, N. (2005). Distracted and confused?: Selective attention under load. Trends in Cognitive Sciences, 9(2), 75–82.

    PubMed  Google Scholar 

  • Lehmann, S., & Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination. Brain Research, 24(2), 326–334.

    PubMed  Google Scholar 

  • Lewkowicz, D. J. (2000). The development of intersensory temporal perception: An epigenetic systems/limitations view. Psychological Bulletin, 126(2), 281–308.

    PubMed  CAS  Google Scholar 

  • Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. (1957). The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54(5), 358–368.

    PubMed  CAS  Google Scholar 

  • Lieberman, P., & Michaels, S. B. (1962). Some aspects of fundamental frequency and envelope amplitude as related to emotional content of speech. The Journal of the Acoustical Society of America, 34, 922–927.

    Google Scholar 

  • Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289(5482), 1206–1208.

    PubMed  CAS  Google Scholar 

  • MacLeod, C. M. (1991). Half a century of research on the Stroop effect: An integrative review. Psychological Bulletin, 109, 163–203.

    PubMed  CAS  Google Scholar 

  • Marois, R., & Ivanoff, J. (2005). Capacity limits of information processing in the brain. Trends in Cognitive Sciences, 9(6), 296–305.

    PubMed  Google Scholar 

  • Marzi, C. A., Tassinari, G., Aglioti, S., & Lutzemberger, L. (1986). Spatial summation across the vertical meridian in hemianopics: A test of blindsight. Neuropsychologia, 24(6), 749–758.

    PubMed  CAS  Google Scholar 

  • Massaro, D. W. (1987). Speech perception by ear and by eye: A paradigm for psychological inquiry. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge: MIT Press.

    Google Scholar 

  • Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 3, 215–221.

    Google Scholar 

  • Mcgurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746–748.

    PubMed  CAS  Google Scholar 

  • Mckelvie, S. J. (1995). Emotional expression in upside-down faces – Evidence for configurational and componential processing. The British Journal of Social Psychology, 34, 325–334.

    PubMed  Google Scholar 

  • Mesulam, M. M. (1998). From sensation to cognition. Brain, 121, 1013–1052.

    PubMed  Google Scholar 

  • Miller, J. (1982). Divided attention – Evidence for co-activation with redundant signals. Cognitive Psychology, 14(2), 247–279.

    PubMed  CAS  Google Scholar 

  • Miller, J. (1986). Timecourse of coactivation in bimodal divided attention. Perception & Psychophysics, 40(5), 331–343.

    CAS  Google Scholar 

  • Miniussi, C., Girelli, M., & Marzi, C. A. (1998). Neural site of the redundant target effect electrophysiological evidence. Journal of Cognitive Neuroscience, 10(2), 216–230.

    PubMed  CAS  Google Scholar 

  • Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research, 14(1), 115–128.

    PubMed  Google Scholar 

  • Moors, A., & De Houwer, J. (2006). Automaticity: A theoretical and conceptual analysis. Psychological Bulletin, 132, 297–326.

    PubMed  Google Scholar 

  • Morris, J. S., Scott, S. K., & Dolan, R. J. (1999). Saying it with feeling: Neural responses to emotional vocalizations. Neuropsychologia, 37(10), 1155–1163.

    PubMed  CAS  Google Scholar 

  • Murray, I. R., & Arnott, J. L. (1993). Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion. The Journal of the Acoustical Society of America, 93, 1097–1108.

    PubMed  CAS  Google Scholar 

  • Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2001). Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: A high-density electrical mapping study. Neuropsychologia, 39(8), 828–844.

    PubMed  CAS  Google Scholar 

  • Osullivan, M., Ekman, P., Friesen, W., & Scherer, K. (1985). What you say and how you say it – The contribution of speech content and voice quality to judgments of others. Journal of Personality and Social Psychology, 48(1), 54–62.

    CAS  Google Scholar 

  • Panksepp, J. (2005). Psychology. Beyond a joke: From animal laughter to human joy? Science, 308(5718), 62–63.

    PubMed  CAS  Google Scholar 

  • Pashler, H. (1994). Dual-task interference in simple tasks: Data and theory. Psychological Bulletin, 116(2), 220–244.

    PubMed  CAS  Google Scholar 

  • Phelps, E. A., Ling, S., & Carrasco, M. (2006). Emotion facilitates perception and potentiates the perceptual benefits of attention. Psychological Science, 17(4), 292–299.

    PubMed  Google Scholar 

  • Pourtois, G., & de Gelder, B. (2002). Semantic factors influence multisensory pairing: A transcranial magnetic stimulation study. Neuroreport, 13(12), 1567–1573.

    PubMed  Google Scholar 

  • Pourtois, G., de Gelder, B., Bol, A., & Crommelinck, M. (2005). Perception of facial expressions and voices and of their combination in the human brain. Cortex; a journal devoted to the study of the nervous system and behavior, 41(1), 49–59.

    PubMed  Google Scholar 

  • Pourtois, G., de Gelder, B., Vroomen, J., Rossion, B., & Crommelinck, M. (2000). The time-course of intermodal binding between seeing and hearing affective information. Neuroreport, 11(6), 1329–1333.

    PubMed  CAS  Google Scholar 

  • Pourtois, G., Debatisse, D., Despland, P. A., & de Gelder, B. (2002). Facial expressions modulate the time course of long latency auditory brain potentials. Brain Research, 14(1), 99–105.

    PubMed  Google Scholar 

  • Pourtois, G., Grandjean, D., Sander, D., & Vuilleumier, P. (2004). Electrophysiological correlates of rapid spatial orienting towards fearful faces. Cerebral Cortex, 14(6), 619–633.

    PubMed  Google Scholar 

  • Raab, D. H. (1962). Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences, 24, 574–590.

    PubMed  CAS  Google Scholar 

  • Sander, D., Grafman, J., & Zalla, T. (2003). The human amygdala: An evolved system for relevance detection. Reviews in the Neurosciences, 14(4), 303–316.

    PubMed  Google Scholar 

  • Savazzi, S., & Marzi, C. A. (2002). Speeding up reaction time with invisible stimuli. Current Biology, 12(5), 403–407.

    PubMed  CAS  Google Scholar 

  • Savazzi, S., & Marzi, C. A. (2004). The superior colliculus subserves interhemispheric neural summation in both normals and patients with a total section or agenesis of the corpus callosum. Neuropsychologia, 42(12), 1608–1618.

    PubMed  Google Scholar 

  • Savazzi, S., & Marzi, C. A. (2008). Does the redundant signal effect occur at an early visual stage? Experimental brain research. Experimentelle Hirnforschung. ExpĂ©rimentation cĂ©rĂ©brale, 184(2), 275–281.

    PubMed  Google Scholar 

  • Scherer, K. (1989). Vocal measurement of emotion. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research, and experience (Vol. 4, pp. 233–259). San Diego, CA: Academic.

    Google Scholar 

  • Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology, 32(1), 76–92.

    Google Scholar 

  • Schneider, W., & Shiffrin, R. M. (1977). Controlled and automatic human information-processing. 1. Detection, search, and attention. Psychological Review, 84(1), 1–66.

    Google Scholar 

  • Scott, S. K., Young, A. W., Calder, A. J., Hellawell, D. J., Aggleton, J. P., & Johnson, M. (1997). Impaired auditory recognition of fear and anger following bilateral amygdala lesions. Nature, 385(6613), 254–257.

    PubMed  CAS  Google Scholar 

  • Sekuler, R., Sekuler, A. B., & Lau, R. (1997). Sound alters visual motion perception. Nature, 385(6614), 308.

    PubMed  CAS  Google Scholar 

  • Shams, L., Kamitani, Y., & Shimojo, S. (2000). Illusions. What you see is what you hear. Nature, 408(6814), 788.

    PubMed  CAS  Google Scholar 

  • Smith, M. L., Cottrell, G. W., Gosselin, F., & Schyns, P. G. (2005). Transmitting and decoding facial expressions. Psychological Science, 16(3), 184–189.

    PubMed  Google Scholar 

  • Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge: Bradford Books.

    Google Scholar 

  • Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14(9), 400–410.

    PubMed  Google Scholar 

  • Tanaka, J. W., & Farah, M. J. (1993). Parts and wholes in face recognition. The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology, 46(2), 225–245.

    PubMed  CAS  Google Scholar 

  • Turatto, M., Mazza, V., Savazzi, S., & Marzi, C. A. (2004). The role of the magnocellular and parvocellular systems in the redundant target effect. Experimental brain research. Experimentelle Hirnforschung. ExpĂ©rimentation cĂ©rĂ©brale, 158(2), 141–150.

    PubMed  Google Scholar 

  • Vroomen, J., Collier, R., & Mozziconacci, S. (1993). Duration and intonation in emotional speech. Proceedings of the Third European Conference on Speech Communication and Technology, Berlin, (pp. 577–580).

    Google Scholar 

  • Vroomen, J., Driver, J., & de Gelder, B. (2001). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 1(4), 382–387.

    CAS  Google Scholar 

  • Vuilleumier, P. (2005). How brains beware: Neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585–594.

    PubMed  Google Scholar 

  • Vuilleumier, P., & Pourtois, G. (2007). Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging. Neuropsychologia, 45(1), 174–194.

    PubMed  Google Scholar 

  • Walker, A., & Grolnick, W. (1983). Discrimination of vocal expressions by young infants. Infant Behavior & Development, 6, 491–498.

    Google Scholar 

  • Walker-Andrews, A. S. (1997). Infants’ Perception of expressive behaviors: Differentiation of multimodal information. Psychological Bulletin, 121, 437–456.

    PubMed  CAS  Google Scholar 

  • Weiskrantz, L. (1986). Blindsight. A case study and implications. Oxford: Oxford University Press.

    Google Scholar 

  • Williams, C. E., & Stevens, K. N. (1972). Emotions and speech – Some acoustical correlates. The Journal of the Acoustical Society of America, 52(4), 1238–1250.

    PubMed  CAS  Google Scholar 

Download references

Acknowledgments

Writing and elaboration of this chapter was made possible thanks to the financial support provided by the European Research Council (Starting Grant #200758) and Ghent University (BOF Grant #05Z01708) to G.P. The behavioral results presented in this chapter were already partly introduced and discussed in the unpublished thesis manuscript written up and submitted by Gilles Pourtois (Tilburg University, April 2002).

Author information

Authors and Affiliations

  1. Department of Experimental-Clinical and Health Psychology, Ghent University, Henri Dunantlaan 2, 9000, Ghent, Belgium

    Gilles Pourtois & Monica Dhar

Authors
  1. Gilles Pourtois
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Monica Dhar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gilles Pourtois .

Editor information

Editors and Affiliations

  1. Dept. Psychology, Voice Neurocognition Lab., University of Glasgow, Glasgow, Glasgow, G12 8QB, United Kingdom

    Pascal Belin

  2. Brugmann University Hospital, Brussels, B-1020, Belgium

    Salvatore Campanella

  3. University of Tubingen, Tubingen, 72074, Germany

    Thomas Ethofer

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Pourtois, G., Dhar, M. (2013). Integration of Face and Voice During Emotion Perception: Is There Anything Gained for the Perceptual System Beyond Stimulus Modality Redundancy?. In: Belin, P., Campanella, S., Ethofer, T. (eds) Integrating Face and Voice in Person Perception. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3585-3_10

Download citation

Publish with us

Policies and ethics

Search

Navigation