Skip to main content

Neural Representation of Faces in Human Visual Cortex: the Roles of Attention, Emotion, and Viewpoint

  • Chapter

Abstract

Faces constitute a special class of visual stimuli not only because we possess expert visual skills and specialized brain areas to recognize them, but also because we can extract a rich set of socially and affectively important information from them in a seemingly effortless manner. Abundant research conducted in cognitive psychology, neuroscience, and clinical neuropsychology has provided an elaborate model of the complex functional architecture underlying these different aspects of face processing, each presumably associated with specific neural substrates that are interconnected all together within a large-scale distributed network (Grüsser and Landis 1991). Thus, many influential neurocognitive models have proposed that face recognition may proceed along a series of distinct stages organized in a hierarchical stream of processing (Bruce and Young 1986; Haxby et al. 2000), from low-level visual analysis subserving the detection and organization of facial features, up to higher-level processes allowing the storage and retrieval of personal information and other associative functions (Fig. 1a). Furthermore, some dissociations in recognition performance in healthy subjects, as well as neuropsychological deficits observed in patients with focal brain lesions, have led to the idea that different processing pathways might be responsible for extracting identity-related information versus other facial features related to emotional expression, eye gaze direction, or speech lip motion, and that such pathways might operate in parallel (Bruce and Young 1986; Grüsser and Landis 1991).

Traditional cognitive model of face processing derived from Bruce and Young (1986), in which identity and expression are processed along pathways of separate serial stages.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adolphs R, Gosselin F, Buchanan TW, Tranel D, Schyns P, Damasio AR (2005) A mechanism for impaired fear recognition after amygdala damage. Nature 433:68–72

    Article  PubMed  CAS  Google Scholar 

  • Amaral DG, Behniea H, Kelly JL (2003) Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience 118:1099–1120

    Article  PubMed  CAS  Google Scholar 

  • Bentley P, Vuilleumier P, Thiel CM, Driver J, Dolan RJ (2003) Cholinergic enhancement modulates neural correlates of selective attention and emotional processing. Neuroimage 20:58–70

    Article  PubMed  Google Scholar 

  • Biederman I, Bar M (2000) Differing views on views: response to Hayward and Tarr (2000). Vision Res 40:3901–3905

    Article  PubMed  CAS  Google Scholar 

  • Biederman I, Kalocsai P (1997) Neurocomputational bases of object and face recognition. Philos Trans R Soc Lond B Biol Sci 352:1203–1219

    Article  PubMed  CAS  Google Scholar 

  • Bruce V (1982) Changing faces: visual and non-visual coding processes in face recognition. Br J Psychol 73:105–116

    PubMed  CAS  Google Scholar 

  • Bruce V, Young AW (1986) Understanding face recognition. Br J Psychol 77:305–327

    PubMed  Google Scholar 

  • Calder AJ, Young AW, Keane J, Dean M (2000) Configural information in facial expression. J Exp Psychol Hum Percept Perform 26:527–551

    Article  PubMed  CAS  Google Scholar 

  • Damasio AR, Tranel D, Damasio H (1990) Face agnosia and the neural substrates of memory. Ann Rev Neurosci 13:89–109

    Article  PubMed  CAS  Google Scholar 

  • Eastwood JD, Smilek D, Merikle PM (2001) Differential attentional guidance by unattended faces expressing positive and negative emotion. Percept Psychophys 63:1004–1013

    PubMed  CAS  Google Scholar 

  • Eger E, Schyns PG, Kleinschmidt A (2004) Scale invariant adaptation in fusiform faceresponsive regions. Neuroimage 22:232–242

    Article  PubMed  Google Scholar 

  • Fox E (2002) Processing of emotional facial expressions: the role of anxiety and awareness. Cogn Affect Behav Neurosci 2:52–63

    Article  PubMed  Google Scholar 

  • Fox E, Lester V, Russo R, Bowles RJ, Pichler A, Dutton K (2000) Facial expressions of emotion: are angry faces detected more efficiently? Cogn Emot 14:61–92

    Article  PubMed  Google Scholar 

  • Gauthier I, Tarr MJ, Moylan J, Skudlarski P, Gore JC, Anderson AW (2000) The fusiform “face area” is part of a network that processes faces at the individual level. J Cogn Neurosci 12:495–50

    Article  PubMed  CAS  Google Scholar 

  • George N, Dolan RJ, Fink GR, Baylis GC, Russell C, Driver J (1999) Contrast polarity and face recognition in the human fusiform gyrus. Nat Neurosci 2:574–580

    Article  PubMed  CAS  Google Scholar 

  • Gobbini MI, Haxby JV (2007) Neural systems for recognition of familiar faces Neuropsychologia 45(1):32–41

    Article  PubMed  Google Scholar 

  • Grandjean D, Sander D, Pourtois G, Schwartz S, Seghier ML, Scherer KR, Vuilleumier P (2005) The voices of wrath: brain responses to angry prosody in meaningless speech. Nat Neurosci 8:145–146

    Article  PubMed  CAS  Google Scholar 

  • Grill-Spector K, Malach R (2001) fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychol (Amst) 107:293–321

    Article  CAS  Google Scholar 

  • Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, Malach R (1999) Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24:187–203

    Article  PubMed  CAS  Google Scholar 

  • Grill-Spector K, Knouf N, Kanwisher N (2004) The fusiform face area subserves face perception, not generic within-category identification. Nat Neurosci 7:555–562

    Article  PubMed  CAS  Google Scholar 

  • Grüsser OJ, Landis T (1991) Visual agnosia and other disturbances of visual perception and cognition. In: Cronly-Dillon J (Ed) Vision and visual dysfunction, Vol. 12. MacMillan, London, pp 218–239

    Google Scholar 

  • Hasselmo ME, Rolls ET, Baylis GC (1989) The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav Brain Res 32:203–218

    Article  PubMed  CAS  Google Scholar 

  • Haxby JV, Horwitz B, Ungerleider LG, Maisog JM, Pietrini P, Grady CL (1994) The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J Neurosci 14:6336–6353

    PubMed  CAS  Google Scholar 

  • Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Neurosci 4:223–232

    Article  Google Scholar 

  • Henson R, Shallice T, Dolan R (2000) Neuroimaging evidence for dissociable forms of repetition priming. Science 287:1269–1272

    Article  PubMed  CAS  Google Scholar 

  • Henson RN, Shallice T, Gorno-Tempini ML, Dolan RJ (2002) Face repetition effects in implicit and explicit memory tests as measured by fMRI. Cereb Cortex 12:178–186

    Article  PubMed  CAS  Google Scholar 

  • Huettel SA, McCarthy G (2001) Regional differences in the refractory period of the hemodynamic response: an event-related fMRI study. Neuroimage 14:967–976

    Article  PubMed  CAS  Google Scholar 

  • Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–4311

    PubMed  CAS  Google Scholar 

  • Lane RD, Chua PM-L, Dolan RJ (1999) Common effects of emotional valence, arousal, and attention on neural activation during visual processing of pictures. Neuropsychologia 37:989–997

    Article  PubMed  CAS  Google Scholar 

  • LeDoux JE (2000) Emotion circuits in the brain. Annu Rev Neurosci 23:155–184

    Article  PubMed  CAS  Google Scholar 

  • McCarthy G, Puce A, Gore J, Allison T (1997) Face-specific processing in the human fusiform gyrus. J Cogn Neurosci 9:605–610

    Article  Google Scholar 

  • Merigan WH, Maunsell JH (1993) How parallel are the primate visual pathways? Annu Rev Neurosci 16:369–402

    Article  PubMed  CAS  Google Scholar 

  • Mogg K, Bradley BP, Hallowell N (1994) Attentional bias to threat: roles of trait anxiety, stressful events, and awareness. Q J Exp Psychol A 47:841–864

    PubMed  CAS  Google Scholar 

  • Morris J, Friston KJ, Buchel C, Frith CD, Young AW, Calder AJ, Dolan RJ (1998a) A neuromodulatory role for the human amygdala in processing emotional facial expressions. Brain 121:47–57

    Article  PubMed  Google Scholar 

  • Morris JS, Ohman A, Dolan RJ (1998b) Conscious and unconscious emotional learning in the human amygdala. Nature 393:470–474

    Article  Google Scholar 

  • Morris JS, Öhman A, Dolan RJ (1999) A subcortical pathway to the right amygdala mediating “unseen” fear. Proc Natl Acad Sci USA 96:1680–168

    Article  PubMed  CAS  Google Scholar 

  • Morris J, DeGelder B, Weiskrantz L, Dolan RJ (2001) Differential extrageniculostriate and amygdala responses to presentation of emotional faces in a cortically blind field. Brain 124:1241–1252

    Article  PubMed  CAS  Google Scholar 

  • Morris JS, deBonis M, Dolan RJ (2002) Human amygdala responses to fearful eyes. Neuroimage 17:214–222

    Article  PubMed  CAS  Google Scholar 

  • Mourao-Miranda J, Volchan E, Moll J, de Oliveira-Souza R, Oliveira L, Bramati I, Gattass R, Pessoa L (2003) Contributions of stimulus valence and arousal to visual activation during emotional perception. Neuroimage 20:1955–1963

    Article  PubMed  CAS  Google Scholar 

  • Naccache L, Dehaene S (2001) The priming method: imaging unconscious repetition priming reveals an abstract representation of number in the parietal lobes. Cereb Cortex 11:966–974

    Article  PubMed  CAS  Google Scholar 

  • Pasley BN, Mayes LC, Schultz RT (2004) Subcortical discrimination of unperceived objects during binocular rivalry. Neuron 42:163–172

    Article  PubMed  CAS  Google Scholar 

  • Pegna AJ, Khateb A, Lazeyras F, Seghier ML (2005) Discriminating emotional faces without primary visual cortices involves the right amygdala. Nat Neurosci 8:24–25

    Article  PubMed  CAS  Google Scholar 

  • Pessoa L (2005) To what extent are emotional visual stimuli processed without attention and awareness? Curr Opin Neurobiol 15:188–196

    Article  PubMed  CAS  Google Scholar 

  • Pessoa L, Kastner S, Ungerleider LG (2002a) Attentional control of the processing of neural and emotional stimuli. Brain Res Cogn Brain Res 15:31–45

    Article  PubMed  Google Scholar 

  • Pessoa L, McKenna M, Gutierrez E, Ungerleider LG (2002b) Neural processing of emotional faces requires attention. Proc Natl Acad Sci USA 99:11458–11463

    Article  PubMed  CAS  Google Scholar 

  • Pourtois G, Grandjean D, Sander D, Vuilleumier P (2004) Electrophysiological correlates of rapid spatial orienting towards fearful faces. Cereb Cortex 14:619–633

    Article  PubMed  Google Scholar 

  • Pourtois G, Dan ES, Grandjean D, Sander D, Vuilleumier P (2005a) Enhanced extrastriate visual response to bandpass spatial frequency filtered fearful faces: time course and topographic evoked-potentials mapping. Hum Brain Mapp 6:65–79

    Article  Google Scholar 

  • Pourtois G, Schwartz S, Seghier ML, Lazeyras F, Vuilleumier P (2005b) Portraits or people? View-sensitive and view-invariant memories of face identity in the human visual cortex. J Cogn Neurosci 17:1043–1057

    Article  PubMed  Google Scholar 

  • Pourtois G, Schwartz S, Seghier ML, Lazeyras F, Vuilleumier P (2005c) View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study. Neuroimage 24:1214–1224

    Article  PubMed  Google Scholar 

  • Rhodes G (1985) Lateralized processes in face recognition. Br J Psychol 76:249–271

    PubMed  Google Scholar 

  • Sabatinelli D, Bradley MM, Fitzsimmons JR, Lang PJ (2005) Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance. Neuroimage 24:1265–1270

    Article  PubMed  Google Scholar 

  • Sahraie A, Weiskrantz L, Trevethan CT, Cruce R, Murray AD (2002) Psychophysical and pupillometric study of spatial channels of visual processing in blindsight. Exp Brain Res 143:249–256

    Article  PubMed  CAS  Google Scholar 

  • Schyns PG, Oliva A (1999) Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations. Cognition 69:243–265

    Article  PubMed  CAS  Google Scholar 

  • Sergent J, Ohta S, Macdonald B (1992) Functional neuroanatomy of face and object processing: a positron emission tomography study. Brain 155:15–36

    Article  Google Scholar 

  • Sugase Y, Yamane S, Ueno S, Kawano K (1999) Global and fine information coded by single neurons in the temporal visual cortex. Nature 400:869–873

    Article  PubMed  CAS  Google Scholar 

  • Surguladze SA, Brammer MJ, Young AW, Andrew C, Travis MJ, Williams SC, Phillips ML (2003) A preferential increase in the extrastriate response to signals of danger. Neuroimage 19:1317–1328

    Article  PubMed  Google Scholar 

  • Tarr MJ, Bulthoff HH (1998) Image-based object recognition in man, monkey and machine. Cognition 67:1–20

    Article  PubMed  CAS  Google Scholar 

  • Vuilleumier P (2005) How brains beware: neural systems for emotional attention. Trends Cogn Sci 9(12):585–594

    Article  PubMed  Google Scholar 

  • Vuilleumier P, Schwartz S (2001a) Beware and be aware: capture of attention by fearrelevant stimuli in patients with unilateral neglect. Neuroreport 12:1119–1122

    Article  PubMed  CAS  Google Scholar 

  • Vuilleumier P, Schwartz S (2001b) Emotional facial expressions capture attention. Neurology 56:153–158

    PubMed  CAS  Google Scholar 

  • Vuilleumier P, Armony JL, Driver J, Dolan RJ (2001) Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron 30:829–841

    Article  PubMed  CAS  Google Scholar 

  • Vuilleumier P, Henson R, Driver J, Dolan RJ (2002) Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming. Nat Neurosci 5:491–499

    Article  PubMed  CAS  Google Scholar 

  • Vuilleumier P, Armony JL, Driver J, Dolan RJ (2003a) Distinct spatial frequency sensitivities for processing faces and emotional expressions. Nat Neurosci 6:624–631

    Article  PubMed  CAS  Google Scholar 

  • Vuilleumier P, Mohr C, Wenzel C, Valenza N, Landis T (2003b) Hyperfamiliarity for unknown faces after left lateral temporo-occipital venous infarction: a double dissociation with prosopagnosia. Brain 126:889–907

    Article  PubMed  Google Scholar 

  • Vuilleumier P, Richardson M, Armony J, Driver J, Dolan RJ (2004) Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat Neurosci 7:1271–1278

    Article  PubMed  CAS  Google Scholar 

  • Whalen PJ, Rauch SL, Etcoff NL, McInerney SC, Lee MB, Jenike MA (1998) Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J Neurosci 18:480–487

    Google Scholar 

  • Whalen PJ, Kagan J, Cook RG, Davis FC, Kim H, Polis S, McLaren DG, Somerville LH, McLean AA, Maxwell JS, Johnstone T (2004) Human amygdala responsivity to masked fearful eye whites. Science 306:2061

    Article  PubMed  CAS  Google Scholar 

  • Williams MA, Morris AP, McGlone F, Abbott DF, Mattingley JB (2004) Amygdala responses to fearful and happy facial expressions under conditions of binocular suppression. J Neurosci 24:2898–2904

    Article  PubMed  CAS  Google Scholar 

  • Winston JS, Vuilleumier P, Dolan RJ (2003) Effects of low-spatial frequency components of fearful faces on fusiform cortex activity. Curr Biol 13:1824–1829

    Article  PubMed  CAS  Google Scholar 

  • Wojciulik E, Kanwisher N, Driver J (1998) Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. J Neurophysiol 79:1574–1578

    PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer

About this chapter

Cite this chapter

Vuilleumier, P. (2007). Neural Representation of Faces in Human Visual Cortex: the Roles of Attention, Emotion, and Viewpoint. In: Osaka, N., Rentschler, I., Biederman, I. (eds) Object Recognition, Attention, and Action. Springer, Tokyo. https://doi.org/10.1007/978-4-431-73019-4_9

Download citation

Publish with us

Policies and ethics