Spatial and feature-based attention to expressive faces

  • Kestutis KveragaEmail author
  • David De Vito
  • Cody Cushing
  • Hee Yeon Im
  • Daniel N. Albohn
  • Reginald B. AdamsJr.
Research Article


Facial emotion is an important cue for deciding whether an individual is potentially helpful or harmful. However, facial expressions are inherently ambiguous and observers typically employ other cues to categorize emotion expressed on the face, such as race, sex, and context. Here, we explored the effect of increasing or reducing different types of uncertainty associated with a facial expression that is to be categorized. On each trial, observers responded according to the emotion and location of a peripherally presented face stimulus and were provided with either: (1) no information about the upcoming face; (2) its location; (3) its expressed emotion; or (4) both its location and emotion. While cueing emotion or location resulted in faster response times than cueing unpredictive information, cueing face emotion alone resulted in faster responses than cueing face location alone. Moreover, cueing both stimulus location and emotion resulted in a superadditive reduction of response times compared with cueing location or emotion alone, suggesting that feature-based attention to emotion and spatially selective attention interact to facilitate perception of face stimuli. While categorization of facial expressions was significantly affected by stable identity cues (sex and race) in the face, we found that these interactions were eliminated when uncertainty about facial expression, but not spatial uncertainty about stimulus location, was reduced by predictive cueing. This demonstrates that feature-based attention to facial expression greatly attenuates the need to rely on stable identity cues to interpret facial emotion.


Threat perception Anger Happiness Facial identity 



Funding for this research was provided by R01 MH101194 to K.K. and R.B.A.

Compliance with ethical standards

Conflict of interest

The authors declare no conflict of interest.


  1. Adams RB, Kleck RE (2003) Perceived Gaze direction and the processing of facial displays of emotion. Psychol Sci. Google Scholar
  2. Adams RB Jr, Hess U, Kleck RE (2015) The intersection of gender-related facial appearance and facial displays of emotion. Emot Rev 7:5–13CrossRefGoogle Scholar
  3. Adams RB Jr, Kveraga K (2015) Social vision: functional forecasting and the integration of compound threat cues. Rev Philos Psychol 6(4):591–610. CrossRefGoogle Scholar
  4. Adams RB Jr, Albohn DN, Kveraga K (2017) Social vision: applying a social-functional approach to face and expression perception. Curr Dir Psychol Sci 26(3):243–248CrossRefGoogle Scholar
  5. Adolphs R, Jansari A, Tranel D (2001) Hemispheric perception of emotional valence from facial expressions. Neuropsychology 15(4):516–524CrossRefGoogle Scholar
  6. Aviezer H, Ensenberg N, Hassin R (2017) The inherently contextualized nature of facial emotion perception. Curr Opin Psychol 17:47–54CrossRefGoogle Scholar
  7. Barrett L, Bliss-Moreau E (2009) Affect as a psychological primitive. Adv Exp Soc Psychol 41:167–218Google Scholar
  8. Becker DV, Srinivasan N (2014) The vividness of the happy face. Curr Dir Psychol Sci 23(3):189–194CrossRefGoogle Scholar
  9. Becker DV, Kenrick DT, Neuberg SL, Blackwell KC, Smith DM (2007) The confounded nature of angry men and happy women. J Pers Soc Psychol 92(2):179–190CrossRefGoogle Scholar
  10. Becker DV, Mortensen CR, Ackerman JM, Shapiro JR, Anderson US, Sasaki T, Maner JK, Neuberg SL, Kenrick DT (2011) Signal detection on the battlefield: priming self-protection vs. revenge-mindedness differentially modulates the detection of enemies and allies. PLoS One 6(9):e23929. CrossRefGoogle Scholar
  11. Beraha E, Eggers J, Hindi Attar C, Gutwinski S, Schlagenhauf F, Stoy M, Bermpohl F (2012) Hemispheric asymmetry for affective stimulus processing in healthy subjects—a fmri study. PLoS One 7(10):1–9CrossRefGoogle Scholar
  12. Berryhill M, Kveraga K, Boucher L, Hughes HC (2004) Smooth pursuit under stimulus-response uncertainty. Cogn Brain Res. Google Scholar
  13. Berryhill ME, Kveraga K, Hughes HC (2005) Effects of directional uncertainty on visually-guided joystick pointing. Percept Mot Skills 100:267–274CrossRefGoogle Scholar
  14. Billings L, Harrison L, Alden J (1993) Age differences among women in the functional asymmetry for bias in facial affect perception. Bull Psychon Soc 31(4):317–320CrossRefGoogle Scholar
  15. Borod JC, Cicero BA, Obler LK, Welkowitz J, Erhan HM, Santschi C, Agosti RM (1998) Right hemisphere emotional perception: evidence across multiple channels. Neuropsychology 12(3):446–458CrossRefGoogle Scholar
  16. Calvo M, Nummenmaa L (2016) Perceptual and affective mechanisms in facial expression recognition: an integrative review. Cogn Emot 30(6):1081–1106CrossRefGoogle Scholar
  17. Carpinella C, Chen J, Hamilton D, Johnson KL (2015) Gendered facial cues influence race categorizations. Pers Soc Psychol Bull 41(3):405–419CrossRefGoogle Scholar
  18. Cottrell CA, Neuberg SL (2005) Different emotional reactions to different groups: a sociofunctional threat-based approach to “prejudice”. J Pers Soc Psychol 88:770–789CrossRefGoogle Scholar
  19. Davidson RJ (1992) Anterior cerebral asymmetry and the nature of emotion. Brain Cogn 20:125–151CrossRefGoogle Scholar
  20. Davidson RJ (1995) Cerebral asymmetry, emotion, and affective style. J Clin Exp Neuropsy, vol 12Google Scholar
  21. Davidson RJ, Irwin W (1999) The functional neuroanatomy of emotion and affective style. Trends Cogn Sci 3:11–21CrossRefGoogle Scholar
  22. Deruelle C, Fagot J (1997) Hemispheric lateralisation and global precedence effects in the processing of visual stimuli by humans and baboons (Papio papio). Laterality 2:233–246Google Scholar
  23. Goff P, Thomas M, Jackson M (2008) “Ain’t I a woman?”: towards an intersectional approach to person perception and group-based harms. Sex Roles 59(5–6):392–403CrossRefGoogle Scholar
  24. Hassin R, Aviezer H, Bentin S (2013) Inherently ambiguous: facial expressions of emotions, in context. Emot Rev 5(1):60–65CrossRefGoogle Scholar
  25. Hess U, Adams RB Jr, Kleck RE (2004) Dominance, gender and emotion expression. Emotion 4:378–388CrossRefGoogle Scholar
  26. Hick WE (1952) On the rate of gain of information. Q J Exp Psychol 4(1):11–26CrossRefGoogle Scholar
  27. Hugenberg K (2005) Social categorization and the perception of facial affect: target race moderates the response latency advantage for happy faces. Emotion 5(3):267–276CrossRefGoogle Scholar
  28. Im HY, Cushing CA, Albohn DN, Steiner TG, Adams RB Jr, Kveraga K (2017a) Differential hemispheric and visual stream contributions to ensemble coding of crowd emotion. Nature Hum Behav 1:828–842. CrossRefGoogle Scholar
  29. Im HY, Chong SC, Sun J, Steiner TG, Albohn DN, Adams RB Jr, Kveraga K (2017b) Cross-cultural and hemispheric laterality effects on the ensemble coding of emotion in facial crowds. Cult Brain. Google Scholar
  30. Jansari A, Tranel D, Adolphs R (2000) A valence-specific lateral bias for discriminating emotional facial expressions in free field. Cogn Emot 14(3):341–353. CrossRefGoogle Scholar
  31. Johnson K, Freeman J, Pauker K (2012) Race is gendered: How covarying phenotypes and stereotypes bias sex categorization. J Pers Soc Psychol 102(1):116–131CrossRefGoogle Scholar
  32. Kastner S, Ungerleider LG (2000) Mechanisms of visual attention in the human cortex. Annu Rev Neurosci 23:315–341CrossRefGoogle Scholar
  33. Kloft L, Reuter B, Viswanathan J, Kathmann N, Barton JJS (2012) Response selection in prosaccades, antisaccades, and other volitional saccades. Exp Brain Res. Google Scholar
  34. Konorski J (1967) Integrative activity of the brain: an interdisciplinary approach. University of Chicago Press, ChicagoGoogle Scholar
  35. Kveraga K, Hughes HC (2005) Effects of stimulus-response uncertainty on saccades to near-threshold targets. Exp Brain Res. Google Scholar
  36. Kveraga K, Boucher L, Hughes HC (2002) Saccades operate in violation of Hick’s Law. Exp Brain Res 146(3):307–314CrossRefGoogle Scholar
  37. Kveraga K, Berryhill M, Hughes HC (2006) Directional uncertainty in visually guided pointing. Percept Motor Skills 102(1):125–132CrossRefGoogle Scholar
  38. Kveraga K, Ghuman AS, Bar M (2007) Top-down predictions in the cognitive brain. Brain Cogn 65(2):145–168CrossRefGoogle Scholar
  39. Kveraga K, Boshyan J, Bar M (2009) The proactive brain: Using memory-based predictions in visual recognition. In: Dickinson S, Tarr M, Leonardis A, Schiele B (eds) Object categorization: computer and human vision perspectives. Cambridge University Press, Cambridge, pp 384–401CrossRefGoogle Scholar
  40. Lawrence BM (2010) An anti-Hick’s effect for exogenous, but not endogenous, saccadic eye movements. Exp Brain Res. Google Scholar
  41. Luce RD (1986) Response times: their role in inferring elementary mental organization. Oxford University Press, New YorkGoogle Scholar
  42. Ma DS, Correll J, Wittenbrink B (2015) The chicago face database: a free stimulus set of faces and norming data. Behav Res Methods 47:1122–1135CrossRefGoogle Scholar
  43. MacNeilage PF, Rogers LJ, Vallortigara G (2009) Origins of the left and right brain. Sci Am. Google Scholar
  44. Maner JK, Kenrick DT, Neuberg SL, Becker DV, Schaller M (2005) Functional projection: How fundamental social motives can bias interpersonal perception. J Pers Soc Psychol 88:63–78CrossRefGoogle Scholar
  45. Nummenmaa L, Calvo MG (2015) Dissociation between recognition and detection advantage for facial expressions: a meta-analysis. Emotion 15(2):243–256CrossRefGoogle Scholar
  46. O’Callaghan C, Kveraga K, Shine JM, Adams RB Jr, Bar M (2017) Predictions penetrate perception: Converging insights from brain, behaviour, and disorder. Conscious Cogn 47:63–74CrossRefGoogle Scholar
  47. Onal-Hartmann C, Pauli P, Ocklenburg S, Gunturkun O (2012) The motor side of emotions: investigating the relationship between hemispheres, motor reactions, and emotional stimuli. Psychol Res 76(3):311–316CrossRefGoogle Scholar
  48. Peirce JW (2007) PsychoPy-Psychophysics software in Python. J Neurosci Methods 162(1–2):8–13. CrossRefGoogle Scholar
  49. Pessoa L (2008) On the relationship between emotion and cognition. Nat Rev Neurosci 9:148–158CrossRefGoogle Scholar
  50. Rogers LJ, Vallortigara G, Andrew RJ (2013) Divided brains: the biology and behaviour of brain asymmetries. Cambridge University Press, Cambridge CrossRefGoogle Scholar
  51. Shannon CE (1948) A Mathematical Theory of Communication. Bell Sys Tech J. Google Scholar
  52. Silberman EK, Weingartner H (1986) “Hemispheric lateralization of functions related to emotion”. Brain Cogn 5:322–353CrossRefGoogle Scholar
  53. Tay PKC (2015) The adaptive value associated with expressing and perceiving angry- male and happy-female faces. Front Psychol 6:851CrossRefGoogle Scholar
  54. Taylor SE, Klein LC, Lewis BP, Gruenewald TL, Gurung RAR, Updegraff JA (2000) Biobehavioural responses to stress in females: tend and befriend, not fight-or-flight. Psychol Rev 107:411–429CrossRefGoogle Scholar
  55. Trawalter S, Todd AR, Baird AA, Richeson JA (2008) Attending to threat: race-based patterns of selective attention. J Exp Soc Psychol 44:1322–1327CrossRefGoogle Scholar
  56. Trivers RL (1985) Social evolution. Benjamin/Cummins, Menlo ParkGoogle Scholar
  57. Vuilleumier P, Armory JL, Dolan RJ (2003) Reciprocal links between emotion and attention. In: Friston KJ, Frith CD, Dolan RJ, Price C, Ashburner J, Penny W, Zeki S, Frackowiak RSJ (eds) Human brain function, 2nd edn. Academic Press, New York, pp 419–444Google Scholar
  58. Watson D, Wiese D, Vaidya J, Tellegen A (1999) The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidence. J Pers Soc Psychol 76:820–838CrossRefGoogle Scholar
  59. Zebrowitz LA (1997) New directions in social psychology. Reading faces: window to the soul? Westview Press, BoulderGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Athinoula A. Martinos Center for Biomedical ImagingMassachusetts General HospitalBostonUSA
  2. 2.Department of RadiologyHarvard Medical SchoolBostonUSA
  3. 3.Department of PsychologyFlorida State UniversityTallahasseeUSA
  4. 4.Department of PsychologyUniversity of California Los AngelesLos AngelesUSA
  5. 5.Department of PsychologyThe Pennsylvania State UniversityUniversity ParkUSA
  6. 6.Department of Radiology, Harvard Medical School, Center for Biomedical ImagingMassachusetts General HospitalCharlestownUSA

Personalised recommendations