Advertisement

The role of eye movements in manual responses to social and nonsocial cues

  • Claudia Bonmassar
  • Francesco Pavani
  • Wieske van Zoest
Article
  • 10 Downloads

Abstract

Gaze and arrow cues cause covert attention shifts even when they are uninformative. Nonetheless, it is unclear to what extent oculomotor behavior influences manual responses to social and nonsocial stimuli. In two experiments, we tracked the gaze of participants during the cueing task with nonpredictive gaze and arrow cues. In Experiment 1, the discrimination task was easy and eye movements were not necessary, whereas in Experiment 2 they were instrumental in identifying the target. Validity effects on manual response time (RT) were similar for the two cues in Experiment 1 and in Experiment 2, though in the presence of eye movements observers were overall slower to respond to the arrow cue compared with the gaze cue. Cue direction had an effect on saccadic performance before the discrimination was presented and throughout the duration of the trial. Furthermore, we found evidence of a distinct impact of the type of cue on diverse oculomotor components. While saccade latencies were affected by the type of cue, both before and after the target onset, saccade landing positions were not. Critically, the manual validity effect was predicted by the landing position of the initial eye movement. This work suggests that the relationship between eye movements and attention is not straightforward. In the presence of overt selection, saccade latency related to the overall speed of manual response, while eye movements landing position was closely related to manual performance in response to different cues.

Keywords

Attention Eye movements and visual attention Face perception 

Notes

Acknowledgements

This research was supported by the Autonomous Province of Trento (Italy), call Grandi Progetti 2012, project Characterizing and Improving Brain Mechanisms of Attention—ATTEND. The authors report no conflict of interests. Finally, we thank Elisa Crestale for having helped in the data collection of Experiment 2.

References

  1. Akiyama, T., Kato, M., Muramatsu, T., Saito, F., Umeda, S., & Kashima, H. (2006). Gaze but not arrows: A dissociative impairment after right superior temporal gyrus damage. Neuropsychologia, 44(10), 1804–1810.  https://doi.org/10.1016/j.neuropsychologia.2006.03.007 Google Scholar
  2. Anderson, S. F., Kelley, K., & Maxwell, S. E. (2017). Sample-size planning for more accurate statistical power: A method adjusting sample effect sizes for publication bias and uncertainty. Psychological Science, 28(11), 1547–1562.  https://doi.org/10.1177/0956797617723724 Google Scholar
  3. Bertelson, P. (1967). The time course of preparation*. Quarterly Journal of Experimental Psychology, 19(3), 272–279.  https://doi.org/10.1080/14640746708400102 Google Scholar
  4. Blair, C., Capozzi, F., & Ristic, J. (2017). Where is your attention? Assessing individual instances of covert attentional orienting in response to gaze and arrow cues. Vision, 1(3), 19.  https://doi.org/10.3390/vision1030019 Google Scholar
  5. Carlin, J. D., & Calder, A. J. (2013). The neural basis of eye gaze processing. Current Opinion in Neurobiology, 23(3), 450–455.  https://doi.org/10.1016/j.conb.2012.11.014 Google Scholar
  6. Clarke, A. D. F., Mahon, A., Irvine, A., & Hunt, A. R. (2017). People are unable to recognize or report on their own eye movements. Quarterly Journal of Experimental Psychology, 70(11).  https://doi.org/10.1080/17470218.2016.1231208
  7. Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3(3), 201–215.  https://doi.org/10.1038/nrn755 Google Scholar
  8. Corkum, V., & Moore, C. (1995). Development of joint visual attention in infants. In C. Moore & P. J. Dunham (Series), Joint attention: Its origins and role in development (pp. 61–83). Hillsdale: Erlbaum.Google Scholar
  9. Dalmaijer, E. S., Mathôt, S., & Van der Stigchel, S. (2014). PyGaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behavior Research Methods, 46(4), 913–921.  https://doi.org/10.3758/s13428-013-0422-2 Google Scholar
  10. Dalmaso, M., Castelli, L., Franchetti, L., Carli, L., Todisco, P., Palomba, D., & Galfano, G. (2015). Altered orienting of attention in anorexia nervosa. Psychiatry Research, 229(1), 318–325.  https://doi.org/10.1016/j.psychres.2015.06.044 Google Scholar
  11. Dalmaso, M., Galfano, G., Tarqui, L., Forti, B., & Castelli, L. (2013). Is social attention impaired in schizophrenia? Gaze, but not pointing gestures, is associated with spatial attention deficits. Neuropsychology, 27(5), 608–613.  https://doi.org/10.1037/a0033518 Google Scholar
  12. Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E., & Baron-Cohen, S. (1999). Gaze perception triggers reflexive visuospatial orienting. Visual Cognition, 6(5), 509–540.  https://doi.org/10.1080/135062899394920 Google Scholar
  13. Egeth, H. E., & Yantis, S. (1997). Visual attention: Control, representation, and time course. Annual Review of Psychology, 48(1), 269–297.  https://doi.org/10.1146/annurev.psych.48.1.269 Google Scholar
  14. Engbert, R., & Kliegl, R. (2003). Microsaccades uncover the orientation of covert attention. Vision Research, 43(9), 1035–1045.  https://doi.org/10.1016/S0042-6989(03)00084-1 Google Scholar
  15. Friesen, C. K., & Kingstone, A. (1998). The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin & Review, 5(3), 490–495.  https://doi.org/10.3758/BF03208827 Google Scholar
  16. Friesen, C. K., Moore, C., & Kingstone, A. (2005). Does gaze direction really trigger a reflexive shift of spatial attention? Brain and Cognition, 57(1), 66–69.  https://doi.org/10.1016/j.bandc.2004.08.025 Google Scholar
  17. Friesen, C. K., Ristic, J., & Kingstone, A. (2004). Attentional effects of counterpredictive gaze and arrow cues. Journal of Experimental Psychology: Human Perception and Performance, 30(2), 319–329.  https://doi.org/10.1037/0096-1523.30.2.319 Google Scholar
  18. Frischen, A., Bayliss, A. P., & Tipper, S. P. (2007). Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychological Bulletin, 133(4), 694–724.  https://doi.org/10.1037/0033-2909.133.4.694 Google Scholar
  19. Galfano, G., Dalmaso, M., Marzoli, D., Pavan, G., Coricelli, C., & Castelli, L. (2012). Eye gaze cannot be ignored (but neither can arrows). Quarterly Journal of Experimental Psychology, 65(10), 1895–1910.  https://doi.org/10.1080/17470218.2012.663765 Google Scholar
  20. Galfano, G., Sarlo, M., Sassi, F., Munafò, M., Fuentes, L. J., & Umiltà, C. (2011). Reorienting of spatial attention in gaze cuing is reflected in N2pc. Social Neuroscience, 6(3), 257–269.  https://doi.org/10.1080/17470919.2010.515722 Google Scholar
  21. Gibson, B. S., & Bryant, T. A. (2005). Variation in cue duration reveals top-down modulation of involuntary orienting to uninformative symbolic cues. Perception & Psychophysics, 67(5), 749–758.  https://doi.org/10.3758/BF03193530 Google Scholar
  22. Hafed, Z. M., & Clark, J. J. (2002). Microsaccades as an overt measure of covert attention shifts. Vision Research, 42(22), 2533–2545.  https://doi.org/10.1016/S0042-6989(02)00263-8 Google Scholar
  23. Heimler, B., van Zoest, W., Baruffaldi, F., Rinaldi, P., Caselli, M. C., & Pavani, F. (2015). Attentional orienting to social and nonsocial cues in early deaf adults. Journal of Experimental Psychology: Human Perception and Performance, 41(6), 1758–1771.  https://doi.org/10.1037/xhp0000099 Google Scholar
  24. Hietanen, J. K. (1999). Does your gaze direction and head orientation shift my visual attention? NeuroReport, 10(16), 3443.Google Scholar
  25. Hietanen, J. K., Leppänen, J. M., Nummenmaa, L., & Astikainen, P. (2008). Visuospatial attention shifts by gaze and arrow cues: An ERP study. Brain Research, 1215, 123–136.  https://doi.org/10.1016/j.brainres.2008.03.091 Google Scholar
  26. Hietanen, J. K., Nummenmaa, L., Nyman, M. J., Parkkola, R., & Hämäläinen, H. (2006). Automatic attention orienting by social and symbolic cues activates different neural networks: An fMRI study. NeuroImage, 33(1), 406–413.  https://doi.org/10.1016/j.neuroimage.2006.06.048 Google Scholar
  27. Hommel, B., Pratt, J., Colzato, L., & Godijn, R. (2001). Symbolic control of visual attention. Psychological Science, 12(5), 360–365.  https://doi.org/10.1111/1467-9280.00367 Google Scholar
  28. Hood, B. M., Willen, J. D., & Driver, J. (1998). Adult’s eyes trigger shifts of visual attention in human infants. Infant Behavior and Development, 21, 466.  https://doi.org/10.1016/S0163-6383(98)91679-4 Google Scholar
  29. Jonides, J. (1981). Voluntary versus automatic control over the mind’s eye’s movements. In J. B. Long & A. D. Baddeley (Eds.), Attention and performance IX (pp. 187–203). Hillsdale: Erlbaum.Google Scholar
  30. Kingstone, A., Friesen, C. K., & Gazzaniga, M. S. (2000). Reflexive joint attention depends on lateralized cortical connections. Psychological Science, 11(2), 159–166.  https://doi.org/10.1111/1467-9280.00232 Google Scholar
  31. Kingstone, A., Tipper, C., Ristic, J., & Ngan, E. (2004). The eyes have it!: An fMRI investigation. Brain and Cognition, 55(2), 269–271.  https://doi.org/10.1016/j.bandc.2004.02.037 Google Scholar
  32. Kröse, B. J. A., & Julesz, B. (1989). The control and speed of shifts of attention. Vision Research, 29(11), 1607–1619.  https://doi.org/10.1016/0042-6989(89)90142-9 Google Scholar
  33. Kuhn, G., & Benson, V. (2007). The influence of eye-gaze and arrow pointing distractor cues on voluntary eye movements. Perception & Psychophysics, 69(6), 966–971.  https://doi.org/10.3758/BF03193934 Google Scholar
  34. Kuhn, G., Benson, V., Fletcher-Watson, S., Kovshoff, H., McCormick, C. A., Kirkby, J., & Leekam, S. R. (2009a). Eye movements affirm: automatic overt gaze and arrow cueing for typical adults and adults with autism spectrum disorder. Experimental Brain Research, 201(2), 155–165.  https://doi.org/10.1007/s00221-009-2019-7 Google Scholar
  35. Kuhn, G., & Kingstone, A. (2009). Look away! Eyes and arrows engage oculomotor responses automatically. Attention, Perception & Psychophysics, 71(2), 314–327.  https://doi.org/10.3758/APP.71.2.314 Google Scholar
  36. Kuhn, G., Tatler, B. W., & Cole, G. G. (2009b). You look where I look! Effect of gaze cues on overt and covert attention in misdirection. Visual Cognition, 17(6/7), 925–944.  https://doi.org/10.1080/13506280902826775 Google Scholar
  37. Kuhn, G., Tewson, L., Morpurgo, L., Freebody, S. F., Musil, A. S., & Leekam, S. R. (2011). Developmental changes in the control of saccadic eye movements in response to directional eye gaze and arrows. Quarterly Journal of Experimental Psychology, 64(10), 1919–1929.  https://doi.org/10.1080/17470218.2011.592592 Google Scholar
  38. Langdon, R., & Smith, P. (2005). Spatial cueing by social versus nonsocial directional signals. Visual Cognition, 12(8), 1497–1527.  https://doi.org/10.1080/13506280444000805 Google Scholar
  39. Langton, S. R. H., & Bruce, V. (1999). Reflexive visual orienting in response to the social attention of others. Visual Cognition, 6(5), 541–567.  https://doi.org/10.1080/135062899394939 Google Scholar
  40. Mahon, A., Clarke, A. D. F., & Hunt, A. R. (2018). The role of attention in eye-movement awareness. Attention, Perception, & Psychophysics, 80(7), 1691–1704.  https://doi.org/10.3758/s13414-018-1553-4 Google Scholar
  41. Mansfield, E., Farroni, T., & Johnson, M. (2003). Does gaze perception facilitate overt orienting? Visual Cognition, 10(1), 7–14.  https://doi.org/10.1080/713756671 Google Scholar
  42. Marotta, A., Román-Caballero, R., & Lupiáñez, J. (2018). Arrows don’t look at you: Qualitatively different attentional mechanisms triggered by gaze and arrows. Psychonomic Bulletin & Review.  https://doi.org/10.3758/s13423-018-1457-2
  43. Mathôt, S., Schreij, D., & Theeuwes, J. (2012). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior Research Methods, 44(2), 314–324.  https://doi.org/10.3758/s13428-011-0168-7 Google Scholar
  44. McCamy, M. B., Jazi, A. N., Otero-Millan, J., Macknik, S. L., & Martinez-Conde, S. (2013). The effects of fixation target size and luminance on microsaccades and square-wave jerks. PeerJ, 1, e9.  https://doi.org/10.7717/peerj.9 Google Scholar
  45. Müller, H. J., & Humphreys, G. W. (1991). Luminance-increment detection: Capacity-limited or not? Journal of Experimental Psychology: Human Perception and Performance, 17(1), 107–124.  https://doi.org/10.1037/0096-1523.17.1.107 Google Scholar
  46. Müller, H. J., & Rabbitt, P. M. (1989). Reflexive and voluntary orienting of visual attention: Time course of activation and resistance to interruption. Journal of Experimental Psychology: Human Perception and Performance, 15(2), 315–330.  https://doi.org/10.1037/0096-1523.15.2.315 Google Scholar
  47. O’Brien, F., & Cousineau, D. (2014). Representing Error bars in within-subject designs in typical software packages. The Quantitative Methods for Psychology, 10(1), 56–67.  https://doi.org/10.20982/tqmp.10.1.p056 Google Scholar
  48. Oosterhof, N. N., & Todorov, A. (2008). The functional basis of face evaluation. Proceedings of the National Academy of Sciences, 105(32), 11087–11092.  https://doi.org/10.1073/pnas.0805664105 Google Scholar
  49. Peirce, J. W. (2007). PsychoPy—Psychophysics software in Python. Journal of Neuroscience Methods, 162(1/2), 8–13.  https://doi.org/10.1016/j.jneumeth.2006.11.017 Google Scholar
  50. Peirce, J. W. (2009). Generating stimuli for neuroscience using PsychoPy. Frontiers in Neuroinformatics, 2.  https://doi.org/10.3389/neuro.11.010.2008
  51. Posner, M. I. (1978). Chronometric explorations of mind. Oxford: Erlbaum.Google Scholar
  52. Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32(1), 3–25.  https://doi.org/10.1080/00335558008248231 Google Scholar
  53. Ricciardelli, P., Bricolo, E., Aglioti, S. M., & Chelazzi, L. (2002). My eyes want to look where your eyes are looking: Exploring the tendency to imitate another individual’s gaze. NeuroReport, 13(17), 2259.Google Scholar
  54. Ristic, J., Friesen, C. K., & Kingstone, A. (2002). Are eyes special? It depends on how you look at it. Psychonomic Bulletin & Review, 9(3), 507–513.  https://doi.org/10.3758/BF03196306 Google Scholar
  55. Ristic, J., & Kingstone, A. (2005). Taking control of reflexive social attention. Cognition, 94(3), B55–B65.  https://doi.org/10.1016/j.cognition.2004.04.005 Google Scholar
  56. Ristic, J., & Kingstone, A. (2009). Rethinking attentional development: Reflexive and volitional orienting in children and adults. Developmental Science, 12(2), 289–296.  https://doi.org/10.1111/j.1467-7687.2008.00756.x Google Scholar
  57. Ristic, J., Wright, A., & Kingstone, A. (2007). Attentional control and reflexive orienting to gaze and arrow cues. Psychonomic Bulletin & Review, 14(5), 964–969.  https://doi.org/10.3758/BF03194129 Google Scholar
  58. Stevens, S. A., West, G. L., Al-Aidroos, N., Weger, U. W., & Pratt, J. (2008). Testing whether gaze cues and arrow cues produce reflexive or volitional shifts of attention. Psychonomic Bulletin & Review, 15(6), 1148–1153.  https://doi.org/10.3758/PBR.15.6.1148 Google Scholar
  59. Tipples, J. (2002). Eye gaze is not unique: Automatic orienting in response to uninformative arrows. Psychonomic Bulletin & Review, 9(2), 314–318.  https://doi.org/10.3758/BF03196287 Google Scholar
  60. Tipples, J. (2008). Orienting to counterpredictive gaze and arrow cues. Perception & Psychophysics, 70(1), 77–87.  https://doi.org/10.3758/PP.70.1.77 Google Scholar
  61. Valsecchi, M., Betta, E., & Turatto, M. (2007). Visual oddballs induce prolonged microsaccadic inhibition. Experimental Brain Research, 177(2), 196–208.  https://doi.org/10.1007/s00221-006-0665-6 Google Scholar
  62. Vecera, S. P., & Rizzo, M. (2004). What are you looking at?: Impaired ‘social attention’ following frontal-lobe damage. Neuropsychologia, 42(12), 1657–1665.  https://doi.org/10.1016/j.neuropsychologia.2004.04.009 Google Scholar
  63. Vecera, S. P., & Rizzo, M. (2006). Eye gaze does not produce reflexive shifts of attention: Evidence from frontal-lobe damage. Neuropsychologia, 44(1), 150–159.  https://doi.org/10.1016/j.neuropsychologia.2005.04.010 Google Scholar
  64. Wright, R. D., & Ward, L. M. (2008). Orienting of attention. Oxford: Oxford University Press.Google Scholar

Copyright information

© The Psychonomic Society, Inc. 2019

Authors and Affiliations

  • Claudia Bonmassar
    • 1
  • Francesco Pavani
    • 1
    • 2
    • 3
  • Wieske van Zoest
    • 1
    • 4
  1. 1.Center for Mind/Brain Sciences (CIMeC)University of TrentoRoveretoItaly
  2. 2.Integrative Multisensory Perception Action and Cognition team (ImpAct)Centre de Recherche en Neurosciences de Lyon (CRNL)LyonFrance
  3. 3.Department of Psychology and Cognitive SciencesUniversity of TrentoTrentoItaly
  4. 4.School of PsychologyUniversity of BirminghamBirminghamUK

Personalised recommendations