Attention, Perception, & Psychophysics

, Volume 81, Issue 8, pp 2666–2672 | Cite as

Selection history in context: Evidence for the role of reinforcement learning in biasing attention

  • Brian A. AndersonEmail author
  • Mark K. Britton


Attention is biased towards learned predictors of reward. The influence of reward history on attentional capture has been shown to be context-specific: When particular stimulus features are associated with reward, these features only capture attention when viewed in the context in which they were rewarded. Selection history can also bias attention, such that prior target features gain priority independently of reward history. The contextual specificity of this influence of selection history on attention has not been examined. In the present study, we demonstrate that the consequences of repetitive selection on attention robustly generalize across context, such that prior target features capture attention even in contexts in which they were never seen previously. Our findings suggest that the learning underlying attention driven by outcome-independent selection history differs qualitatively from the learning underlying value-driven attention, consistent with a distinction between associative and reinforcement learning mechanisms.


Selective attention Attentional capture Selection history Contextual cuing Associative learning 



  1. Anderson, B. A. (2013). A value-driven mechanism of attentional selection. Journal of Vision, 13(3):7, 1-16.CrossRefGoogle Scholar
  2. Anderson, B. A. (2015a). Value-driven attentional capture is modulated by spatial context. Visual Cognition, 23, 67-81.CrossRefGoogle Scholar
  3. Anderson, B. A. (2015b). Value-driven attentional priority is context specific. Psychonomic Bulletin and Review, 22, 750-756.CrossRefGoogle Scholar
  4. Anderson, B. A. (2016). The attention habit: How reward learning shapes attentional selection. Annals of the New York Academy of Sciences, 1369, 24-39.CrossRefGoogle Scholar
  5. Anderson, B. A., & Britton, M. K. (2019). On the automaticity of attentional orienting to threatening stimuli. Emotion.Google Scholar
  6. Anderson, B. A., Chiu, M., DiBartolo, M. M., & Leal, S. L. (2017). On the distinction between value-driven attention and selection history: Evidence from individuals with depressive symptoms. Psychonomic Bulletin and Review, 24, 1636-1642.CrossRefGoogle Scholar
  7. Anderson, B. A., & Halpern, M. (2017). On the value-dependence of value-driven attentional capture. Attention, Perception, and Psychophysics, 79, 1001-1011.CrossRefGoogle Scholar
  8. Anderson, B. A., Laurent, P. A., & Yantis, S. (2011). Value-driven attentional capture. Proceedings of the National Academy of Sciences, USA, 108, 10367-10371.CrossRefGoogle Scholar
  9. Anderson, B. A., Leal, S. L., Hall, M. G., Yassa, M. A., & Yantis, S. (2014). The attribution of value-based attentional priority in individuals with depressive symptoms. Cognitive, Affective, and Behavioral Neuroscience, 14, 1221-1227.CrossRefGoogle Scholar
  10. Awh, E. Belopolsky, A. V., & Theeuwes, J. (2012). Top-down versus bottom-up attentional control: A failed theoretical dichotomy. Trends in Cognitive Sciences, 16, 437-443.CrossRefGoogle Scholar
  11. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433–436.Google Scholar
  12. Bucker, B., & Theeuwes, J. (2017). Pavlovian reward learning underlies value driven attentional capture. Attention, Perception, and Psychophysics, 79, 415-428.CrossRefGoogle Scholar
  13. Chun, M., & Jiang, Y. (1998). Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognitive Psychology, 36, 28-71.CrossRefGoogle Scholar
  14. Chun, M., & Jiang, Y. (2003). Implicit, long-term spatial contextual memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 224-234.PubMedGoogle Scholar
  15. Cosman, J. D., & Vecera, S. P. (2013). Context-dependent control over attentional capture. Journal of Experimental Psychology: Human Perception and Performance, 39, 836-848.PubMedGoogle Scholar
  16. Della Libera, C., & Chelazzi, L. (2009). Learning to attend and to ignore is a matter of gains and losses. Psychological Science, 20, 778-784.CrossRefGoogle Scholar
  17. Desimone, R., Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222.CrossRefGoogle Scholar
  18. Failing, M., & Theeuwes, J. (2018). Selection history: How reward modulates selectivity of visual attention. Psychonomic Bulletin and Review, 25, 514-538.CrossRefGoogle Scholar
  19. Folk, C. L., Remington, R. W., & Johnston, J. C. (1992). Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030-1044.PubMedGoogle Scholar
  20. Hickey, C., Chelazzi, L., & Theeuwes, J. (2010). Reward changes salience in human vision via the anterior cingulate. Journal of Neuroscience, 30, 11096-11103.CrossRefGoogle Scholar
  21. Kyllingsbaek, S., Schneider, W. X., & Bundesen, C. (2001). Automatic attraction of attention to former targets in visual displays of letters. Perception and Psychophysics, 63, 85-98.CrossRefGoogle Scholar
  22. Kyllingsbaek, S., Van Lommel, S., Sorensen, T. A., & Bundesen, C. (2014). Automatic attraction of visual attention by supraletter features of former target strings. Frontiers in Psychology, 5:1383, 1-7.Google Scholar
  23. Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015). When goals conflict with values: Counterproductive attentional and oculomotor capture by reward-related stimuli. Journal of Experimental Psychology: General, 144, 158-171.CrossRefGoogle Scholar
  24. Lin, Z., Lu, Z.-H., & He, S. (2016). Decomposing experience-driven attention: opposite attentional effects of previously predictive cues. Attention, Perception, and Psychophysics, 78, 2185-2198.Google Scholar
  25. Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3-25.CrossRefGoogle Scholar
  26. Qu, Z., Hillyard, S. A., & Ding, Y. (2017). Perceptual learning induces persistent attentional capture by nonsalient shapes. Cerebral Cortex, 27, 1512-1523.PubMedGoogle Scholar
  27. Roelfsema, P. R., & van Ooyen, A. (2005). Attention-gated reinforcement learning of internal representations for classification. Neural Computation, 17, 2176-2214.CrossRefGoogle Scholar
  28. Roelfsema, P. R., van Ooyen, A., & Watanabe, T. (2010). Perceptual learning rules based on reinforcers and attention. Trends in Cognitive Sciences, 14, 64-71.CrossRefGoogle Scholar
  29. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225-237.CrossRefGoogle Scholar
  30. Sali, A. W., Anderson, B. A., & Yantis, S. (2014). The role of reward prediction in the control of attention. Journal of Experimental Psychology: Human Perception and Performance, 40, 1654-1664.PubMedGoogle Scholar
  31. Sasaki, Y., Nanez, J. E., & Watanabe, T. (2010). Advances in visual perceptual learning and plasticity. Nature Reviews Neuroscience, 11, 53-60.CrossRefGoogle Scholar
  32. Schmidt, L. J., Belopolsky, A. V., & Theeuwes, J. (2015). Attentional capture by signals of threat. Cognition and Emotion, 29, 687-694.CrossRefGoogle Scholar
  33. Seitz, A., Lefebvre, C., Watanabe, T., & Jolicoeur, P. (2005). Requirement for high-level processing in subliminal learning. Current Biology, 15, R753-R755.CrossRefGoogle Scholar
  34. Seitz, A., & Watanabe, T. (2005). A unified model for perceptual learning. Trends in Cognitive Sciences, 9, 329-334.CrossRefGoogle Scholar
  35. Sha, L. Z., & Jiang, Y. V. (2016). Components of reward-driven attentional capture. Attention, Perception, and Psychophysics, 78, 403-414.CrossRefGoogle Scholar
  36. Shiffrin, R. M., & Schneider, W. (1977). Controlled and automatic human information processing II: Perceptual learning, automatic attending, and general theory. Psychological Review, 84, 127-190. CrossRefGoogle Scholar
  37. Stankevich, B. A., & Geng, J. J. (2014). Reward associations and spatial probabilities produce additive effects on attentional selection. Attention, Perception, and Psychophysics, 76, 2315-2325.CrossRefGoogle Scholar
  38. Theeuwes, J. (1992). Perceptual selectivity for color and form. Perception and Psychophysics, 51, 599-606.CrossRefGoogle Scholar
  39. Theeuwes, J. (2010). Top-down and bottom-up control of visual selection. Acta Psychologica, 135, 77-99.CrossRefGoogle Scholar
  40. Wang, L., Yu, H., & Zhou, X. (2013). Interaction between value and perceptual salience in value-driven attentional capture. Journal of Vision, 13(3:5), 1-13.CrossRefGoogle Scholar
  41. Wolfe, J. M., Cave, K. R., Franzel, S. L. (1989). Guided Search: An alternative to the feature integration model for visual search. Journal of Experimental Psychology: Human Perception and Performance, 15, 419-433.PubMedGoogle Scholar

Copyright information

© The Psychonomic Society, Inc. 2019

Authors and Affiliations

  1. 1.Department of PsychologyTexas A&M UniversityCollege StationUSA

Personalised recommendations