Skip to main content

Attention and Cognition: Principles to Guide Modeling

  • Chapter
  • First Online:
Computational and Cognitive Neuroscience of Vision

Part of the book series: Cognitive Science and Technology ((CSAT))

Abstract

Interest in the modeling of visual attention and cognition is strong with the number of models growing quickly. It thus becomes important to try to consolidate what all this activity has demonstrated in terms of what principles may be abstracted from the collective experience that can guide future research. This is not a straightforward task; many have tried and have little to show for it. Here, a different view is presented, one that attempts to combine multiple perspectives on the problem. The novelty is that in contrast with the vast majority of past work, there is an explicit assertion that no single principle can capture the complexities of human attentional and cognitive behavior. There are several principles, each defined in a particular context, with interactions among them. Many previous authors have stated principles that in fact are more correctly considered as modeling philosophies or requirements and these will be so distinguished. The development of a model of human visual cognition is dependent on the choice of which experimental observations act as constraints during its development (Tsotsos 2014). Those constraints provide a means to select solutions among those potential ones that satisfy the principles. Here, we begin by proposing a set of elements that may be considered as the components of attention, without any claims or completeness or optimality, and these will act as the first level set of constraints on any modeling activity. A look at specific models of attention and cognitive architectures will reveal a variety of principles, philosophies and requirements that have been shown to be important. This will be followed by the introduction of the Survival Requirement as a replacement for any over-arching principle of optimality because there still is a need for a selection criterion for choosing among competing solutions. The presentation will conclude by considering how progress on open problems in neuroscience may be facilitated by considering this list of principles, philosophies and requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Computer science, broadly defined, is the theory and practice of representing, processing, and using information and encompasses a body of knowledge concerning algorithms, communication, languages, software, and information systems. In a nice paper, Peter Denning (Denning 2007) claimed that it offers a powerful foundation for modeling complex phenomena such as cognition. The language of computation is the best language we have to date, he claims, for describing how information is encoded, stored, manipulated, and used by natural as well as synthetic systems. As such, the language of computation subsumes mathematics and formal logic which are nevertheless critical tools for expressing appropriate elements of theories.

References

  • Adolphs R (2015) The unsolved problems of neuroscience. Trends Cogn Sci 19(4):173–175

    Article  Google Scholar 

  • Bellman RE (1957) Dynamic programming. Princeton University Press

    Google Scholar 

  • Beuth F, Hamker F (2015). A mechanistic cortical microcircuit of attention for amplification, normalization and suppression, Vision Research, in press

    Google Scholar 

  • Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(185–207):110–126

    Google Scholar 

  • Bruce ND, Wloka C, Frosst N, Rahman S, Tsotsos, JK (2015). On computational modeling of visual saliency: Examining what’s right, and what’s left. Vision research (in press)

    Google Scholar 

  • Bylinskii Z, DeGennaro EM, Rajalingham R, Ruda H, Zhang J, Tsotsos JK (2015). Towards the quantitative evaluation of visual attention models. Vision Research, in press

    Google Scholar 

  • Carrasco M (2011) Visual attention: The past 25 years. Vis Res 51(13):1484–1525

    Article  Google Scholar 

  • Denning PJ (2007) Computing is a natural science. Commun ACM 50(7):13–18

    Article  Google Scholar 

  • Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202–1205

    Article  Google Scholar 

  • Findlay JM, Gilchrist ID (2001) Visual attention: the active vision perspective. Vis Atten, 83–103. Springer New York

    Google Scholar 

  • Frintrop S, Rome E, Christensen HI (2010) Computational visual attention systems and their cognitive foundations: a survey. ACM Trans Appl Percept (TAP) 7(1):6

    Google Scholar 

  • Friston K (2010) The free-energy principle: a unified brain theory? Nat Rev Neurosci 11(2):127–138

    Article  Google Scholar 

  • Garey M, Johnson D (1979) Computers and intractability: a guide to the theory of NP-completeness. Freeman, San Francisco

    MATH  Google Scholar 

  • Itti L, Rees G, Tsotsos JK (eds) (2005) Neurobiology of Attention, Elsevier Press

    Google Scholar 

  • Just MA, Varma S (2007) The organization of thinking: what functional brain imaging reveals about the neuroarchitecture of complex cognition. Cogn Affect Behav Neurosci 7(3):153–191

    Article  Google Scholar 

  • Kimura A, Yonetani R, Hirayama T (2013) Computational models of human visual attention and their implementations: A survey. IEICE Trans Inf Syst 96(3):562–578

    Article  Google Scholar 

  • Kravitz DJ, Saleem KS, Baker CI, Ungerleider LG, Mishkin M (2013) The ventral visual pathway: an expanded neural framework for the processing of object quality. Trends Cogn Sci 17(1):26–49

    Article  Google Scholar 

  • Marr D (1982) Vision: A computational investigation into the human representation and processing of visual information. Henry Holt and Co., Inc., New York, NY, USA

    Google Scholar 

  • Nobre K, Kastner S (eds) (2013) The Oxford handbook of attention. Oxford University Press

    Google Scholar 

  • O’Reilly RC (1998) Six principles for biologically based computational models of cortical cognition. Trends Cogn Sci 2(11):455–462

    Article  MathSciNet  Google Scholar 

  • Pashler H (ed) (1998) Attention. Psychology Press, East Sussex, UK

    Google Scholar 

  • Rao S (1998) Visual routines and attention, PhD Dissertation, MIT, February

    Google Scholar 

  • Rothenstein AL, Tsotsos JK (2014) Attentional modulation and selection—an integrated approach, Public Libr Sci (PLoS) ONE 9(6): e99681

    Google Scholar 

  • Russell S, Norvig P (2010) Artificial intelligence: a modern approach, 3rd edn. Pearson Education Inc., Upper Saddle River, NJ

    MATH  Google Scholar 

  • Samsonovich AV (2010) Toward a unified catalog of implemented cognitive architectures. BICA 221:195–244

    Google Scholar 

  • Samsonovich AV (2012) On a roadmap for the BICA Challenge. Biol Inspired Cogn Archit 1:100–107

    Google Scholar 

  • Treisman A, Gelade G (1980) A feature integration theory of attention. Cogn Psychol 12:97–136

    Article  Google Scholar 

  • Tsotsos JK (1990) Analyzing vision at the complexity level. Behav Brain Sci 13–3:423–445

    Article  Google Scholar 

  • Tsotsos JK (1992) On the relative complexity of passive vs active visual search. Int J Comput Vis 7(2):127–141

    Article  Google Scholar 

  • Tsotsos JK (2011) A computational perspective on visual attention. MIT Press, Cambridge MA

    Book  Google Scholar 

  • Tsotsos JK, Rothenstein A (2011) Computational models of visual attention. Scholarpedia 6(1):6201

    Article  Google Scholar 

  • Tsotsos JK, Kruijne W (2014) Cognitive programs: software for attention’s executive. Front Psychol, 5

    Google Scholar 

  • Tsotsos JK (2014) It’s all about the constraints. Curr Biol 24(18):R854–R858

    Article  Google Scholar 

  • Ullman S (1984) Visual routines. Cognition 18(1–3):97–159

    Article  Google Scholar 

  • Varma S (2011) Criteria for the design and evaluation of cognitive architectures. Cogn Sci 35(7):1329–1351

    Article  Google Scholar 

  • Yarbus AL (1967) Eye movements and vision. Plenum Press, New York

    Book  Google Scholar 

  • Ye Y, Tsotsos JK (1996) 3D sensor planning: its formulation and complexity. In: Kautz H, Selman B, (eds) Proceedings 4th International Symposium on Artifi cial Intelligence and Mathematics. January 3–5, Fort Lauderdale, FL

    Google Scholar 

  • Yi W, Ballard D (2009) Recognizing behavior in hand-eye coordination patterns. Int J Hum Robot 6(3):337–359

    Article  Google Scholar 

  • Zucker, S. W. (1981). Computer Vision and Human Perception: An Essay on the Discovery of Constraints. Proc. 7th Int. Conf. on Artificial Intelligence. August 24–28, Vancouver, BC, 1102–1116

    Google Scholar 

  • Zylberberg A, Slezak DF, Roelfsema PR, Dehaene S, Sigman M (2010) The brain’s router: a cortical network model of serial processing in the primate brain. PLoS Comput Biol 6(4):e1000765

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

JKT gratefully acknowledges support from the following sources without which this research could not have been conducted: the Natural Sciences and Engineering Research Council of Canada; the Canada Research Chairs Program; the Air Force Office of Scientific Research, Air Force Material Command, USAF under Award No. FA9550-14-1-0393.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John K. Tsotsos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Tsotsos, J.K. (2017). Attention and Cognition: Principles to Guide Modeling. In: Zhao, Q. (eds) Computational and Cognitive Neuroscience of Vision. Cognitive Science and Technology. Springer, Singapore. https://doi.org/10.1007/978-981-10-0213-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-0213-7_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-0211-3

  • Online ISBN: 978-981-10-0213-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics