About Behaviour

  • Shaogang Gong
  • Tao Xiang


Understanding and interpreting behaviours of objects, and in particular those of humans, is central to social interaction and communication. In particular, visual behaviour refers to the actions or reactions of a sensory mechanism in response to a visual stimulus, for example, the navigation mechanism of nocturnal bees in dim light, visual search by eye movement of infants or drivers in response to their surrounding environment. If visual behaviour as a search mechanism is a perceptual function that scans actively a visual environment in order to focus attention and seek an object of interest among distracters, visual analysis of behaviour is a perceptual task that interprets actions and reactions of objects, such as people, interacting or co-existing with other objects in a visual environment. Recognising objects visually by behaviour and activity rather than shape and size is important to the human visual system. Since 1970s, the computer vision community has endeavoured to bring about intelligent perceptual capabilities to artificial visual sensors. This endeavour has been intensified in recent years by the need for understanding massive quantity of video data, with the aim to not only comprehend objects spatially in a snapshot but also their spatiotemporal relations over time in a sequence of images. In this chapter, we introduce the computational study of visual analysis of behaviour, in particular of human behaviour, and outline the opportunities and challenges for visual analysis of behaviour.


Visual Search Visual Analysis Behaviour Analysis Human Visual System Visual Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Agre, P.E.: The dynamic structure of everyday life. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, USA (1989) Google Scholar
  2. Barbur, J.L., Ruddock, K.H., Waterfield, V.A.: Human visual responses in the absence of the geniculo-calcarine projection. Brain 103(4), 905–928 (1980) CrossRefGoogle Scholar
  3. Breazeal, C.L. (ed.): Desiging Sociable Robots. MIT Press, Cambridge (2002) Google Scholar
  4. Buxton, H., Gong, S.: Visual surveillance in a dynamic and uncertain world. Artif. Intell. 78(1–2), 431–459 (1995) CrossRefGoogle Scholar
  5. Gong, S., Ng, J., Sherrah, J.: On the semantics of visual behaviour, structured events and trajectories of human action. Image Vis. Comput. 20(12), 873–888 (2002) CrossRefGoogle Scholar
  6. Gough, D.: The visual behaviour of infants in the first few weeks of life. Proc. R. Soc. Med. 55(4), 308–310 (1962) Google Scholar
  7. Gregory, R.L.: The Intelligent Eye. Weidenfeld and Nicolson, London (1970) Google Scholar
  8. Harbluk, J.L., Noy, Y.I.: The impact of cognitive distraction on driver visual behaviour and vehicle control. Technical Report TP 13889 E, Road Safety Directorate and Motor Vehicle Regulation Directorate, Canadian Minister of Transport (2002) Google Scholar
  9. Humphreys, G.W., Bruce, V.: Visual Cognition: Computational, Experimental and Neuropsychological Perspectives. Erlbaum, Hove (1989) MATHGoogle Scholar
  10. Ingle, D.J., Goodale, M.A., Mansfield, R.J.W. (eds.): Analysis of Visual Behaviour. MIT Press, Cambridge (1982) Google Scholar
  11. Ltti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998) CrossRefGoogle Scholar
  12. Marr, D.: Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information. Freeman, New York (1982) Google Scholar
  13. Rollinson, D.: Organisational Behaviour and Analysis: An Integrated Approach. Prentice Hall, New York (2004) Google Scholar
  14. Schiller, P.H., Koerner, F.: Discharge characteristics of single units in superior colliculus of the alert rhesus monkey. J. Neurophysiol. 34(5), 920–935 (1971) Google Scholar
  15. Sherman, M.D., Sherman, I.C.: The process of human behaviour. J. Ment. Sci. 76, 337–338 (1930) Google Scholar
  16. Simon, H.A.: A behavioral model of rational choice. Q. J. Econ. 69(1), 99–118 (1955) CrossRefGoogle Scholar
  17. von Helmholtz, H.: The recent progress of the theory of vision. In: Popular Scientific Lectures. Dover, New York (1962) Google Scholar
  18. Warrant, E.J.: Seeing in the dark: vision and visual behaviour in nocturnal bees and wasps. J. Exp. Biol. 211, 1737–1746 (2008) CrossRefGoogle Scholar
  19. Weiskrantz, L.: Review lecture: behavioural analysis of the monkey’s visual nervous system. Proc. R. Soc. 182, 427–455 (1972) CrossRefGoogle Scholar
  20. Xiang, T., Gong, S.: Beyond tracking: modelling activity and understanding behaviour. Int. J. Comput. Vis. 67(1), 21–51 (2006) CrossRefGoogle Scholar
  21. Yang, G.Z. (ed.): Body Sensor Networks. Springer, Berlin (2006) Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK
  2. 2.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK

Personalised recommendations