Hierarchical Behaviour Discovery

  • Shaogang Gong
  • Tao Xiang


Behaviour of groups of objects observed in a crowded public space is typically complex and uncertain. What is considered to be ‘subjectively interesting behaviour’ to a human observer can be influenced by a wide variety of factors including: (1) the activity of a single object over time; (2) the correlated spatial states of multiple objects, for example, a piece of abandoned luggage is defined by separation from its owner; and (3) higher order spatial and temporal correlations among multiple entities, for instance, traffic flow at a road intersection has a particular spatio-temporal order beyond co-occurrence dictated by traffic lights. Constructing computational models that are both flexible and accurate in representing such complex and uncertain characteristics of behaviour is challenging. A dynamic topic model possesses unique computational attributes that make it an attractive framework for addressing these challenges. In this chapter, we describe a Markov clustering topic model designed for unsupervised modelling and on-line processing of multi-object spatio-temporal behaviours in crowded public scenes. A Markov clustering topic model draws on machine learning theories on probabilistic topic models and dynamic Bayesian networks to achieve a robust hierarchical modelling of behaviours and their dynamics.


Topic Model Latent Dirichlet Allocation Saliency Detection Behaviour Class Behaviour Cluster 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997) CrossRefGoogle Scholar
  2. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006) MATHGoogle Scholar
  3. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003) MATHGoogle Scholar
  4. Fisher, R.A.: The statistical utilisation of multiple measurements. Ann. Eugen. 8, 376–386 (1938) CrossRefGoogle Scholar
  5. Gilks, W.R., Richardson, S., Spiegelhalter, D. (eds.): Markov Chain Monte Carlo in Practice: Interdisciplinary Statistics. Chapman & Hall/CRC Press, London/Boca Raton (1995) Google Scholar
  6. Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. Natl. Acad. Sci. USA 101, 5228–5235 (2004) CrossRefGoogle Scholar
  7. Griffiths, T.L., Steyvers, M., Blei, D.M., Tenenbaum, J.: Integrating topics and syntax. In: Advances in Neural Information Processing Systems, pp. 537–544 (2005) Google Scholar
  8. Gruber, A., Rosen-Zvi, M., Weiss, Y.: Hidden topic Markov models. In: Artificial Intelligence and Statistics, San Juan, Puerto Rico (2007) Google Scholar
  9. Hospedales, T., Gong, S., Xiang, T.: A Markov clustering topic model for behaviour mining in video. In: IEEE International Conference on Computer Vision, Kyoto, Japan, October 2009, pp. 1165–1172 (2009) Google Scholar
  10. Kuettel, D., Breitenstein, M.D., Van Gool, L., Ferrari, V.: What’s going on? discovering spatio-temporal dependencies in dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, USA, June 2010, pp. 1951–1958 (2010) Google Scholar
  11. Li, J., Gong, S., Xiang, T.: Global behaviour inference using probabilistic latent semantic analysis. In: British Machine Vision Conference, Leeds, UK, September 2008, pp. 193–202 (2008) Google Scholar
  12. Rosen-Zvi, M., Griffiths, T.L., Steyvers, M., Smyth, P.: The author-topic model for authors and documents. In: Uncertainty in Artificial Intelligence, Banff, Canada, pp. 487–494 (2008) Google Scholar
  13. Wallach, H., Murray, I., Salakhutdinov, R., Mimno, D.: Evaluation methods for topic models. In: International Conference on Machine Learning, pp. 1105–1112 (2009) Google Scholar
  14. Wang, X., Ma, X., Grimson, W.E.L.: Unsupervised activity perception by hierarchical Bayesian models. IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 539–555 (2009) CrossRefGoogle Scholar
  15. Zhu, X.: Semi-supervised learning literature survey. Technical Report 1530, University of Wisconsin-Madison Department of Computer Science (2007) Google Scholar
  16. Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using Gaussian fields and harmonic functions. In: International Conference on Machine Learning, pp. 912–919 (2003) Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK
  2. 2.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK

Personalised recommendations