Connecting the Dots

  • Shaogang Gong
  • Tao Xiang


One of the ultimate goals for automated visual analysis of distributed object behaviour is to bring about a coherent understanding of partially observed uncertain sensory data from the past and present, and to ‘connect the dots’ in composing a big picture of global situational awareness for explaining away anomalies and discovering hidden patterns of significance. To that end, we consider the computational task and plausible models for modelling global behaviours and detecting global abnormal activities across distributed and disjoint multiple cameras. For constructing a global behaviour model for detecting holistic anomalies, besides model sensitivity and robustness, model tractability and scalability are of a great importance. A typical distributed camera network may consist of dozens to hundreds of cameras, many of which cover a wide-area scene of different distinctive activity semantic regions. In this chapter, we describe three different approaches to building a model for discovering and describing global behaviour patterns emerging from a distributed network of local activity regions. We examine their model characteristics for coping with uncertainty and complexity in temporal delays between activities observed in different camera views, and for maintaining a manageable computational cost and memory consumption.


Anomaly Detection Latent Dirichlet Allocation Global Behaviour Camera View Camera Network 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Auliac, C., Frouin, V., Gidrol, X., d’Alche-Buc, F.: Evolutionary approaches for the reverse-engineering of gene regulatory networks: a study on a biologically realistic dataset. BMC Bioinform. 9(91), 1–14 (2008) Google Scholar
  2. Baum, L.E., Petrie, T., Soules, G., Weiss, N.: A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41(1), 164–171 (1970) MathSciNetMATHCrossRefGoogle Scholar
  3. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006) MATHGoogle Scholar
  4. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003) MATHGoogle Scholar
  5. Buntine, W.: Theory refinement on Bayesian networks. In: Uncertainty in Artificial Intelligence, Los Angeles, USA, pp. 52–60 (1991) Google Scholar
  6. Chen, X., Anantha, G., Wang, X.: An effective structure learning method for constructing gene networks. Bioinformatics 22(11), 1367–1374 (2006) CrossRefGoogle Scholar
  7. Chen, X., Anantha, G., Lin, X.: Improving Bayesian network structure learning with mutual information-based node ordering in the K2 algorithm. IEEE Trans. Knowl. Data Eng. 20(5), 628–640 (2008) CrossRefGoogle Scholar
  8. Chow, C., Liu, C.: Approximating discrete probability distributions with dependence trees. IEEE Trans. Inf. Theory 14(3), 462–467 (1968) MathSciNetMATHCrossRefGoogle Scholar
  9. Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9(4), 309–347 (1992) MATHGoogle Scholar
  10. Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms. MIT Press, Cambridge (2009) MATHGoogle Scholar
  11. de Campos, C.P., Zeng, Z., Ji, Q.: Structure learning of Bayesian networks using constraints. In: International Conference on Machine Learning, pp. 113–120 (2009) Google Scholar
  12. Fraser, A.M., Swinney, H.L.: Independent coordinates for strange attractors from mutual information. Phys. Rev. 33(2), 1134–1140 (1986) MathSciNetMATHGoogle Scholar
  13. Friedman, N., Goldszmidt, M.: Sequential update of Bayesian network structure. In: Uncertainty in Artificial Intelligence, pp. 165–174 (1997) Google Scholar
  14. Friedman, N., Koller, D.: Being Bayesian about network structure. In: Uncertainty in Artificial Intelligence, pp. 201–210 (2000) Google Scholar
  15. Friedman, N., Nachman, I., Peér, D.: Learning Bayesian network structure from massive datasets: the “Sparse Candidate” algorithm. In: Uncertainty in Artificial Intelligence, pp. 206–215 (1999) Google Scholar
  16. Gilks, W.R., Richardson, S., Spiegelhalter, D. (eds.): Markov Chain Monte Carlo in Practice. Chapman & Hall, London (1995) Google Scholar
  17. Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: the combination of knowledge and statistical data. Mach. Learn. 20(3), 197–243 (1995) MATHGoogle Scholar
  18. Lam, W., Bacchus, F.: Using new data to refine a Bayesian network. In: Uncertainty in Artificial Intelligence, pp. 383–390 (1994) Google Scholar
  19. Li, J., Gong, S., Xiang, T.: Discovering multi-camera behaviour correlations for on-the-fly global activity prediction and anomaly detection. In: IEEE International Workshop on Visual Surveillance, Kyoto, Japan, October 2009 Google Scholar
  20. Loy, C.C., Xiang, T., Gong, S.: Multi-camera activity correlation analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, USA, June 2009, pp. 1988–1995 (2009) Google Scholar
  21. Loy, C.C., Xiang, T., Gong, S.: Time-delayed correlation analysis for multi-camera activity understanding. Int. J. Comput. Vis. 90(1), 106–129 (2010) CrossRefGoogle Scholar
  22. Murphy, K.P.: Active learning of causal Bayes net structure. Technical report, University of California, Berkeley (2001) Google Scholar
  23. Murphy, K.P.: Dynamic Bayesian networks: representation, inference and learning. PhD thesis, University of California at Berkeley (2002) Google Scholar
  24. Prim, R.C.: Shortest connection networks and some generalizations. Bell Syst. Tech. J. 36, 1389–1401 (1957) Google Scholar
  25. Schwarz, G.: Estimating the dimension of a model. Ann. Math. Stat. 6(2), 461–464 (1978) MATHCrossRefGoogle Scholar
  26. Zhou, H., Kimber, D.: Unusual event detection via multi-camera video mining. In: IEEE International Conference on Pattern Recognition, pp. 1161–1166 (2006) Google Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK
  2. 2.School of Electronic Engineering and Computer ScienceQueen Mary University of LondonLondonUK

Personalised recommendations