Skip to main content

Building Visual Surveillance Systems with Neural Networks

  • Chapter
  • First Online:
Computational Intelligence for Privacy and Security

Part of the book series: Studies in Computational Intelligence ((SCI,volume 394))

Abstract

Self-organising neural networks have shown promise in a variety of applications areas. Their massive and intrinsic parallelism makes those networks suitable to solve hard problems in image-analysis and computer vision applications, especially when non-stationary environments occur. Moreover, this kind of neural networks preserves the topology of an input space by using their inherited competitive learning property. In this work we use a kind of self-organising network, the Growing Neural Gas, to solve some computer vision tasks applied to visual surveillance systems. The neural network is also modified to accelerate the learning algorithm in order to support applications with temporal constraints. This feature has been used to build a system able to track image features in video sequences. The system automatically keeps the correspondence of features among frames in the sequence using its own structure. Information obtained during the tracking process and allocated in the neural network can also be used to analyse the objects motion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hu, W., Tan, T., Wang, L., Maybank, S.: A Survey on Visual Surveillance of Object Mo-tion Behaviors. IEEE Transactions on Systems, Man and Cybernetics 34(3), 334–352 (2004)

    Article  Google Scholar 

  2. Haritaoglu, H., Harwood, D., Davis, L.S.: W4: Who? When? Where? What? A Real Time System for Detecting and Tracking People. In: Proceedings of the International Conference on Automatic Face and Gesture Recognition, pp. 222–227 (1998)

    Google Scholar 

  3. Wren, C., Azarbayejani, A., Darell, T., Pentland, A.: Pfinder: Real-Time Tracking of the Human Body. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997)

    Article  Google Scholar 

  4. Olson, T., Brill, F.: Moving Object Detection and Event Recognition Algorithms for Smart Cameras. In: Proc. DARPA Image Understanding Workshop, pp. 159–175 (1997)

    Google Scholar 

  5. Lipton, A.J., Fujioshi, H., Patil, R.S.: Moving Target Classification and Tracking from Real-Time Video. In: Proc. IEEE Workshop Applications of Computer Vision, pp. 8–14 (1998)

    Google Scholar 

  6. Collins, T., Lipton, A.J., Kanade, T.: Introduction to the special section on video sur-veillance. IEEE Trans. Pattern Anal. Machine Intell. 22, 745–746 (2000)

    Article  Google Scholar 

  7. Howarth, R.J., Buxton, H.: Conceptual descriptions from monitoring and watching im-age sequences. Image and Vision Computing 18(9), 105–135 (2000)

    Article  Google Scholar 

  8. Hu, W., Xie, D., Nan, T.N.: A Hierarchical Self-Organizing Approach for Learning the Patterns of Motion Trajectories. Chin. J. Comput. 26(4), 417–426 (2003)

    Google Scholar 

  9. Buxton, H.: Learning and Understanding dynamic scene activity: a review. Image. Vis. Comput. 21(1), 125–136 (2003)

    Article  Google Scholar 

  10. Bremond, F., Thonnat, M., Zuñiga, M.: Video understanding framework for automatic behaviour recognition. Behav. Res. Meth. (2006)

    Google Scholar 

  11. Brand, M., Kettnaker, V.: Discovery and Segmentation of Activities in Video. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 844–885 (2000)

    Article  Google Scholar 

  12. Makris, D., Ellis, T.: Learning semantic scene models from observating activity in vis-ual surveillance. IEEE Trans. Syst. Man Cybern. 35(3), 397–408 (2005)

    Article  Google Scholar 

  13. Mckenna, S.J., Nait Charif, H.: Summarising contextual activity and detecting unsual inac-tivity in a supportive home environment. Pattern Anal. Appl. 7(4), 386–401 (2004)

    Article  Google Scholar 

  14. Stauffer, C.: Estimating tracking sources and sinks. In: Proceedings of 2nd IEEE workshop of event mining, pp. 259–266 (2003)

    Google Scholar 

  15. Dee, H.M., Velastin, S.: How close are we to solving the problem of automated visual surveillance? Machine Vision and Applications 19, 329–343 (2008)

    Article  Google Scholar 

  16. Fritzke, B.: A Self-Organizing Network that Can Follow Non-stationary Distributions. In: Proceedings of the 7th International Conference on Artificial Neural Networks, pp. 613–618 (1997)

    Google Scholar 

  17. Fritzke, B.: A Growing Neural Gas Network Learns Topologies. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 625–632. MIT Press (1995)

    Google Scholar 

  18. Frezza-Buet, H.: Following Non-stationary Distributions by Controlling the Vector Quatization Accuracy of a Growing Neural Gas Network. Neurocomputing 71, 1191–1202 (2008)

    Article  Google Scholar 

  19. Stergiopoulou, E., Papamarkos, N., Atsalakis, A.: Hand Gesture Recognition Via a New Self-Organized Neural Network. In: Sanfeliu, A., Cortés, M.L. (eds.) CIARP 2005. LNCS, vol. 3773, pp. 891–904. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  20. Cao, X., Suganthan, P.N.: Video Shot Motion Characterization Based on Hierachical Overlapped Growing Neural Gas Networks. Multimedia Systems 9, 378–385 (2003)

    Article  Google Scholar 

  21. García, J., Flórez-Revuelta, F., García, J.M.: Growing Neural Gas for Vision Tasks with Time Restrictions. In: Kollias, S.D., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 578–586. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  22. Martinetz, T., Shulten, K.: Topology Representing Networks. Neural Networks 7(3), 507–522 (1994)

    Article  Google Scholar 

  23. Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (2001)

    Book  MATH  Google Scholar 

  24. Welch, G., Bishop, G.: An Introduction to the Kalman Filter. In: ACM SIGGRAPH, Course 8 (2001), http://www.cs.unc.edu/~welch/kalman/,2001

  25. Ristic, B., Arulampalam, S., Gordon, N.: Beyond the Kalman Filter. Particle Filters for Tracking Applications. Artech House (2004)

    Google Scholar 

  26. Han, M., Xu, W., Tao, H., Gong, Y.: An Algorithm for Multiple Object Trajectory Tracking. In: Proceedings of IEEE Computer Vision and Pattern Recognition Conference (2004)

    Google Scholar 

  27. Hue, C., Le Cadre, J.C., Pérez, P.: Tracking Multiple Objects with Particle Filtering. IEEE Transactions on Aerospace and Electronic Systems 38(3), 791–812 (2002)

    Article  Google Scholar 

  28. Sullivan, J., Carlsson, S.: Tracking and Labelling of Interacting Multiple Targets. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 619–632. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  29. Huang, Y., Essa, I.: Tracking Multiple Objects trough Occlusions. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (2005)

    Google Scholar 

  30. Fisher, R.B.: PETS 2004 Surveillance Ground Truth Data Set. In: Proc. Sixth IEEE Int. Work. on Performance Evaluation of Tracking and Surveillance (PETS 2004), pp. 1–5 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. García-Rodríguez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

García-Rodríguez, J., Angelopoulou, A., Mora-Gimeno, F.J., Psarrou, A. (2012). Building Visual Surveillance Systems with Neural Networks. In: Elizondo, D., Solanas, A., Martinez-Balleste, A. (eds) Computational Intelligence for Privacy and Security. Studies in Computational Intelligence, vol 394. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25237-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25237-2_11

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25236-5

  • Online ISBN: 978-3-642-25237-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics