Advertisement

Multi-Agent Framework in Visual Sensor Networks

  • M. A. Patricio
  • J. Carbó
  • O. Pérez
  • J. García
  • J. M. Molina
Open Access
Research Article
Part of the following topical collections:
  1. Visual Sensor Networks

Abstract

The recent interest in the surveillance of public, military, and commercial scenarios is increasing the need to develop and deploy intelligent and/or automated distributed visual surveillance systems. Many applications based on distributed resources use the so-called software agent technology. In this paper, a multi-agent framework is applied to coordinate videocamera-based surveillance. The ability to coordinate agents improves the global image and task distribution efficiency. In our proposal, a software agent is embedded in each camera and controls the capture parameters. Then coordination is based on the exchange of high-level messages among agents. Agents use an internal symbolic model to interpret the current situation from the messages from all other agents to improve global coordination.

Keywords

Sensor Network Surveillance System Quantum Information Recent Interest Visual Sensor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Airport Surface Detection Equipment Model X (ASDE-X), http://www.sensis.com/docs/128
  2. 2.
    Weber ME, Stone ML: Low altitude wind shear detection using airport surveillance radars. IEEE Aerospace and Electronic Systems Magazine 1995,10(6):3-9. 10.1109/62.387970CrossRefGoogle Scholar
  3. 3.
    Pozzobon A, Sciutto G, Recagno V: Security in ports: the user requirements for surveillance system. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998.Google Scholar
  4. 4.
    Avis P: Surveillance and Canadian maritime domestic security. Canadian Military Journal 2003,4(1):9-15.MathSciNetGoogle Scholar
  5. 5.
    Lo BPL, Sun J, Velastin SA: Fusing visual and audio information in a distributed intelligent surveillance system for public transport systems. Acta Automatica Sinica 2003,29(3):393-407.Google Scholar
  6. 6.
    Nwagboso C: User focused surveillance systems integration for intelligent transport systems. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998:8-12. chapter 1.1Google Scholar
  7. 7.
    ADVISOR specification documents (internal classification 2001)Google Scholar
  8. 8.
  9. 9.
    Ronetti N, Dambra C: Railway station surveillance: the Italian case. In Multimedia Video Based Surveillance Systems. Edited by: Foresti GL, Mahonen P, Regazzoni CS. Kluwer Academic, Boston, Mass, USA; 2000:13-20.CrossRefGoogle Scholar
  10. 10.
    Pellegrini M, Tonani P: Highway traffic monitoring. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998.Google Scholar
  11. 11.
    Beymer D, McLauchlan P, Coifman B, Malik J: A real-time computer vision system for measuring traffic parameters. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '97), June 1997, San Juan, Puerto Rico, USA 495-502.CrossRefGoogle Scholar
  12. 12.
    Zhi-Hong Z: Lane detection and car tracking on the highway. Acta Automatica Sinica 2003,29(3):450-456.Google Scholar
  13. 13.
    Jian-Guang L, Qi-Feing L, Tie-Niu T, Wei-Ming H: 3-D model based visual traffic surveillance. Acta Automatica Sinica 2003,29(3):434-449.Google Scholar
  14. 14.
    Ferryman JM, Maybank SJ, Worrall AD: Visual surveillance for moving vehicles. International Journal of Computer Vision 2000,37(2):187-197. 10.1023/A:1008155721192CrossRefMATHGoogle Scholar
  15. 15.
  16. 16.
  17. 17.
  18. 18.
    Brodsky T, Cohen R, Cohen-Solal E, et al.: Visual surveillance in retail stores and in the home. In Advanced Video-based Surveillance Systems. Kluwer Academic, Boston, Mass, USA; 2001:50-61. chapter 4Google Scholar
  19. 19.
    Cucchiara R, Grana C, Prati A, Tardini G, Vezzani R: Using computer vision techniques for dangerous situation detection in domotic applications. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '04), February 2004, London, UK 1-5.CrossRefGoogle Scholar
  20. 20.
    Greenhill D, Remagnino P, Jones GA: VIGILANT: content querying of video surveillance streams. In Video-Based Surveillance Systems. Edited by: Remagnino P, Jones GA, Paragios N, Regazzoni CS. Kluwer Academic, Boston, Mass, USA; 2002:193-205.CrossRefGoogle Scholar
  21. 21.
    Micheloni C, Foresti GL, Snidaro L: A co-operative multicamera system for video-surveillance of parking lots. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '03), February 2003, London, UK 21-24.Google Scholar
  22. 22.
    Boult TE, Micheals RJ, Gao X, Eckmann M: Into the woods: visual surveillance of noncooperative and camouflaged targets in complex outdoor settings. Proceedings of the IEEE 2001,89(10):1382-1401. 10.1109/5.959337CrossRefGoogle Scholar
  23. 23.
    Xu M, Lowey L, Orwell J: Architecture and algorithms for tracking football players with multiple cameras. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '04), February 2004, London, UK 51-56.CrossRefGoogle Scholar
  24. 24.
    Krumm J, Harris S, Meyers B, Brumit B, Hale M, Shafer S: Multi-camera multi-person tracking for easy living. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 3-10.CrossRefGoogle Scholar
  25. 25.
    Heikkilä J, Silvén O: A real-time system for monitoring of cyclists and pedestrians. Proceedings of 2nd IEEE International Workshop on Visual Surveillance (VS '99), 1999, Fort Collins, Colo, USA 74-81.CrossRefGoogle Scholar
  26. 26.
    Haritaoglu I, Harwood D, Davis LS:Open image in new window: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):809-830. 10.1109/34.868683CrossRefGoogle Scholar
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
    Haritaoglu I, Harwood D, Davis LS: Hydra: multiple people detection and tracking using silhouettes. Proceedings of 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 6-13.CrossRefGoogle Scholar
  34. 34.
    Batista J, Peixoto P, Araujo H: Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking. Proceedings of the IEEE Workshop on Visual Surveillance (VS '98), January 1998, Bombay, India 18-25.Google Scholar
  35. 35.
    Ivanov Y, Bobick A, Liu J: Fast lighting independent background subtraction. International Journal of Computer Vision 2000,37(2):199-207. 10.1023/A:1008107805263CrossRefMATHGoogle Scholar
  36. 36.
    Pless R, Brodsky T, Aloimonos Y: Detecting independent motion: the statistics of temporal continuity. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):768-773. 10.1109/34.868679CrossRefGoogle Scholar
  37. 37.
    Liu L-C, Chien J-C, Chuang HY-H, Li CC: A frame-level FSBM motion estimation architecture with large search range. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA 327-333.Google Scholar
  38. 38.
    Remagnino P, Baumberg A, Grove T, et al.: An integrated traffic and pedestrian model-based vision system. Proceedings of the British Machine Vision Conference (BMVC '97), 1997, Essex, UK 380-389.Google Scholar
  39. 39.
    Ng KC, Ishiguro H, Trivedi M, Sogo T: Monitoring dynamically changing environments by ubiquitous vision system. Proceedings of 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 67-74.CrossRefGoogle Scholar
  40. 40.
    Orwell J, Remagnino P, Jones GA: Multi-camera colour tracking. Proceedings of the 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 14-21.CrossRefGoogle Scholar
  41. 41.
    Darrell T, Gordon G, Woodfill J, Baker H, Harville M: Robust real-time people tracking in open environments using integrated stereo, color, and face detection. Proceedings of the 3rd IEEE Workshop on Visual Surveillance (VS '98), January 1998, Bombay, India 26-33.Google Scholar
  42. 42.
    Rota N, Thonnat M: Video sequence interpretation for visual surveillance. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 59-68.CrossRefGoogle Scholar
  43. 43.
    Owens J, Hunter A: Application of the self-organising map to trajectory classification. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 77-83.CrossRefGoogle Scholar
  44. 44.
    Stauffer C, Grimson WEL: Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):747-757. 10.1109/34.868677CrossRefGoogle Scholar
  45. 45.
    Stringa E, Regazzoni CS: Content-based retrieval and real time detection from video sequences acquired by surveillance systems. Proceedings of the IEEE International Conference on Image Processing (ICIP '98), October 1998, Chicago, Ill, USA 3: 138-142.Google Scholar
  46. 46.
    Decleir C, Hacid M-S, Koulourndijan J: A database approach for modeling and querying video data. Proceedings of the 15th International Conference on Data Engineering (ICDE '99), March 1999, Sydney, Australia 1-22.Google Scholar
  47. 47.
    Makris D, Ellis T, Black J: Bridging the gaps between cameras. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), June-July 2004, Washington, DC, USA 2: 205-210.Google Scholar
  48. 48.
    Black J, Ellis T, Rosin P: A novel method for video tracking performance evaluation. Proceedings of the IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, October 2003, Nice, France 125-132.Google Scholar
  49. 49.
    Valera M, Velastin SA: Intelligent distributed surveillance systems: a review. IEE Proceedings: Vision, Image and Signal Processing 2005,152(2):192-204. 10.1049/ip-vis:20041147Google Scholar
  50. 50.
    Shoham Y: Agent-oriented programming. Artificial Intelligence 1993,60(1):51-92. 10.1016/0004-3702(93)90034-9MathSciNetCrossRefGoogle Scholar
  51. 51.
    Newell A: Unified Theories of Cognition. Harvard University Press, Cambridge, Mass, USA; 1990.Google Scholar
  52. 52.
    Brooks RA: A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation 1986,2(1):14-23.CrossRefGoogle Scholar
  53. 53.
    Labrou Y, Finin T, Peng Y: Agent communication languages: the current landscape. IEEE Intelligent Systems & Their Applications 1999,14(2):45-52. 10.1109/5254.757631CrossRefGoogle Scholar
  54. 54.
    Rao A, Georgeff M: BDI agents: from theory to practice. In Proceedings of the 1st International Conference on Multi-Agent Systems (ICMAS '95), June 1995, San Francisco, Calif, USA. Edited by: Lesser V. The MIT Press; 312-319.Google Scholar
  55. 55.
    Pokahr A, Braubach L, Lamersdorf W: Jadex: implementing a BDI-infrastructure for JADE agents. EXP - In Search of Innovation (Special Issue on JADE), September 2003 3(3):76-85. http://vsis-www.informatik.uni-hamburg.de/projects/jadex/Google Scholar
  56. 56.
    Bellifemine F, Poggi A, Rimassa G: Developing multi-agent systems with JADE. Proceedings of the 7th International Workshop Agent Theories Architectures and Languages (ATAL '00), July 2000, Boston, Mass, USA 89-103. http://jade.tilab.com/Google Scholar
  57. 57.
    Nguyen NT, Venkatesh S, West G, Bui HH: Multiple camera coordination in a surveillance system. Acta Automatica Sinica 2003,29(3):408-422.Google Scholar
  58. 58.
    Bui HH, Venkatesh S, West GAW: Tracking and surveillance in wide-area spatial environments using the abstract hidden Markov model. International Journal of Pattern Recognition and Artificial Intelligence 2001,15(1):177-196. 10.1142/S0218001401000782CrossRefGoogle Scholar
  59. 59.
    Rath TM, Manmatha R: Features for word spotting in historical manuscripts. Proceedings of the 7th International Conference on Document Analysis and Recognition (ICDAR '03), August 2003, Edinburgh, Scotland 1: 218-222.Google Scholar
  60. 60.
    Oates T, Schmill MD, Cohen PR: A method for clustering the experiences of a mobile robot that accords with human judgments. In Proceedings of the 7th National Conference on Artificial Intelligence and 12th Conference on Innovative Applications of Artificial Intelligence, July-August 2000, Austin, Tex, USA. AAAI Press; 846-851.Google Scholar
  61. 61.
    Nguyen NT, Bui HH, Venkatesh S, West G: Recognising and monitoring high-level behaviours in complex spatial environments. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), June 2003, Madison, Wis, USA 2: 620-625.Google Scholar
  62. 62.
    Ivanov YA, Bobick AF: Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):852-872. 10.1109/34.868686CrossRefGoogle Scholar
  63. 63.
    Pavlidis I, Morellas V, Tsiamyrtzis P, Harp S: Urban surveillance systems: from the laboratory to the commercial world. Proceedings of the IEEE 2001,89(10):1478-1497. 10.1109/5.959342CrossRefGoogle Scholar
  64. 64.
    Collins RT, Lipton AJ, Kanade T, et al.: A system for video surveillance and monitoring. In Tech. Rep. CMU-RI-TR-00-12. Robotics Institute, Carnegie Mellon University, Pittsburgh, Pa, USA; 2000.Google Scholar
  65. 65.
    Regazzoni CS, Ramesh V, Foresti GL: Special issue on video communications, processing, and understanding for third generation surveillance systems. Proceedings of the IEEE 2001,89(10):1355-1539.CrossRefGoogle Scholar
  66. 66.
    Christensen M, Alblas R: V2- design issues in distributed video surveillance systems. Department of Computer Science, Aalborg University, Aalborg, Denmark; 2000.Google Scholar
  67. 67.
    Collins RT, Lipton AJ, Fujiyoshi H, Kanade T: Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE 2001,89(10):1456-1477. 10.1109/5.959341CrossRefGoogle Scholar
  68. 68.
    Yuan X, Sun Z, Varol Y, Bebis G: A distributed visual surveillance system. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA 199-205.Google Scholar
  69. 69.
    Pavlidis I, Morellas V: Two examples of indoor and outdoor surveillance systems. In Video Based Surveillance Systems: Computer Vision and Distributed Processing. Edited by: Remagnino P, Graeme JA, Paragios N, Regazzoni C. Kluwer Academic, Boston, Mass, USA; 2002:39-50.CrossRefGoogle Scholar
  70. 70.
    Besada JA, García J, Portillo J, Molina JM, Varona A, Gonzalez G: Airport surface surveillance based on video images. IEEE Transactions on Aerospace and Electronic Systems 2005,41(3):1075-1082. 10.1109/TAES.2005.1541452CrossRefGoogle Scholar
  71. 71.
    García J, Molina JM, Besada JA, Portillo JI: A multitarget tracking video system based on fuzzy and neuro-fuzzy techniques. EURASIP Journal on Applied Signal Processing 2005,2005(14):2341-2358. special issue on Advances in Intelligent Vision Systems: Methods and Applications 10.1155/ASP.2005.2341CrossRefMATHGoogle Scholar
  72. 72.
    García J, Pérez O, Berlanga A, Molina JM: An evaluation metric for adjusting parameters of surveillance video systems. In Focus on Robotics and Intelligent Systems Research. Nova Science, New York, NY, USA; 2004.Google Scholar
  73. 73.
    Pérez O, García J, Berlanga A, Molina JM: Evolving parameters of surveillance video systems for non-overfitted learning. Proceedings of the 7th European Workshop on Evolutionary Computation in Image Analysis and Signal Processing (EvoIASP '05), March-April 2005, Lausanne, Switzerland 386-395.Google Scholar
  74. 74.
    Varshney PK, Coman IL: Distributed multi-sensor surveillance: issues and recent advances. In Video-Based Surveillance Systems. Computer Vision and Distributed Processing. Kluwer Academic, Boston, Mass, USA; 2002:239-250.CrossRefGoogle Scholar
  75. 75.
    Marchesotti L, Piva S, Regazzoni C: An agent-based approach for tracking people in indoor complex environments. Proceedings of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 99-102.Google Scholar
  76. 76.
    Bratman M: Intention, Plans, and Practical Reason. Harvard University Press, Cambridge, Mass, USA; 1987.Google Scholar
  77. 77.
    Braubach L, Pokahr A, Moldt D, Lamersdorf W: Goal representation for BDI agent systems. Proceedings of the 2nd Workshop on Programming Multiagent Systems: Languages, Frameworks, Techniques, and Tools (ProMAS '04), July 2004, New York, NY, USAGoogle Scholar
  78. 78.
    Carbó J, Orfila A, Ribagorda A: Adaptive agents applied to intrusion detection. In Proceedings of the 3rd International Central and Eastern European Conference on Multi-Agent Systems (CEEMAS '03), June 2003, Prague, Czech Republic, Lecture Notes in Artificial Intelligence. Volume 2691. Springer; 445-453.Google Scholar

Copyright information

© M. A. Patricio et al. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Authors and Affiliations

  • M. A. Patricio
    • 1
  • J. Carbó
    • 1
  • O. Pérez
    • 1
  • J. García
    • 1
  • J. M. Molina
    • 1
  1. 1.Grupo de Inteligencia Artificial Aplicada, Departamento de InformáticaUniversidad Carlos III de MadridMadridSpain

Personalised recommendations