A Multi-agent System for Infrared and Color Video Fusion

  • José Manuel Gascueña
  • Juan Serrano-Cuerda
  • José Carlos Castillo
  • Antonio Fernández-Caballero
  • María T. López
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 293)


Nowadays, the use of heterogeneous cameras is preferred to develop robust monitoring systems. Under multi-camera setups, information fusion processes are required to improve the results independently obtained from each installed camera. In addition, multi-agent systems are designed to face up the development of complex systems such as advanced monitoring systems. This paper describes the use of INT 3 technologies to develop an agent-based robust people detection and tracking system completed by a scheme for infrared and color video fusion. The system development process covers from the modeling to the implementation of the system. The meaning of the levels selected by an analyst is detailed as well as the components required to fulfil the requirements for human detection and tracking. The proposed approach has the ability to make decisions about the convenience to fuse visible and infrared spectra information.


Multi-agent system Color video Infrared video Video fusion INT3 technologies 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Carneiro, D., Castillo, J.C., Novais, P., Fernández-Caballero, A., Neves, J.: Multimodal behavioral analysis for non-invasive stress detection. Expert Systems with Applications 39(18), 13376–13389 (2012)CrossRefGoogle Scholar
  2. 2.
    Castanedo, F., García, J., Patricio, M.A., Molina, J.: A multi-agent architecture based on the BDI model for data fusion in visual sensor networks. Journal of Intelligent and Robotic Systems 62(3-4), 299–328 (2011)CrossRefGoogle Scholar
  3. 3.
    Costa, A., Castillo, J.C., Novais, P., Fernández-Caballero, A., Simoes, R.: Sensor-driven agenda for intelligent home care of the elderly. Expert Systems with Applications 39(15), 12192–12204 (2012)CrossRefGoogle Scholar
  4. 4.
    Chiaretta, S., Nayyeri, K.: Beginning ASP.NET MVC 1.0. Wiley Publishing, Inc. (2009)Google Scholar
  5. 5.
    Fernández-Caballero, A., Castillo, J.C., Serrano-Cuerda, J., Maldonado-Bascón, S.: Real-time human segmentation in infrared videos. Expert Systems with Applications 38(3), 2577–2584 (2011)CrossRefGoogle Scholar
  6. 6.
    Fernández-Caballero, A., López, M.T., Carmona, E.J., Delgado, A.E.: A historical perspective of algorithmic lateral inhibition and accumulative computation in computer vision. Neurocomputing 74(8), 1175–1181 (2011)CrossRefGoogle Scholar
  7. 7.
    Fernández-Caballero, A., Castillo, J.C., López, M., Sokolova, M.V.: INT3-Horus framework for multispectrum activity interpretation in intelligent environments. Expert Systems with Applications 40(17), 6715–6727 (2013)CrossRefGoogle Scholar
  8. 8.
    Gascueña, J.M., Fernández-Caballero, A.: Agent-oriented modeling and development of a person-following mobile robot. Expert Systems with Applications 38(4), 4280–4290 (2011)CrossRefGoogle Scholar
  9. 9.
    Gascueña, J.M., Castillo, J.C., Navarro, E., Fernández-Caballero, A.: Engineering the development of systems for multisensory monitoring and activity interpretation. Int. J. of Systems Science 45(4), 728–740 (2014)CrossRefzbMATHGoogle Scholar
  10. 10.
    Hammoud, R.I.: Augmented vision perception in infrared: Algorithms and applied systems. Springer (2009)Google Scholar
  11. 11.
    Lewis, J.J., O’ Callaghan, R.J., Nikolov, S.G., Bull, D.R., Canagarajah, N.: Pixel- and region-based image fusion with complex wavelets. Information Fusion 8(2), 119–130 (2007)CrossRefGoogle Scholar
  12. 12.
    Luo, R.C., Kay, M.G.: Data fusion and sensor integration: State of the art 1990s. In: Abidi, M.A., Gonzalez, R.C. (eds.) Data Fusion in Robotics and Machine Intelligence, pp. 7–135. Academic Press, San Diego (1992)Google Scholar
  13. 13.
    Muñoz-Salinas, R., Aguirre, E., García-silvente, M., Ayesh, A., Góngora, M.: Multi-agent system for people detection and tracking using stereo vision in mobile robots. Robotica 27(5), 715–727 (2009)CrossRefGoogle Scholar
  14. 14.
    Pavón, J., Gómez-Sanz, J., Fernández-Caballero, A., Valencia-Jiménez, J.J.: Development of intelligent multisensor surveillance systems with agents. Robotics and Autonomous Systems 55(12), 892–903 (2007)CrossRefGoogle Scholar
  15. 15.
    Reenskaug, T.: Thing-Model-View-Editor - An example from a planning system. Technical note, Xerox PARC (1979)Google Scholar
  16. 16.
    Serrano-Cuerda, J., María, T., López, M., Fernández-Caballero, A.: Robust Human Detection and Tracking in Intelligent Environments by Information Fusion of Color and Infrared Video. In: 7th Int. Conf. on Intelligent Environments, pp. 354–357 (2011)Google Scholar
  17. 17.
    Stefano, L., Tombari, F., Lisi, E., Mattoccia, S.: Robust and accurate change detection under sudden illumination variations. In: Workshop on Multi-dimensional and Multi-view Image Processing, pp. 103–109 (2007)Google Scholar
  18. 18.
    Weyns, D.: Architecture-based design of multi-agent systems. Springer (2010)Google Scholar
  19. 19.
    Wooldridge, M.: An Introduction to MultiAgent Systems, 2nd edn. John Wiley & Sons (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • José Manuel Gascueña
    • 1
  • Juan Serrano-Cuerda
    • 1
  • José Carlos Castillo
    • 2
  • Antonio Fernández-Caballero
    • 1
  • María T. López
    • 1
  1. 1.Departamento de Sistemas Informáticos & Instituto de Investigación en Informática de AlbaceteUniversidad de Castilla-La ManchaAlbaceteSpain
  2. 2.Departamento de Ingeniería de Sistemas y AutomáticaUniversidad Carlos III de MadridLeganésSpain

Personalised recommendations