Advertisement

Markovian Agent Models: A Dynamic Population of Interdependent Markovian Agents

  • Andrea Bobbio
  • Davide Cerotti
  • Marco GribaudoEmail author
  • Mauro Iacono
  • Daniele Manini
Chapter
First Online:
Part of the Simulation Foundations, Methods and Applications book series (SFMA)

Abstract

A Markovian Agent Model (MAM) is an agent-based spatio-temporal analytical formalism aimed to model a collection of interacting entities, called Markovian Agents (MA), guided by stochastic behaviours. An MA is characterized by a finite number of states over which a transition kernel is defined. Transitions can either be local, or induced by the state of other agents in the system. Agents operate in a space that can be either continuous, or composed by a discrete number of locations. MAs may belong to different classes and each class can be parametrized depending on the location in the geographical (or abstract) space. In this work, we provide a very general analytical formulation of an MAM that encompasses many forms of physical dependencies among objects and many ways in which the spatial density may change in time. We revisit recent literature to show how previous works can be cast in terms of this more general MAM formulation.

Keywords

Agent-based model Spatially distributed systems Performance modelling 
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Ball F, Milne R, Tame I, Yeo G (1997) Superposition of interacting aggregated continuous-time Markov chains. Adv Appl Probab 29:56–91MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Bobbio A, Gribaudo M, Telek M (2008) Analysis of large scale interacting systems by mean field method. In: 5th international conference on quantitative evaluation of systems—QEST2008. St. MaloGoogle Scholar
  3. 3.
    Bruneo D, Scarpa M, Bobbio A, Cerotti D, Gribaudo M (2012) Markovian agent modeling swarm intelligence algorithms in wireless sensor networks. Perform Eval 69:135–149CrossRefGoogle Scholar
  4. 4.
    Bruneo D, Scarpa M, Bobbio A, Cerotti D, Gribaudo M (2015) An intelligent swarm of markovian agents. In: Springer handbook of computational intelligence, pp 1345–1359Google Scholar
  5. 5.
    Castiglione A, Gribaudo M, Iacono M, Palmieri F (2015) Modeling performances of concurrent big data applications. Softw Pract Exp 45(8):1127–1144. doi: 10.1002/spe.2269 Google Scholar
  6. 6.
    Cerotti D, Gribaudo M, Bobbio A (2009) Disaster propagation in inhomogeneous media via markovian agents. In: Critical information infrastructure security, vol 5508, pp 328–335. Springer LNCS (2009)Google Scholar
  7. 7.
    Cerotti D, Gribaudo M, Bobbio A (2009) Presenting dynamic markovian agents with a road tunnel application. In: 17th annual meeting of the IEEE/ACM international symposium on modelling, analysis and simulation of computer and telecommunication systems, MASCOTS 2009, September 21–23, 2009, South Kensington Campus, Imperial College London, pp 1–4Google Scholar
  8. 8.
    Cerotti D, Gribaudo M, Bobbio A (2014) Markovian agents models for wireless sensor networks deployed in environmental protection. Rel Eng Syst Saf 130:149–158CrossRefGoogle Scholar
  9. 9.
    Cerotti D, Gribaudo M, Bobbio A, Calafate CMT, Manzoni P (2010) A markovian agent model for fire propagation in outdoor environments. In: Computer Performance Engineering—7th European Performance Engineering Workshop, EPEW 2010, Bertinoro, Italy, September 23–24, 2010. Proceedings, pp 131–146Google Scholar
  10. 10.
    Ciardo G, Muppala J, Trivedi K (1991) On the solution of GSPN reward models. Perform Eval 12:237–253CrossRefzbMATHGoogle Scholar
  11. 11.
    Cordero F, Fornari C, Gribaudo M, Manini D (2014) Markovian agents population models to study cancer evolution. In: Analytical and stochastic modelling techniques and applications—21st international conference, ASMTA 2014, Budapest, Hungary, June 30–July 2, 2014. Proceedings, pp 16–32Google Scholar
  12. 12.
    Deneubourg Aron S, Goss S, Pasteels JM (1990) The self-organizing exploratory pattern of the argentine ant. J Insect Behav 3(2):159–168. doi: 10.1007/BF01417909 Google Scholar
  13. 13.
    Dorigo M, Stützle T (2004) Ant colony optimization. MIT PressGoogle Scholar
  14. 14.
    Edwards J, Palsson B (1998) How will bioinformatics influence metabolic engineering? Biotechnol Bioeng 58(2–3):162–169CrossRefGoogle Scholar
  15. 15.
    Gilmore S, Hillston J, Kloul L, Ribaudo M (2003) PEPA nets: a structured performance modelling formalism. Perform Eval 54(2):79–104. http://www.sciencedirect.com/science/article/pii/S0166531603000695 Google Scholar
  16. 16.
    Goss S, Aron S, Deneubourg J, Pasteels J (1989) Self-organized shortcuts in the Argentine ant. Naturwissenschaften 76(12):579–581. doi: 10.1007/BF00462870 Google Scholar
  17. 17.
    Gribaudo M, Cerotti D, Bobbio A (2008) Analysis of on-off policies in sensor networks using interacting Markovian agents. In: 4th international work sensor networks and systems for pervasive computing—PerSens 2008, pp 300–305Google Scholar
  18. 18.
    Gribaudo M, Chiasserini CF, Gaeta R, Garetto M, Manini D, Sereno M (2005) A spatial fluid-based framework to analyze large-scale wireless sensor networks. In: IEEE international conference on dependable systems and networks, DSN2002Google Scholar
  19. 19.
    Gribaudo M, Manini D, Chiasserini C (2013) Studying mobile internet technologies with agent based mean-field models. In: Analytical and stochastic modelling techniques and applications—20th international conference, ASMTA 2013, Ghent, Belgium, July 8–10, 2013. Proceedings, pp 112–126Google Scholar
  20. 20.
    Guenther, M.C., Bradley, J.T.: Higher moment analysis of a spatial stochastic process algebra. In: Computer Performance Engineering, pp. 87–101. Springer - LNCS, Vol 6977, Springer (2011)Google Scholar
  21. 21.
    Hillston J (2005) Fluid flow approximation of PEPA models. In: 2nd international conference on quantitative evaluation of systems—QEST, pp 33–43Google Scholar
  22. 22.
    Horton G, Kulkarni VG, Nicol DM, Trivedi KS (1998) Fluid stochastic petri nets: theory, application, and solution techniques. Eur J Oper Res 105(1):184–201CrossRefzbMATHGoogle Scholar
  23. 23.
    Kaâniche M, Lollini P, Bondavalli A, Kanoun K (2012) Modeling the resilience of large and evolving systems. CoRR abs/1211.5738Google Scholar
  24. 24.
    Kurtz T (1981) Approximation of population processes. Soc Ind Appl Math. http://epubs.siam.org/doi/abs/10.1137/1.9781611970333
  25. 25.
    Plateau B, Atif K (1991) Stochastic automata network for modeling parallel systems. IEEE Trans Softw Eng 17:1093–1108MathSciNetCrossRefGoogle Scholar
  26. 26.
    Sheng-hai A, Byung-Hyug L, Dong-Ryeol S (2011) A survey of intelligent transportation systems. In: 2011 Third international conference on computational intelligence, communication systems and networks (CICSyN), pp 332–337Google Scholar
  27. 27.
    Sukhwani H, Bobbio A, Trivedi K (2015) Largeness avoidance in availability modeling using hierarchical and fixed-point iterative techniques. Int J Perform Eng 11(4):305–319Google Scholar
  28. 28.
    Tomek L, Trivedi K (1991) Fixed point iteration in availability modeling. In: Cin M, Hohl W (eds) Fault-Tolerant Computing Systems, Informatik-Fachberichte, vol 283. Springer, Berlin, pp 229–240CrossRefGoogle Scholar
  29. 29.
    Trivedi KS (2002) Probability and statistics with reliability, queuing and computer science applications. Wiley, ChichesterzbMATHGoogle Scholar
  30. 30.
    Trivedi KS, Ma X, Dharmaraja S (2003) Performability modelling of wireless communication systems. Int J Commun Syst 16(6):561–577. doi: 10.1002/dac.605 Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Andrea Bobbio
    • 1
  • Davide Cerotti
    • 2
  • Marco Gribaudo
    • 2
    Email author
  • Mauro Iacono
    • 3
  • Daniele Manini
    • 4
  1. 1.Università del Piemonte OrientaleAlessandriaItaly
  2. 2.Politecnico di MilanoMilanItaly
  3. 3.Seconda Università di NapoliCasertaItaly
  4. 4.Università di TorinoTurinItaly

Personalised recommendations

Cite chapter

Buy options