Recently a great number of methods and frameworks to develop multiagent systems have appeared. It makes difficult the selection between one and another. Because of that the evaluation of multiagent system software engineering techniques is an open research topic. This paper presents an evaluation framework for analyzing and comparing methods and tools for developing multiagent systems. Furthermore, four examples of usage are presented and analyzed.


Software Engineering Modeling Language Multiagent System None None Development Tool 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bordini, R.H., Dastani, M., Winikoff, M.: Current issues in multi-agent systems development (invited paper). In: O’Hare, G.M.P., Ricci, A., O’Grady, M.J., Dikenelli, O. (eds.) ESAW 2006. LNCS, vol. 4457, pp. 38–61. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  2. 2.
    Lin, C.E., Kavi, K.M., Sheldon, F.T., Daley, K.M., Abercrombie, R.K.: A methodology to evaluate agent oriented software engineering techniques. In: HICSS 2007: Proceedings of the 40th Annual Hawaii International Conference on System Sciences, p. 60. IEEE Computer Society, Los Alamitos (2007)CrossRefGoogle Scholar
  3. 3.
    Punter, T., Kusters, R., Trienekens, J., Bemelmans, T., Brombacher, A.: The w-process for software product evaluation: A method for goal-oriented implementation of the iso 14598 standard. Software Quality Control 12(2), 137–158 (2004)CrossRefGoogle Scholar
  4. 4.
    Sturm, A., Shehory, O.: A framework for evaluating agent-oriented methodologies. In: Giorgini, P., Henderson-Sellers, B., Winikoff, M. (eds.) AOIS 2003. LNCS, vol. 3030, pp. 94–109. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  5. 5.
    Cernuzzi, L., Rossi, G.: On the evaluation of agent oriented modeling methods. In: Proceedings of Agent Oriented Methodology Workshop (2002)Google Scholar
  6. 6.
    Eiter, T., Mascardi, V.: Comparing environments for developing software agents. AI Commun. 15(4), 169–197 (2002)Google Scholar
  7. 7.
    Bitting, E., Carter, J., Ghorbani, A.A.: Multiagent System Development Kits: An Evaluation. In: Proc. of the 1st Annual Conference on Communication Networks and Services Research (CNSR 2003), May 15-16, pp. 80–92 (2003)Google Scholar
  8. 8.
    Sudeikat, J., Braubach, L., Pokahr, A., Lamersdorf, W.: Evaluation of agent-oriented software methodologies examination of the gap between modeling and platform. In: Odell, J.J., Giorgini, P., Müller, J.P. (eds.) AOSE 2004. LNCS, vol. 3382, pp. 126–141. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Dam, K.H.: Evaluating and Comparing Agent-Oriented Software Engineering Methodologies. Master’s thesis, Master of Applied Science in Information Technology - RMIT University, Australia (2003)Google Scholar
  10. 10.
    Tran, Q.N., Low, G.: Comparison of ten agent-oriented methodologies, 341–367 (2005)Google Scholar
  11. 11.
    Garcia, E., Argente, E., Giret, A., Botti, V.: Issues for organizational multiagent systems development. In: Sixth International Workshop From Agent Theory to Agent Implementation (AT2AI-6), pp. 59–65 (2008)Google Scholar
  12. 12.
    Garcia, E., Giret, A., Botti, V.: Software engineering for Service-oriented MAS. In: Klusch, M., Pěchouček, M., Polleres, A. (eds.) CIA 2008. LNCS(LNAI), vol. 5180, pp. 86–100. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  13. 13.
    Garcia, E., Giret, A., Botti, V.: Towards an evaluation framework for MAS software engineering. In: Bui, T.D., Ho, T.V., Ha, Q.T. (eds.) PRIMA 2008. LNCS (LNAI), vol. 5357, pp. 197–205. Springer, Heidelberg (2008)Google Scholar
  14. 14.
    Dubielewicz, I., Hnatkowska, B., Huzar, Z., Tuzinkiewicz, L.: An Approach to Software Quality Specification and Evaluation (SPoQE). IFIP International Federation for Information Processing, vol. 227, pp. 155–166. Springer, Boston (2007)Google Scholar
  15. 15.
    Argente, E., Julian, V., Botti, V.: Mas modelling based on organizations. In: 9th Int. Workshop on Agent Oriented Software Engineering (AOSE2008), pp. 1–12 (2008)Google Scholar
  16. 16.
    Julian, V., Botti, V.: Developing real-time multiagent systems. Integrated Computer-Aided Engineering 11, 135–149 (2004)Google Scholar
  17. 17.
    Pavon, J., Gomez-Sanz, J., Fuentes, R.: The INGENIAS Methodology and Tools, ch. IX, pp. 236–276. Henderson-Sellers (2005)Google Scholar
  18. 18.
    Botti, V., Giret, A.: Anemona. a multi-agent methodology for holonic manufacturing systems. Springer Series in Advanced Manufacturing, vol. XVI, p. 214 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Emilia Garcia
    • 1
  • Adriana Giret
    • 1
  • Vicente Botti
    • 1
  1. 1.Departamento de Sistemas Informaticos y ComputacionUniversidad Politecnica de ValenciaSpain

Personalised recommendations