Skip to main content

Evaluation of a Conversation Management Toolkit for Multi Agent Programming

  • Conference paper
Programming Multi-Agent Systems (ProMAS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7837))

Included in the following conference series:

Abstract

The Agent Conversation Reasoning Engine (ACRE) is intended to aid agent developers to improve the management and reliability of agent communication. To evaluate its effectiveness, a problem scenario was created that could be used to compare code written with and without the use of ACRE by groups of test subjects.

This paper describes the requirements that the evaluation scenario was intended to meet and how these motivated the design of the problem. Two experiments were conducted with two separate sets of students and their solutions were analysed using a combination of simple objective metrics and subjective analysis. The analysis suggested that ACRE by default prevents some common problems arising that would limit the reliability and extensibility of conversation-handling code.

As ACRE has to date been integrated only with the Agent Factory multi agent framework, it was necessary to verify that the problems identified are not unique to that platform. Thus a comparison was made with best practice communication code written for the Jason platform, in order to demonstrate the wider applicability of a system such as ACRE.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 72.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Lillis, D., Collier, R.W.: Augmenting Agent Platforms to Facilitate Conversation Reasoning. In: Dastani, M., El Fallah Seghrouchni, A., Hübner, J., Leite, J. (eds.) LADS 2010. LNCS, vol. 6822, pp. 56–75. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  2. Muldoon, C., O’Hare, G.M.P., Collier, R.W., O’Grady, M.J.: Towards Pervasive Intelligence: Reflections on the Evolution of the Agent Factory Framework. In: El Fallah Seghrouchni, A., Dix, J., Dastani, M., Bordini, R.H. (eds.) Multi-Agent Programming: Languages, Platforms and Applications and Applications, pp. 187–212. Springer US, Boston (2009)

    Google Scholar 

  3. Russell, S., Jordan, H., O’Hare, G.M.P., Collier, R.W.: Agent Factory: A Framework for Prototyping Logic-Based AOP Languages. In: Klügl, F., Ossowski, S. (eds.) MATES 2011. LNCS, vol. 6973, pp. 125–136. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  4. Bordini, R.H., Hübner, J.F., Wooldridge, M.: Programming multi-agent systems in AgentSpeak using Jason. Wiley-Interscience (2007)

    Google Scholar 

  5. Bellifemine, F., Caire, G., Trucco, T., Rimassa, G.: JADE Programmer’s Guide (JADE 4.0) (2010)

    Google Scholar 

  6. Barbuceanu, M., Fox, M.S.: COOL: A language for describing coordination in multi agent systems. In: Proceedings of the First International Conference on Multi-Agent Systems, ICMAS 1995, pp. 17–24 (1995)

    Google Scholar 

  7. Cost, R.S., Finin, T., Labrou, Y., Luan, X., Peng, Y., Soboroff, I., Mayfield, J., Boughannam, A.: Jackal: a Java-based Tool for Agent Development. Working Papers of the AAAI 1998 Workshop on Software Tools for Developing Agents. AAAI Press (1998)

    Google Scholar 

  8. Bradshaw, J.M., Dutfield, S., Benoit, P., Woolley, J.D.: KAoS: Toward an industrial-strength open agent architecture. Software Agents, 375–418 (1997)

    Google Scholar 

  9. Huget, M.P., Koning, J.L.: Interaction Protocol Engineering. Communications, 291–309 (2003)

    Google Scholar 

  10. Ancona, D., Drossopoulou, S., Mascardi, V.: Automatic Generation of Self-Monitoring MASs from Multiparty Global Session Types in Jason. In: Baldoni, M., Dennis, L., Mascardi, V., Vasconcelos, W. (eds.) DALT 2012. LNCS (LNAI), vol. 7784, pp. 76–95. Springer, Heidelberg (2013)

    Google Scholar 

  11. Hochstein, L., Basili, V.R., Vishkin, U., Gilbert, J.: A pilot study to compare programming effort for two parallel programming models. Journal of Systems and Software 81(11), 1920–1930 (2008)

    Article  Google Scholar 

  12. Luff, M.: Empirically Investigating Parallel Programming Paradigms: A Null Result. In: Workshop on Evaluation and Usability of Programming Languages and Tools, PLATEAU, pp. 43–49 (2009)

    Google Scholar 

  13. Rossbach, C.J., Hofmann, O.S., Witchel, E.: Is Transactional Programming Actually Easier? ACM SIGPLAN Notices 45(5), 47–56 (2010)

    Article  Google Scholar 

  14. VanderWiel, S.P., Nathanson, D., Lilja, D.J.: Complexity and performance in parallel programming languages. In: Second International Workshop on High-Level Programming Models and Supportive Environments, pp. 3–12 (1997)

    Google Scholar 

  15. Rao, A.S.: AgentSpeak (L): BDI agents speak out in a logical computable language. In: Van de Velde, W., Perram, J.W. (eds.) MAAMAW 1996. LNCS, vol. 1038, pp. 42–55. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lillis, D., Collier, R.W., Jordan, H.R. (2013). Evaluation of a Conversation Management Toolkit for Multi Agent Programming. In: Dastani, M., Hübner, J.F., Logan, B. (eds) Programming Multi-Agent Systems. ProMAS 2012. Lecture Notes in Computer Science(), vol 7837. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38700-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38700-5_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38699-2

  • Online ISBN: 978-3-642-38700-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics