Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Multi-Agent Systems and Agent-Based Simulation

MABS 2014: Multi-Agent-Based Simulation XV pp 17–27Cite as

RatKit: Repeatable Automated Testing Toolkit for Agent-Based Modeling and Simulation

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9002))

Abstract

Agent-based modeling and simulation (ABMS) became an attractive and efficient way to model large-scale complex systems. The use of models always raises the question whether the model is correctly encoded (verification) and accurately represents the real system (validation). However, achieving a sufficiently credible agent-based simulation (ABS) model is still difficult due to weak verification, validation and testing (VV&T) techniques. Moreover, there is no comprehensive and integrated toolkit for VV&T of ABS models that demonstrates that inaccuracies exist and/or which reveals the existing errors in the model. Based on this observation, we designed and developed RatKit: a toolkit for ABS models to conduct VV&T. RatKit facilitates the VV&T process of ABMS by providing an integrated environment that allows repeatable and automated execution of ABS tests. This paper presents RatKit in detail and demonstrates its effectiveness by showing its applicability on a simple well-known case study: predator - prey.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    JUnit. http://www.junit.org (Accessed: July 2014).

  2. 2.

    RatKit4Repast http://code.google.com/p/ratkit (Accessed: September 2014).

References

  1. Balci, O.: Validation, verification, and testing techniques throughout the life cycle of a simulation study. In: WSC 1994, pp. 215–220 (1994)

    Google Scholar 

  2. Balci, O.: Principles and techniques of simulation validation, verification, and testing. In: WSC 1995, pp. 147–154. IEEE Computer Society (1995)

    Google Scholar 

  3. Love, G., Back, G.: Model verification and validation for rapidly developed simulation models: balancing cost and theory. In: Proceedings of the 18th International Conference of the System Dynamics Society (2000)

    Google Scholar 

  4. Wilensky, U.: NetLogo Wolf Sheep Predation model. Center for Connected Learning and Computer-Based Modeling (1997)

    Google Scholar 

  5. Calvez, B., Hutzler, G.: Automatic tuning of agent-based models using genetic algorithms. In: Sichman, J.S., Antunes, L. (eds.) MABS 2005. LNCS (LNAI), vol. 3891, pp. 41–57. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  6. Gürcan, O., Türker, K.S., Mano, J., Bernon, C., Dikenelli, O., Glize, P.: Mimicking human neuronal pathways in silico: an emergent model on the effective connectivity. J. Comput. Neurosci. 36, 235–257 (2013)

    Article  Google Scholar 

  7. Grimm, V., Revilla, E., Berger, U., Jeltsch, W.M., Railsback, S.: Pattern-oriented modeling of agent-based complex systems: lessons from ecology. Science 310, 987–991 (2005)

    Article  Google Scholar 

  8. Epstein, J.M.: Agent-based computational models and generative social science. In: Generative Social Science Studies in Agent-Based Computational Modeling. Princeton University Press, Princeton (2007)

    Google Scholar 

  9. Niazi, M.A., Hussain, A.: Agent-based computing from multi-agent systems to agent-based models: a visual survey. Scientometrics 89, 479–499 (2011). Springer

    Article  Google Scholar 

  10. Niazi, M.A., Hussain, A.: A novel agent-based simulation framework for sensing in complex adaptive environments. IEEE Sens. J. 11(2), 404–412 (2011)

    Article  Google Scholar 

  11. De Wolf, T., Holvoet, T.: Emergence versus self-organisation: different concepts but promising when combined. In: Brueckner, S.A., Di Marzo Serugendo, G., Karageorgos, A., Nagpal, R. (eds.) ESOA 2005. LNCS (LNAI), vol. 3464, pp. 1–15. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Sargent, R.G.: Verification and validation of simulation models. In: WSC 2005, pp. 130–143 (2005)

    Google Scholar 

  13. Terano, T.: Exploring the vast parameter space of multi-agent based simulation. In: Antunes, L., Takadama, K. (eds.) MABS 2006. LNCS (LNAI), vol. 4442, pp. 1–14. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  14. Klügl, F.: A validation methodology for agent-based simulations. In: Proceedings of the 2008 ACM Symposium on Applied Computing, SAC 2008, pp. 39–43. ACM (2008)

    Google Scholar 

  15. Niazi, M.A., Hussain, A., Kolberg, M.: Verification and validation of agent-based simulation using the VOMAS approach. In: MAS&S at Multi-Agent Logics, Languages, and Organisations Federated Workshops (MALLOW), vol. 494 (2009)

    Google Scholar 

  16. Xing, P., Lees, M., Nan, H., Viswanthatn, T.V.: Validation of agent-based simulation through human computation: an example of crowd simulation. In: Villatoro, D., Sabater-Mir, J., Sichman, J.S. (eds.) MABS 2011. LNCS, vol. 7124, pp. 90–102. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  17. Railsback, S.F., Grimm, V.: Agent-Based and Individual-Based Modeling: A Practical Introduction. Princeton University Press, Princeton (2011)

    Google Scholar 

  18. Gürcan, O., Dikenelli, O., Bernon, C.: A generic testing framework for agent-based simulation models. J. Simul. 7, 183–201 (2013)

    Article  Google Scholar 

  19. Wright, C.J., McMinn, P., Gallardo, J.: Testing Multi-Agent Based Simulations using MASTER (2012)

    Google Scholar 

  20. Balci, O.: Golden rules of verification, validation, testing, and certification of modeling and simulation applications. SCS M&S Magazine (2010)

    Google Scholar 

  21. Beck, K.: Test-Driven Development by Example. Addison Wesley, Vaseem (2003)

    Google Scholar 

  22. Gürcan, O., Dikenelli, O., Bernon, C.: Towards a generic testing framework for agent-based simulation models. In: MAS&S 2011, pp. 637–644 (2011)

    Google Scholar 

  23. North, M.J., T.R. Howe, N.T. Collier, Vos, R.J.: The Repast Simphony Runtime System, Argonne National Laboratory (2005)

    Google Scholar 

  24. Soyez, J.-B., Morvan, G., Dupont, D., Merzouki, R.: A methodology to engineer and validate dynamic multi-level multi-agent based simulations. In: Giardini, F., Amblard, F. (eds.) MABS 2012. LNCS, vol. 7838, pp. 130–142. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  25. Drogoul, A., Amouroux, E., Caillou, P., Gaudou, B., Grignard, A., Marilleau, N., Taillandier, P., Vavasseur, M., Vo, D.-A., Zucker, J.-D.: GAMA: a spatially explicit, multi-level, agent-based modeling and simulation platform. In: Demazeau, Y., Ishida, T., Corchado, J.M., Bajo, J. (eds.) PAAMS 2013. LNCS, vol. 7879, pp. 271–274. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  26. Burstein, I.: Practical Software Testing. Springer, New York (2003)

    Google Scholar 

  27. Thacker, B.H., Doebling, S. W., Hemez, F.M., Anderson, M.C., Pepin, J.E., Rodriguez, E.A.: Concepts of model verification and validation. Technical report, Los Alamos National Lab., Los Alamos, NM, US (2004)

    Google Scholar 

  28. Stasser, G.: Computer simulation as a research tool: the DISCUSS model of group decision making. J. Exp. Soc. Psychol. 24(5), 393–422 (1988). ISSN 0022-1031. http://dx.doi.org/10.1016/0022-1031(88)90028-5

    Article  Google Scholar 

  29. Carley, K.M.: Validating computational models (1996)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Ege University, 35100, İzmir, Turkey

    İbrahim Çakırlar, Önder Gürcan, Oğuz Dikenelli & Şebnem Bora

  2. LIST, Laboratory of Model Driven Engineering for Embedded Systems, CEA, Point Courrier 174, 91191, Gif-sur-Yvette, France

    Önder Gürcan

Authors
  1. İbrahim Çakırlar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Önder Gürcan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oğuz Dikenelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Şebnem Bora
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to İbrahim Çakırlar .

Editor information

Editors and Affiliations

  1. Universitat de València, Burjassot-València, Spain

    Francisco Grimaldo

  2. Manchester Metropolitan University, Manchester, United Kingdom

    Emma Norling

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Çakırlar, İ., Gürcan, Ö., Dikenelli, O., Bora, Ş. (2015). RatKit: Repeatable Automated Testing Toolkit for Agent-Based Modeling and Simulation. In: Grimaldo, F., Norling, E. (eds) Multi-Agent-Based Simulation XV. MABS 2014. Lecture Notes in Computer Science(), vol 9002. Springer, Cham. https://doi.org/10.1007/978-3-319-14627-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14627-0_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14626-3

  • Online ISBN: 978-3-319-14627-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation