Skip to main content

Using Model Replication to Improve the Reliability of Agent-Based Models

  • Conference paper
Advances in Social Computing (SBP 2010)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6007))

Abstract

The basic presupposition of model replication activities for a computational model such as an agent-based model (ABM) is that, as a robust and reliable tool, it must be replicable in other computing settings. This assumption has recently gained attention in the community of artificial society and simulation due to the challenges of model verification and validation. Illustrating the replication of an ABM representing fraudulent behavior in a public service delivery system originally developed in the Java-based MASON toolkit for NetLogo by a different author, this paper exemplifies how model replication exercises provide unique opportunities for model verification and validation process. At the same time, it helps accumulate best practices and patterns of model replication and contributes to the agenda of developing a standard methodological protocol for agent-based social simulation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Axelord, R.M.: The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration. Princeton University Press, Princeton (1997)

    Google Scholar 

  2. Deffuant, G., Moss, S., Jager, W.: Dialogues concerning a (possibly) new science. Journal of Artificial Societies and Social Simulation 9(1) (2006), http://jasss.soc.surrey.ac.uk/9/1/1.html

  3. Eck, J.E.: Examining routine activity theory: A review of two books. Justice Quarterly 12(4), 783–797 (1995)

    Article  MathSciNet  Google Scholar 

  4. Edmonds, B.: The use of models: Making mabs actually work. In: Moss, S., Davidsson, P. (eds.) MABS 2000. LNCS (LNAI), vol. 1979, pp. 15–32. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  5. Edmonds, B.: Simulation and complexity: How they can relate. In: Feldmann, V., Mhlfeld, K. (eds.) Virtual Worlds of Precision: Computer-Based Simulations in the Sciences and Social Sciences, pp. 5–32. Lit Verlag, Mnster (2005)

    Google Scholar 

  6. Edmonds, B., Hales, D.: Replication, replication and replication: Some hard lessons from model alignment. Journal of Artificial Societies and Social Simulation 6(4) (2003), http://jasss.soc.surrey.ac.uk/6/4/11.html

  7. Felson, M.: Crime and Everyday Life: Impact and Implications for Society. Pine Forge Press, Thousand Oaks (1994)

    Google Scholar 

  8. Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W.M., Railsback, S.F., Thulke, H., Weiner, J., Wiegand, T., DeAngelis, D.L.: Pattern-oriented modeling of agent-based complex systems: Lessons from ecology. Science 310(5750), 987–991 (2005)

    Article  Google Scholar 

  9. Kim, Y.: Analysis for Adaptive Complex Public Enterprises. PhD thesis, The Ohio State University, Columbus (2006)

    Google Scholar 

  10. Kim, Y., Xiao, N.: Fraudsim: Simulating fraud in a public delivery program. In: Liu, L., Eck, J. (eds.) Artificial Crime Analysis Systems: Using Computer Simulations and Geographic Information Systems, pp. 319–338. IGI Global, Hershey (2008)

    Google Scholar 

  11. Macal, C.M., North, M.J.: Validation of an agent-based model of deregulated electric power markets. In: North American Association for Computational Social and Organization Sciences Conference, Notre Dame, Indiana, USA, June 22-23 (2006)

    Google Scholar 

  12. Macy, M., Sato, Y.: Reply to will and hegselmann. Journal of Artificial Societies and Social Simulation 11(4) (2008), http://jasss.soc.surrey.ac.uk/11/4/11.html

  13. Martins, A.C.R.: Replication in the deception and convergence of opinions problem. Journal of Artificial Societies and Social Simulation 11(4) (2008), http://jasss.soc.surrey.ac.uk/11/4/8.html

  14. Merlone, U., Sonnessa, M., Terna, P.: Horizontal and vertical multiple implementations in a model of industrial districts. Journal of Artificial Societies and Social Simulation 11(2) (2008), http://jasss.soc.surrey.ac.uk/11/2/5.html

  15. Oreskes, N., Shrader-Frechette, K., Belitz, K.: Verification, validation, and confirmation of numerical models in the earth sciences. Science 263(5147), 641–646 (1994)

    Article  Google Scholar 

  16. Pace, D.K.: Modeling and simulation verification and validation challenges. Johns Hopkins APL Technical Digest 25(2), 163–172 (2004)

    MathSciNet  Google Scholar 

  17. Rand, W., Wilensky, U.: Verification and validation through replication: A case study using axelrod and hammond’s ethnocetnrism model. In: North American Association for Computational Social and Organization Sciences Conference., Notre Dame, Indiana, USA, June 22-23 (2006)

    Google Scholar 

  18. Rouchier, J., Cioffi-Revill, C., Polhill, J.G., Takadama, K.: Progress in model-to-model analysis. Journal of Artificial Societies and Social Simulation 11(2) (2008), http://jasss.soc.surrey.ac.uk/11/2/8.html

  19. Sansores, C., Pavon, J.: Agent-based simulation replication: A model driven architecture approach. In: Gelbukh, A., de Albornoz, Á., Terashima-Marín, H. (eds.) MICAI 2005. LNCS (LNAI), vol. 3789, pp. 244–253. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  20. Smith, M.J., Goodchild, M.F., Longley, P.A.: Geospatial Analysis: A Comprehensive Guide to Principles, Techniques and Software Tools. Troubador Publishing Ltd., Leicester (2007)

    Google Scholar 

  21. Sutherland, E.H.: White-collar criminality. American Sociological Review 5(1), 1–12 (1940)

    Article  Google Scholar 

  22. Trucanoa, T., Swilera, L., Igusab, T., Oberkampfc, W., Pilch, M.: Calibration, validation, and sensitivity analysis: What’s what. Reliability Engineering and System Safety 91(10-11), 1331–1357 (2006)

    Article  Google Scholar 

  23. Wilensky, U., Rand, W.: Making models match: Replicating an agent-based model. Journal of Artificial Societies and Social Simulation 10(4) (2007), http://jasss.soc.surrey.ac.uk/10/4/2.html

  24. Will, O., Hegselmann, R.: A replication that failed. Journal of Artificial Societies and Social Simulation 11(3) (2008), http://jasss.soc.surrey.ac.uk/11/3/3.html

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhong, W., Kim, Y. (2010). Using Model Replication to Improve the Reliability of Agent-Based Models. In: Chai, SK., Salerno, J.J., Mabry, P.L. (eds) Advances in Social Computing. SBP 2010. Lecture Notes in Computer Science, vol 6007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12079-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12079-4_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12078-7

  • Online ISBN: 978-3-642-12079-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics