Validation and Verification of Agent-Based Models in the Social Sciences

  • Paul Ormerod
  • Bridget Rosewell
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5466)


This paper considers some of the difficulties in establishing verificaction and validation of agent based models. The fact that most ABMs are solved by simulation rather than analytically blurs the distinction between validation and verification. We suggest that a clear description of the phenomena to be explained by the model and testing for the simplest possible realistic agent rules of behaviour are key to the successful validation of ABMs and will provide the strongest base for enabling model comparison and acceptance. In particular, the empirical evidence that in general agents act intuitively rather than rationally is now strong. This implies that models which assign high levels of cognition to their agents require particularly strong justification if they are to be considered valid.


Verification validation agent-based models agents behaviour 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Atkinson, A.B.: The Timescale of Economic Models: How Long is the Long Run? Review of Economic Studies 36, 137–152 (1969)CrossRefGoogle Scholar
  2. 2.
    Axelrod, R.: Advancing the Art of Simulation in the Social Sciences. In: Conte, R., Hegelsmann, R., Terna, P. (eds.) Simulating Social Phenomena, Berlin, pp. 21–40. Springer, Heidelberg (1997)CrossRefGoogle Scholar
  3. 3.
    Dosi, G., Fagiolo, G., Roventini, A.: An Evolutionary Model of Endogenous Business Cycles. Computational Economics 27(1), 3–34 (2006)CrossRefzbMATHGoogle Scholar
  4. 4.
    Kahenman, D.: Maps of Bounded Rationality: A Perspective on Intuitive Judgement and Choice. American Economic Review 93, 1449–1475 (2003)CrossRefGoogle Scholar
  5. 5.
    McNamara, L., Trucano, T., Backus, G.: Verification and Validation as Applied Epistemology. In: Proceedings of the UCLA Conference on Human Complex Systems (April 2007),
  6. 6.
    Ormerod, P.: The US business cycle: power law scaling for interacting units with complex internal structure. Physica A 314, 774–785 (2002)CrossRefzbMATHGoogle Scholar
  7. 7.
    Ormerod, P.: Information cascades and the distribution of economic recessions in capitalist economies. Physica A 341, 556–568 (2004)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Ormerod, P., Rosewell, B.: What can firms know?, plenary talk. In: Proc. NAACSOS conference, Pittsburgh (2003)Google Scholar
  9. 9.
    Ormerod, P., Rosewell, B.: On the Methodology of Assessing Agent Based Models in the Social Sciences. In: Metcalfe, J.S., Foster, J. (eds.) Evolution and Economic Complexity, Edward Elgar, Cheltenham (2004)Google Scholar
  10. 10.
    Pilch, M., Trucano, T., Moya, J., Groehlich, G., Hodges, A., Peercy, D.: Guidelines for Sandia ASCI Verification and Validation Plans – Content and Format: Version 2.0., Albuquerque, NM: Sandia National Laboratories, SAND 2000–3101 (2000)Google Scholar
  11. 11.
    Rand, W., Wilensky, U.: Verification and Validation through Replication: A Case Study Using Axelrod and Hammond’s Ethnocentrism Model. In: Proc. NAACSOS (2006)Google Scholar
  12. 12.
    Rosewell, B., Horton, A.: Neighbours are not enough. In: European Conference on Complex Systems, Oxford (2006)Google Scholar
  13. 13.
    Smith, V.L.: Constructivist and Ecological Rationality in Economics. American Economic Review 93, 465–508 (2003)CrossRefGoogle Scholar
  14. 14.
    Stewart, I.: From Here to Infinity. Oxford University Press, Oxford (1996)zbMATHGoogle Scholar
  15. 15.
    Windrum, P., Fagiolo, G., Moneta, A.: Empirical Validation of Agent-Based Models: Alternatives and Prospects. Journal of Artificial Societies and Social Simulation 10, 2 (2007)Google Scholar
  16. 16.
    Wright, I.: The social architecture of capitalism. Physica A 346, 589–620 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Paul Ormerod
    • 1
  • Bridget Rosewell
    • 1
  1. 1.Volterra ConsultingLondonUK

Personalised recommendations