Advertisement

Validation and Verification in Social Simulation: Patterns and Clarification of Terminology

  • Nuno David
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5466)

Abstract

The terms ‘verification’ and ‘validation’ are widely used in science, both in the natural and the social sciences. They are extensively used in simulation, often associated with the need to evaluate models in different stages of the simulation development process. Frequently, terminological ambiguities arise when researchers conflate, along the simulation development process, the technical meanings of both terms with other meanings found in the philosophy of science and the social sciences. This article considers the problem of verification and validation in social science simulation along five perspectives: The reasons to address terminological issues in simulation; the meaning of the terms in the philosophical sense of the problem of “truth”; the observation that some debates about these terms in simulation are inadvertently more terminological than epistemological; the meaning of the terms in the technical context of the simulation development process; and finally, a comprehensive outline of the relation between terminology used in simulation, different types of models used in the development process and different epistemological perspectives.

Keywords

Verification validation pre-computerized post-computerized models terminology 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Axelrod, R.: Advancing the Art of Simulation in the Social Sciences. In: Conte, R., Hegselmann, R., Terna, P. (eds.) Simulating Social Phenomena, pp. 21–40. Springer, Heidelberg (1997a)CrossRefGoogle Scholar
  2. 2.
    Axelrod, R.: The dissemination of culture: A model with local convergence and global polarization. Journal of Conflict Resolution 41(2), 203–226 (1997b)CrossRefGoogle Scholar
  3. 3.
    Heine, B.-O., Meyer, M., Strangfeld, O.: Stylised Facts and the Contribution of Simulation to the Economic Analysis of Budgeting. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
  4. 4.
    Boero, R., Squazzoni, F.: Does Empirical Embeddedness Matter? Methodological Issues on Agent Based Models for Analytical Social Science. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
  5. 5.
    David, N., Sichman, J., Coelho, H.: The Logic of the Method of Agent-Based Simulation in the Social Sciences: Empirical and Intentional Adequacy of Computer Programs. Journal of Artificial Societies and Social Simulation (JASSS) 8(4) (2005)Google Scholar
  6. 6.
    David, N., Sichman, J., Coelho, H.: Simulation as Formal and Generative Social Science: The Very Idea. In: Gershenson, C., Aerts, D., Edmonds, B. (eds.) Worldviews, Science and Us: Philosophy and Complexity, pp. 266–275. World Scientific, Singapore (2007)CrossRefGoogle Scholar
  7. 7.
    Edmonds, B., Hales, D.: Replication, replication and replication: Some hard lessons from model alignment. Journal of Artificial Societies and Social Simulation 6(4) (2003)Google Scholar
  8. 8.
    Edmonds, B.: Towards an ideal social simulation language. In: Sichman, J.S., Bousquet, F., Davidsson, P. (eds.) MABS 2002. LNCS, vol. 2581, pp. 105–124. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  9. 9.
    Epstein, J.: Agent-Based Computational Models and Generative Social Science. Complexity 4(5), 41–59 (1999)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Fetzer, J.: The Role of Models in Computer Science. In: General Topic: Philosophy of Computer Science, La Salle. The Monist, vol. 82(1), pp. 20–36 (1999)Google Scholar
  11. 11.
    Gilbert, N., Troitzsch, K.: Simulation for the Social Scientist. Open University Press (1999)Google Scholar
  12. 12.
    Hales, D., Rouchier, J., Edmonds, B.: Model-to-Model Analysis. Journal of Artificial Societies and Social Simulation 6(4) (2003)Google Scholar
  13. 13.
    Iseda, T.: Verification, Validation, and Confirmation of Simulation Models: Suppe vs. In: Oreskes, et al. (eds.) Assistantship at University of Maryland, PHIL 250 Philosophy of Science I (instructor: Frederick Suppe), December 9 (1997) (retrieved March 2007), http://carnap.umd.edu/phil250/oreskes/oreskes.html
  14. 14.
    Küppers, G., Lenhard, J.: Validation of Simulation: Patterns in the Social and Natural Sciences. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
  15. 15.
    Oreskes, N., Shrader-Frechette, K., Belitz, K.: Verification, validation, and confirmation of numerical models in the earth sciences. Science 263, 641–646 (1994)CrossRefGoogle Scholar
  16. 16.
    Richiardi, M., Leombruni, R., Sonnessa, M., Saam, N.: A Common Protocol for Agent-Based Social Simulation. Journal of Artificial Societies and Social Simulation 9(1) (2006)Google Scholar
  17. 17.
    Sargent, T.J.: Verification and validation of simulation models. In: Proceedings of 1998 Winter Simulation Conference (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Nuno David
    • 1
  1. 1.Department of Information Science and TechnologyISCTE - Instituto Superior de Ciências do Trabalho e da EmpresaLisboaPortugal

Personalised recommendations