Validation and Verification in Social Simulation: Patterns and Clarification of Terminology
- 729 Downloads
The terms ‘verification’ and ‘validation’ are widely used in science, both in the natural and the social sciences. They are extensively used in simulation, often associated with the need to evaluate models in different stages of the simulation development process. Frequently, terminological ambiguities arise when researchers conflate, along the simulation development process, the technical meanings of both terms with other meanings found in the philosophy of science and the social sciences. This article considers the problem of verification and validation in social science simulation along five perspectives: The reasons to address terminological issues in simulation; the meaning of the terms in the philosophical sense of the problem of “truth”; the observation that some debates about these terms in simulation are inadvertently more terminological than epistemological; the meaning of the terms in the technical context of the simulation development process; and finally, a comprehensive outline of the relation between terminology used in simulation, different types of models used in the development process and different epistemological perspectives.
KeywordsVerification validation pre-computerized post-computerized models terminology
Unable to display preview. Download preview PDF.
- 3.Heine, B.-O., Meyer, M., Strangfeld, O.: Stylised Facts and the Contribution of Simulation to the Economic Analysis of Budgeting. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
- 4.Boero, R., Squazzoni, F.: Does Empirical Embeddedness Matter? Methodological Issues on Agent Based Models for Analytical Social Science. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
- 5.David, N., Sichman, J., Coelho, H.: The Logic of the Method of Agent-Based Simulation in the Social Sciences: Empirical and Intentional Adequacy of Computer Programs. Journal of Artificial Societies and Social Simulation (JASSS) 8(4) (2005)Google Scholar
- 7.Edmonds, B., Hales, D.: Replication, replication and replication: Some hard lessons from model alignment. Journal of Artificial Societies and Social Simulation 6(4) (2003)Google Scholar
- 10.Fetzer, J.: The Role of Models in Computer Science. In: General Topic: Philosophy of Computer Science, La Salle. The Monist, vol. 82(1), pp. 20–36 (1999)Google Scholar
- 11.Gilbert, N., Troitzsch, K.: Simulation for the Social Scientist. Open University Press (1999)Google Scholar
- 12.Hales, D., Rouchier, J., Edmonds, B.: Model-to-Model Analysis. Journal of Artificial Societies and Social Simulation 6(4) (2003)Google Scholar
- 13.Iseda, T.: Verification, Validation, and Confirmation of Simulation Models: Suppe vs. In: Oreskes, et al. (eds.) Assistantship at University of Maryland, PHIL 250 Philosophy of Science I (instructor: Frederick Suppe), December 9 (1997) (retrieved March 2007), http://carnap.umd.edu/phil250/oreskes/oreskes.html
- 14.Küppers, G., Lenhard, J.: Validation of Simulation: Patterns in the Social and Natural Sciences. Journal of Artificial Societies and Social Simulation 8(4) (2005)Google Scholar
- 16.Richiardi, M., Leombruni, R., Sonnessa, M., Saam, N.: A Common Protocol for Agent-Based Social Simulation. Journal of Artificial Societies and Social Simulation 9(1) (2006)Google Scholar
- 17.Sargent, T.J.: Verification and validation of simulation models. In: Proceedings of 1998 Winter Simulation Conference (1998)Google Scholar