Abstract
Validation of System Dynamics (SD) models involves two general types of tests: Tests of model structure and tests of model behavior. Yet, since SD models are causal models, the essence of model validity lies always in structural validity: “Right behavior for the right reasons”. (The nature of SD model validity has been discussed in various SD literature. For example, Forrester 1961 (Chapter 13); Forrester 1968; Forrester and Senge 1980; Bell and Senge 1980; Richardson and Pugh 1981 (Chapter 5 and 6) and Barlas 1985). Standard behavior tests, which compare the model-generated behavior to the observed reference behavior are generally “weak” in SD context, since they can not separate spurious behavior accuracy (“right behavior for the wrong reasons”) from true behavior validity. Such tests provide no structural information. Structure tests, on the other hand, are “strong” tests, since they evaluate the model structure directly. But their their major drawback is that they are informal, qualitative, hence difficult to communicate. (See Forrester and Senge 1980, and Richardson and Pugh 1981 (chapter 5) for some specific behavior and structure tests). Thus, it seems like a “third type of test” would be most appropriate for SD validation purposes: Quantitative/formal behavior tests that can provide some structural information (“structurally-oriented” behavior tests). Interestingly, such tests already exist in the SD validation “repertoire”. (For example, “Extreme Condition” simulations, “Behavior Sensitivity” testing, in Forrester and Senge 1980 and Richardson and Pugh 1981). But these tests are usually listed along with all other behavior tests, which undermines the major difference that exists between the former and the latter.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Barlas, Yaman. 1985. Validation of System Dynamics Models with a Sequential Procedure Involving Multiple Quantitative Methods (Ph.D. Dissertation), Georgia Institute of Technology, Atlanta, Georgia.
Barlas, Yaman. 1989. “Multiple Tests for Validation of System Dynamics Type of Simulation Models”, European Journal of Operations Research. Forthcoming.
Bell, James A. and Senge, Peter, M. 1980. “Methods for Enhancing Refutability in System Dynamics Modeling”, in Forrester Jay. W. et al., eds., System Dynamics. North-Holland, New York.
Forrester, Jay, W. 1961. Industrial Dynamics. MIT Press, Cambridge, MA.
Forrester, Jay, W. 1968. “A Response to Ansoff and Slevin”, Management Science, Vol. 14, pp. 601–618.
Forrester, Jay, W. and Senge, Peter, M. 1980. “Tests for Building Confidence in System Dynamics Models”, in Forrester, Jay. W. et al. eds., System Dynamics. North-Holland, New York.
Richardson, George P. and Alexander Pugh, III. 1981. Introduction to System Dynamics Modeling with DYNAMO, MIT Press, Cambridge, MA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1989 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Barlas, Y. (1989). Tests of Model Behavior that can Detect Structural Flaws: Demonstration with Simulation Experiments. In: Milling, P.M., Zahn, E.O.K. (eds) Computer-Based Management of Complex Systems. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-74946-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-74946-9_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-51447-3
Online ISBN: 978-3-642-74946-9
eBook Packages: Springer Book Archive