Skip to main content

What Is a Validation Methodology? Analyzing and Synthesizing Two Meanings

  • Chapter
  • First Online:
Systemic Management for Intelligent Organizations
  • 1405 Accesses

Abstract

Well-validated models can improve the management of intelligent organizations (Schwaninger 2009; Kybernetes, 39: 1419–1428, 2010). In the domain of system dynamics and computational modeling, the assurance of model validity is a prominent challenge. A number of contributions concerning validation tests and their epistemological foundations have been developed. Considering the existing literature, however, little has been said about a validation methodology for system-dynamics models. This chapter differentiates two meanings of such methodology. The first meaning denotes a body of methods. This understanding has been adopted almost exclusively in the field of system dynamics. The second meaning sets forth a comprehensive understanding of the elicitation, description, reflection, and evaluation of issues related to validation, which is currently lacking. This chapter’s contribution is to synthesize the two meanings in a single conceptual model. That model is used to derive directions for future research as well as actions required to support systemic management for intelligent organizations. The chapter aims at focusing the attention of researchers on validation and at inaugurating a beneficial discussion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Argyris C, Schön D (1978) Organizational learning: a theory of action perspective. Addison Wesley, Reading

    Google Scholar 

  • Barlas Y (1990) An autocorrelation function test for output validation. Simulation 55(1):7–16

    Article  Google Scholar 

  • Barlas Y (1996) Formal aspects of model validity and validation in system dynamics. Syst Dynam Rev 12(3):183–210

    Article  Google Scholar 

  • Barlas Y (2006) Model validity and testing in system dynamics: two specific tools. In: Proceedings of the 24th international conference of the System Dynamics Society, Nijmegen

    Google Scholar 

  • Barlas Y, Bog S (2005) Automated dynamic pattern testing, parameter calibration and policy improvement. In: Proceedings of the 23rd international conference of the System Dynamics Society, Boston

    Google Scholar 

  • Barlas Y, Carpenter S (1990) Philosophical roots of model validation: two paradigms. Syst Dynam Rev 6(2):148–166

    Article  Google Scholar 

  • Barlas Y, Topalglu J, Yilankaya S (1997) A behavior validity testing software (BTS). In: Proceedings of the 15th international system dynamics conference: systems approach to learning and education into the 21st century, Istanbul

    Google Scholar 

  • Bateson G (1972) Steps to an ecology of mind. Chandler, San Francisco

    Google Scholar 

  • Coyle G, Exelby D (2000) The validation of commercial system dynamics models. Syst Dyn Review 16(1):27–41

    Article  Google Scholar 

  • Eberlein RL, Wang Q (1983) Validation of oscillatory behavior modes using spectral analysis. In: Proceedings of the international system dynamics conference, Chestnut Hill

    Google Scholar 

  • Finlay PN, Wilson JM (1997) Validity of decision support systems: towards a validation methodology. Syst Res Behav Sci 14(3):169–182

    Article  Google Scholar 

  • Forrester JW (1961) Industrial dynamics. Productivity Press, Cambridge, MA

    Google Scholar 

  • Forrester JW (1985) The ‘model’ versus a modeling ‘process’. Syst Dynam Rev 1(1):133–143

    Article  Google Scholar 

  • Forrester JW (2007a) System dynamics: a personal view of the first fifty years. Syst Dynam Rev 23(2–3):345–358

    Article  Google Scholar 

  • Forrester JW (2007b) System dynamics – the next fifty years. Syst Dynam Rev 23(2–3):359–370

    Article  Google Scholar 

  • Forrester JW (2010) Interview with Jay W. Forrester. Infinite History Project. http://mit150.mit.edu/ infinite-history 12 March 2012

  • Forrester JW, Senge PM (1980) Tests for building confidence in system dynamics models. In: Legasto AA, Forrester JW, Lyneis JM (eds) System dynamics: TIMS studies in the management sciences. North-Holland, Amsterdam

    Google Scholar 

  • Graham AK (2008) How to write a good SD paper. In: Proceedings of the 26th international conference of the System Dynamics Society, Athens

    Google Scholar 

  • Groesser SN, Schwaninger M (2012) Hierarchy, process, and cessation: contributions to when and how to validate. Syst Dynam Rev 28(1):46–68

    Google Scholar 

  • Gűneralp B (2006) Towards coherent loop dominance analysis: progress in eigenvalue elasticity analysis. Syst Dynam Rev 22(3):263–289

    Article  Google Scholar 

  • Homer JB (1996) Why we iterate: scientific modeling in theory and practice. Syst Dynam Rev 12(1):1–19

    Article  Google Scholar 

  • Kampmann CE, Oliva R (2006) Loop eigenvalue elasticity analysis: three case studies. Syst Dynam Rev 22(2):141–162

    Article  Google Scholar 

  • Kleindorfer GB, O’Neill L, Ganeshan R (1998) Validation in simulation: various positions in the philosophy of science. Manage Sci 44(8):1087–1099

    Article  Google Scholar 

  • Lane DC (1995) The folding star: a comparative reframing and extension of validity concepts in system dynamics. In: Proceedings of the 13th international conference of the System Dynamics Society, Tokyo

    Google Scholar 

  • Law AM, Kelton DW (1982) Simulation modeling and analysis. McGraw Hill, New York

    Google Scholar 

  • Opp KD (2008) Methodologie der Sozialwissenschaften Einführung in Probleme ihrer Theorienbildung und praktischen Anwendung, 7th edn. Westdeutscher Verlag, Opladen

    Google Scholar 

  • Peterson DW, Eberlein RL (1994) Reality checks: a bridge between systems thinking and system dynamics. Syst Dynam Rev 10(2/3):159–174

    Article  Google Scholar 

  • Richardson GP, Pugh III AL (1981) Introduction to system dynamics modeling with DYNAMO. Productivity Press, Cambridge

    Google Scholar 

  • Saysel AK, Barlas Y (2006) Model simplification and validation with indirect structure validity tests. Syst Dynam Rev 22(3):241–262

    Article  Google Scholar 

  • Schaffernicht M, Groesser SN (2007) Peer review dialog meeting. In: Proceedings of the 25th international conference of the System Dynamics Society, Boston

    Google Scholar 

  • Schaffernicht M, Groesser SN (2008) Peer review dialog meeting. In: Proceedings of the 26th international conference of the System Dynamics Society, Athens

    Google Scholar 

  • Schaffernicht M, Groesser SN (2009) Peer review dialog meeting. In: Proceedings of the 27th international conference of the System Dynamics Society, Albuquerque

    Google Scholar 

  • Schaffernicht M, Groesser SN (2010) Peer review dialog meeting. In: Proceedings of the 28th international conference of the System Dynamics Society, Seoul

    Google Scholar 

  • Schaffernicht M, Madariaga P (2010) What is learned in system dynamics education: a competency-based representation based upon bloom’s taxonomy. In: Proceedings of the 28th international conference of the System Dynamics Society, Seoul

    Google Scholar 

  • Schwaninger M (2009) Intelligent organizations: powerful models for systemic management (2nd edn). Springer, Berlin/Heidelberg

    Google Scholar 

  • Schwaninger M (2010) Model-based management (MBM): a vital prerequisite for organizational viability. Kybernetes 39(9/10):1419–1428

    Article  Google Scholar 

  • Schwaninger M, Groesser SN (2009a) New frontiers in the validation of simulation models – structural dominance analysis. In: Proceedings of the 12th international conference on computer aided systems theory. Springer, Berlin

    Google Scholar 

  • Schwaninger M, Groesser SN (2009b) System dynamics modeling: validation for quality assurance. In: Encyclopedia of complexity and system science. Springer, Berlin/London/Paris

    Google Scholar 

  • Senge PM (1990) The fifth discipline: the art and practice of the learning organization. Currency Doubleday, New York

    Google Scholar 

  • Sterman JD (2000) Business dynamics: systems thinking and modeling for a complex world. McGraw-Hill, Boston

    Google Scholar 

  • Weick KE (1989) Theory construction as disciplined imagination. Acad Manage Rev 14(4):516–531

    Google Scholar 

  • Webster (2009) Webster’s new encyclopedic dictionary: online. Black Dog & Levinthal Publishers, New York

    Google Scholar 

Download references

Acknowledgements

I thank both my co-editor Rene Zeier and an anonymous reviewer for thorough criticisms of an earlier draft.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stefan N. Grösser .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Grösser, S.N. (2012). What Is a Validation Methodology? Analyzing and Synthesizing Two Meanings. In: Grösser, S., Zeier, R. (eds) Systemic Management for Intelligent Organizations. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29244-6_3

Download citation

Publish with us

Policies and ethics