Advertisement

Dynamical Symmetries and Model Validation

  • Benjamin C. JantzenEmail author
Conference paper
Part of the Fields Institute Communications book series (FIC, volume 82)

Abstract

I introduce a new method for validating models—including stochastic models—that gets at the reliability of a model’s predictions under intervention or manipulation of its inputs and not merely at its predictive reliability under passive observation. The method is derived from philosophical work on natural kinds, and turns on comparing the dynamical symmetries of a model with those of its target, where dynamical symmetries are interventions on model variables that commute with time evolution. I demonstrate that this method succeeds in testing aspects of model validity for which few other tools exist.

Notes

Acknowledgements

I am grateful to the participants in the 2015 Algorithms and Complexity in Mathematics, Epistemology and Science (ACMES) conference for insightful discussion of an early algorithm for discovering dynamical kinds, to Cosmo Grant for pointing out a physical inconsistency in the first version of one of my examples, and to Nicolas Fillion for helpful comments on a previous draft of this paper. The work presented here was supported by the National Science Foundation under Grant No. 1454190.

References

  1. 1.
    Balci O (1994) Validation, verification, and testing techniques throughout the life cycle of a simulation study. Ann Oper Res 53(1):121–173MathSciNetGoogle Scholar
  2. 2.
    Barlas Y (1989) Multiple tests for validation of system dynamics type of simulation models. Eur J Oper Res 42(1):59–87zbMATHGoogle Scholar
  3. 3.
    Barlas Y (1996) Formal aspects of model validity and validation in system dynamics. Syst Dyn Rev 12(3):183–210Google Scholar
  4. 4.
    Buchanan RL, Whiting RC, Damert WC (1997) When is simple good enough: a comparison of the Gompertz, Baranyi, and three-phase linear models for fitting bacterial growth curves. Food Microbiol 14(4):313–326.Google Scholar
  5. 5.
    Committee on Mathematical Foundations of Verification, Validation, and Uncertainty Quantification (2012) Assessing the reliability of complex models: mathematical and statistical foundations of verification, validation, and uncertainty quantification. National Academy Press, WashingtonGoogle Scholar
  6. 6.
    Connelly B (2014) Data set for ‘analyzing microbial growth with R’. https://doi.org/10.5281/zenodo.1171129
  7. 7.
    Fillion N (2017) The vindication of computer simulations. In: Lenhard J, Carrier M (eds) Mathematics as a tool: tracing new roles of mathematics in the sciences. Springer, Cham, pp 137–155Google Scholar
  8. 8.
    Flach P (2012) Machine learning: the art and science of algorithms that make sense of data. Cambridge University Press, CambridgezbMATHGoogle Scholar
  9. 9.
    Fujikawa H, Kai A, Morozumi S (2004) A new logistic model for Escherichia coli growth at constant and dynamic temperatures. Food Microbiol 21(5):501–509Google Scholar
  10. 10.
    Gompertz B (1825) XXIV. On the nature of the function expressive of the law of human mortality, and on a new mode of determining the value of life contingencies. In a letter to Francis Baily, Esq. F. R. S. &c. Philos Trans R Soc Lond 115:513–583Google Scholar
  11. 11.
    Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning. Springer series in statistics, 2nd edn. Springer, New YorkGoogle Scholar
  12. 12.
    Higham DJ (2001) An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev 43(3):525–546MathSciNetzbMATHGoogle Scholar
  13. 13.
    Jantzen BC (2014) Projection, symmetry, and natural kinds. Synthese 192(11):3617–3646Google Scholar
  14. 14.
    Jantzen BC (2017) Dynamical kinds and their discovery. In: Proceedings of the UAI 2016 workshop on causation: foundation to application. ArXiv: 1612.04933Google Scholar
  15. 15.
    Ling Y, Mahadevan S (2013) Quantitative model validation techniques: new insights. Reliab Eng Syst Saf 111:217–231Google Scholar
  16. 16.
    Liu M, Fan M (2017) Permanence of stochastic Lotka–Volterra systems. J Nonlinear Sci 27(2):425–452MathSciNetzbMATHGoogle Scholar
  17. 17.
    McCarthy MA, Broome LS (2000) A method for validating stochastic models of population viability: a case study of the mountain pygmy-possum (Burramys parvus). J Anim Ecol 69(4):599–607Google Scholar
  18. 18.
    Miller JH (1998) Active nonlinear tests (ANTs) of complex simulation models. Manag Sci 44(6):820–830zbMATHGoogle Scholar
  19. 19.
    Rhinehart RR (2016) Nonlinear regression modeling for engineering applications: modeling, model validation, and enabling design of experiments. Wiley, HobokenGoogle Scholar
  20. 20.
    Skiadas CH (2010) Exact solutions of stochastic differential equations: Gompertz, generalized logistic and revised exponential. Methodol Comput Appl Probab 12(2):261–270MathSciNetzbMATHGoogle Scholar
  21. 21.
    Sokal RR, Rohlf FJ (1994) Biometry: the principles and practices of statistics in biological research, 3rd edn. W. H. Freeman, New YorkzbMATHGoogle Scholar
  22. 22.
    Spirtes P, Glymour CN, Scheines R (2000) Causation, prediction, and search. Adaptive computation and machine learning, 2nd edn. MIT Press, CambridgezbMATHGoogle Scholar
  23. 23.
    Tsoularis A, Wallace J (2002) Analysis of logistic growth models. Math Biosci 179(1):21–55MathSciNetzbMATHGoogle Scholar
  24. 24.
    Verhulst PF (1838) Notice sur la loi que la populations suit dans son accroissement. Correspondence Mathématique et Physique. X:113–121Google Scholar
  25. 25.
    Vogels M et al (1975) P. F. Verhulst’s ‘Notice sur la loi que la populations suit dans son accroissement’ from correspondence mathematique et physique. Ghent, vol. X, 1838. J Biol Phys 3(4):183–192Google Scholar
  26. 26.
    Wilcox JR (2018) Research for practice: highlights in systems verification. Commun ACM 61(2):48–49Google Scholar
  27. 27.
    Woodward J (2001) Law and explanation in biology: invariance is the kind of stability that matters. Philos Sci 68(1):1–20Google Scholar
  28. 28.
    Zeigler BP, Praehofer H, Kim TG (2000) Theory of modeling and simulation, 2nd edn. Academic, San DiegozbMATHGoogle Scholar
  29. 29.
    Zwietering MH et al (1990) Modeling of the bacterial growth curve. Appl Environ Microbiol 56(6):1875–1881Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of PhilosophyVirginia TechBlacksburgUSA

Personalised recommendations