The Mismatch of Intrinsic Fluctuations and the Static Assumptions of Linear Statistics
- 33 Downloads
The social and cognitive science replication crisis is partly due to the limitations of commonly used statistical tools. Inferential statistics require that unsystematic measurement variation is independent of system history, and weak relative to systematic or causal sources of variation. However, contemporary systems research underscores the dynamic, adaptive nature of social, cognitive, and behavioral systems. Variation in human activity includes the influences of intrinsic dynamics intertwined with changing contextual circumstances. Conventional inferential techniques presume milder forms of variability, such as unsystematic measurement error, as in a Gaussian distribution. Inferential statistics indicate an elementary Newtonian cause-effect metaphor for change that is inconsistent with known principles of change in complex systems. Pattern formation in self-organizing systems and quantum probability are used to illustrate theoretical metaphors that instantiate alternative notions of change in complex systems. Inferential statistics and related techniques are crucial scientific resources. However, in the social and behavioral sciences, they must be practiced in conjunction with an appropriate general systems framework that accommodates intrinsic fluctuations and contextual adaptation.
- Amon, M.J., and J.G. Holden. 2016. Fractal scaling and implicit bias: A conceptual replication of Correll (2008). In Proceedings of the 38th Annual Conference of the Cognitive Science Society, ed. A. Papafragou, D. Grodner, D. Mirman, and J.C. Trueswell, 1553–1558. Philadelphia: Cognitive Science Society.Google Scholar
- Amon, M.J., O. Pavlov, and J.G. Holden. 2018. Synchronization and fractal scaling as resources for cognitive control. Cognitive Systems Research. https://doi.org/10.1016/j.cogsys.2018.04.010.
- Balota, D.A., and J.I. Chumbley. 1984. Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. Journal of Experimental Psychology: Human Perception and Performance 10: 340–357. https://doi.org/10.1037//0096-15184.108.40.2060.CrossRefGoogle Scholar
- Camazine, S., N.R. Franks, J. Sneyd, E. Bonabeau, J.-L. Deneubourg, and G. Theraulaz. 2001. Self-organization in biological systems. Princeton: Princeton University Press.Google Scholar
- Digman, J.M. 1990. Personality structure: Emergence of the five-factor model. Annual Review of Psychology 41: 417–440. https://doi.org/10.1146/annurev.ps.41.020190.002221.CrossRefGoogle Scholar
- Forster, K. I., & Forster, J. C. 1996. DMASTR (version 2.16) [computer program]. Available at http://www.u.arizona.edu/~kforster/dmastr/dmastr.htm. Retrieved 9/1/1996
- Friedman, J., Hastie, T., & Tibshirani, R. 2009. The elements of statistical learning: Data mining, inference, and prediction. Springer series in statistics. Retrieved from http://www-stat.stanford.edu/~tibs/ElemStatLearn/.
- Gould, S.J. 1996. The mismeasure of man. New York: WW Norton & Company.Google Scholar
- Guastello, S.J., M.E. Koopmans, and D.E. Pincus. 2009. Chaos and complexity in psychology: The theory of nonlinear dynamical systems. Cambridge: Cambridge University Press.Google Scholar
- Handel, P.H., and A.L. Chung. 1993. Noise in physical systems and 1/"f" fluctuations. New York: American Institute of Physics.Google Scholar
- Hasselman, F. 2015. Beyond the boundary. An analysis of verisimilitude and causal ontology of scientific claims: Etiologies of developmental dyslexia as a case in point (Unpublished doctoral dissertation). Radboud University Nijmegen, Netherlands. Retrieved from https://doi.org/10.6084/m9.figshare.928517.
- Hollis, J., H. Kloos, and G. Van Orden. 2009. Origins of order in cognitive activity. In Chaos and complexity in psychology: The theory of nonlinear dynamical systems, ed. S.J. Guastello, M. Koopmans, and D. Pincus, 206–241. Cambridge: Cambridge University Press.Google Scholar
- Huey, E.B. 1908. The psychology and pedagogy of reading. New York: MacMillan.Google Scholar
- Kauffman, S. 1995. At home in the universe: The search for the laws of self-organization and complexity. New York: Oxford University Press.Google Scholar
- Kelso, S. 1995. Dynamic patterns: The self-organization of brain and behavior. Cambridge: MIT Press.Google Scholar
- Klein, J.L. 1997. Statistical visions in time: A history of time series analysis. New York: Cambridge University Press.Google Scholar
- Konvalinka, I., D. Xygalatas, J. Bulbulia, U. Schojødt, E.-M. Jegindø, S. Wallot, G. Van Orden, and A. Roepstorff. 2011. Synchronized arousal between performers and related spectators in a fire-walking ritual. Proceedings of the National Academy of Sciences 108: 8514–8519. https://doi.org/10.1073/pnas.1016955108.CrossRefGoogle Scholar
- Kučera, H., and W.N. Francis. 1967. Computational analysis of present-day American English. Providence: Brown University Press.Google Scholar
- Kugler, P.N., and M.T. Turvey. 1987. Information, natural law and the self-assembly of rhythmic movement. Hillsdale: Erlbaum.Google Scholar
- Lakoff, G. 1987. Women, fire and dangerous things: What categories reveal about thought.Google Scholar
- Luce, R.D. 1986. Response times: Their role in inferring elementary mental organization. New York: Oxford University Press.Google Scholar
- Mäkikallio, T.H., H.V. Huikuri, A. Makikallio, L.B. Sourander, R.D. Mitrani, A. Castellanos, and R.J. Myerburg. 2001. Prediction of sudden cardiac death by fractal analysis of heart rate variability in elderly subjects. Journal of the American College of Cardiology 37: 1395–1402.CrossRefGoogle Scholar
- Mitchell, J. 2014. On the emptiness of failed replications. Retrieved from http://wjh.harvard.edu/~jmitchel/writing/failed_science.htm
- Press, W.H. 1978. Flicker noises in astronomy and elsewhere. Comments on Astrophysics 7 (4): 103–119.Google Scholar
- Schmiedek, F., K. Oberauer, O. Wilhelm, H.M. Süß, and W.W. Wittmann. 2007. Individual differences in components of reaction time distributions and their relations to working memory and intelligence. Journal of Experimental Psychology: General 136: 414–429. https://doi.org/10.1037/0096-34220.127.116.114.CrossRefGoogle Scholar
- Shanon, B. 1993. The representational and the presentational: An essay on cognition and the study of the mind. New York: Harvester Wheatsheaf.Google Scholar
- Thelen, E., and L.B. Smith. 1994. A dynamic systems approach to the development of cognition and action. Cambridge: MIT Press.Google Scholar
- Townsend, J.T., and F.G. Ashby. 1983. The stochastic modeling of elementary psychological processes. Cambridge: Cambridge University Press.Google Scholar
- Uttal, W.R. 2001. The new phrenology: The limits of localizing cognitive processes in the brain. Cambridge: MIT Press.Google Scholar
- Van Orden, G., G. Hollis, and S. Wallot. 2012. The blue-collar brain. Frontiers in Physiology 3 (207). https://doi.org/10.3389/fphys.2012.00207.
- van Rooij, M., and J.G. Holden. 2013. Correspondence are cognitive functions localizable? Response. Journal of Economic Perspectives 27 (2): 250–252.Google Scholar
- Yu, L., Grebogi, C., & Ott, E. 1989. Fractal structure in physical space in the dispersal of particles in fluids. In L. Lam & H. C. Morris. Nonlinear Structures in Physical Systems: Pattern Formation, Chaos, and Waves (223–231). Proceedings of the Second Woodward Conference: San Jose State University.Google Scholar