Abstract
Parameter space exploration is a common problem tackled on large-scale computational resources. The most common technique, a full combinatorial mesh, is robust but scales poorly to the computational demands of complex models with higher dimensional spaces. Such models are routinely found in the modeling and simulation community. To alleviate the computational requirements, I have implemented two parallelized intelligent search and exploration algorithms: one based on adaptive mesh refinement and the other on regression trees. These algorithms were chosen because there is a dual interest in approaches that allow searching a parameter space for optimal values, as well as exploring the overall space in general. Both intelligent algorithms reduce computational costs at some expense to the quality of results, yet the regression tree approach was orders of magnitude faster than the other methodologies.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexander WP, Grimshaw SD (1996) Treed regression. J Comput Graph Stat 5(2):156–175
Anderson JR (2007) How can the human mind occur in the physical universe? Oxford University Press, Oxford
Bellman RE (1961) Adaptive control processes. Princeton University Press, Princeton
Berger MJ, Oliger JE (1984) Adaptive mesh refinement for hyperbolic partial differential equations. J Comput Phys 53:484–512
Bentley JL (1982) Writing efficient programs. Prentice-Hall, Upper Saddle River, p 34
Best BJ, Gerhart N, Furjanic C, Fincham J, Gluck KA, Gunzelmann G, Krusmark M (2009) Adaptive mesh refinement for efficient exploration of cognitive architectures and cognitive models. In: Proceedings of the ninth international conference on cognitive modeling (ICCM2009), Manchester, UK, pp 18–23 (Paper 252)
Chen J, Taylor V (1998) Mesh partitioning for distributed systems. In: Seventh IEEE international symposium on high performance distributed computing. IEEE Comput Soc, Washington, pp 292–300
Friedman J (1991) Multivariate adaptive regression splines. Ann Stat 19:1–141
Gluck KA, Stanley CT, Moore LR Jr, Reitter D, Halbrugge M (2010) Exploration for understanding in cognitive modeling. J Artif Gen Intell 2(2):88–107
Gunzelmann G, Gross JB, Gluck KA, Dinges DF (2009) Sleep deprivation and sustained attention performance: Integrating mathematical and cognitive modeling. Cogn Sci 33(5):880–910
Harris J, Gluck KA, Mielke T, Moore LRJr (2009) MindModeling@Home … and anywhere else you have idle processors. In: Proceedings of the ninth international conference on cognitive modeling, Manchester, UK (Paper 249)
Kase SE (2008) Parallel genetic algorithm optimization of a cognitive model: investigating group and individual performance on a math stressor task. Doctoral dissertation, Penn State University. Retrieved from http://etda.libraries.psu.edu/theses/approved/WorldWideIndex/ETD-3236/index.html
Kase S, Ritter FE (2009) An HPC and PGA approach to model calibration and validation. In: Proceedings of the 18th conference on behavior representation in modeling and simulation (BRIMS), Sundance, UT, pp 39–46 (Paper 10)
Knofcyznski GT, Mundfrom D (2008) Sample sizes when using multiple linear regression for prediction. Educ Psychol Meas 68(3):431–442
Moore LR Jr, Gunzelmann G, Gluck KA (2008) Evaluating mechanisms of fatigue using a digit symbol substitution task [Abstract]. In: Taatgen N, van Rijn H, Schomaker L, Nerbonne J (eds) Proceedings of the thirty-first annual meeting of the cognitive science society. Cognitive Science Society, Austin, p 1522
Moore LR Jr, Kopala M, Mielke T, Krusmark M, Gluck KA (2010) Simultaneous performance exploration and optimized search with volunteer computing. In: Dinda P (ed) Proceedings of the ACM international symposium on high performance distributed computing (HPDC), Chicago, IL, pp 312–315
Post D (2009) The promise and challenges for next generation of computers. PowerPoint presented at the Georgia Tech/AFRL computational science workshop on computational science challenges using emerging & massively parallel computer architectures, August 17, 2009, Atlanta, GA (p 17). Retrieved from http://www.cc.gatech.edu/~bader/AFRL-GT-Workshop2009/AFRL-GT-Post.pdf
Raymond WD, Fornberg B, Buck-Gengler CJ, Healy AF, Bourne LE (2008) Matlab optimization of an IMPRINT model of human behavior. In: Proceedings of the seventeenth conference on behavior representation in modeling and simulation (BRIMS). Simulation Interoperability Standards Organization, Providence, pp 26–33
Ritter FE (1991) Towards fair comparisons of connectionist algorithms through automatically generated parameter sets. In: Proceedings of the 13th annual conference of the cognitive science society. Erlbaum, Hillsdale, pp 877–881
Ritter FE, Schoelles MJ, Quigley KS, Klein LC (in press) Determining the number of model runs: treating cognitive models as theories by not sampling their behavior. In: Narayanan S, Rothrock L (eds) Human-in-the-loop simulations: Methods and practice. Springer, Berlin
Ritter FE, Shadbolt NR, Elliman D, Young R, Gobet F, Baxter GD (2003) Techniques for modeling human performance in synthetic environments: a supplementary review. Human Systems Information Analysis Center, Wright-Patterson Air Force Base
Roberts S, Pashler H (2000) How persuasive is a good fit? A comment on theory testing. Psychol Rev 107(2):358–367
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Moore, L.R. Cognitive model exploration and optimization: a new challenge for computational science. Comput Math Organ Theory 17, 296–313 (2011). https://doi.org/10.1007/s10588-011-9092-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10588-011-9092-8