Advertisement

Assessing Model Performance with Generalization Tests

  • Brandon M. Turner
  • Birte U. Forstmann
  • Mark Steyvers
Chapter
Part of the Computational Approaches to Cognition and Perception book series (CACP)

Abstract

This chapter focuses on the problem of model evaluation, and it is separated into three parts. First, we discuss how to assess model fit to the existing data. Second, we discuss methods of assessing the model’s generalizability to new data. Third, we present the details necessary to carry out several methods of model assessment.

Keywords

Cross validation Generalization Prediction 

References

  1. 3.
    J.D. Schall, Annu. Rev. Psychol. 55, 23 (2004)CrossRefGoogle Scholar
  2. 12.
    B.M. Turner, B.U. Forstmann, E.J. Wagenmakers, S.D. Brown, P.B. Sederberg, M. Steyvers, NeuroImage 72, 193 (2013)CrossRefGoogle Scholar
  3. 18.
    B.M. Turner, L. Van Maanen, B.U. Forstmann, Psychol. Rev. 122, 312 (2015)CrossRefGoogle Scholar
  4. 46.
    B.M. Turner, C.A. Rodriguez, T. Norcia, M. Steyvers, S.M. McClure, NeuroImage 128, 96 (2016)CrossRefGoogle Scholar
  5. 57.
    B.M. Turner, B.U. Forstmann, B.C. Love, T.J. Palmeri, L. Van Maanen, J. Math. Psychol. 76, 65 (2017)CrossRefGoogle Scholar
  6. 62.
    W. Vanpaemel, J. Math. Psychol. 54, 491 (2010)CrossRefGoogle Scholar
  7. 64.
    W. Vanpaemel, M.D. Lee, Psychon. Bull. Rev. 19, 1047 (2012)CrossRefGoogle Scholar
  8. 68.
    B.M. Turner, T. Wang, E. Merkel, NeuroImage 153, 28 (2017)CrossRefGoogle Scholar
  9. 71.
    S. Roberts, H. Pashler, Psychol. Rev. 107, 358 (2000)CrossRefGoogle Scholar
  10. 72.
    B.M. Turner, S. Dennis, T. Van Zandt, Psychol. Rev. 120, 667 (2013)CrossRefGoogle Scholar
  11. 73.
    A.R. Teodorescu, M. Usher, Psychol. Rev. 120, 1 (2013)CrossRefGoogle Scholar
  12. 74.
    I.J. Myung, M.A. Pitt, Psychon. Bull. Rev. 4, 79 (1997)CrossRefGoogle Scholar
  13. 75.
    I.J. Myung, J. Math. Psychol. 44, 190 (2000)CrossRefGoogle Scholar
  14. 76.
    I.J. Myung, M. Forster, M.W. Browne, J. Math. Psychol. 44, 1 (2000)CrossRefGoogle Scholar
  15. 77.
    J.I. Myung, M. Montenegro, M.A. Pitt, J. Math. Psychol. 51, 198 (2007)CrossRefGoogle Scholar
  16. 78.
    M. Montenegro, J.I. Myung, M.A. Pitt, REM integral expressions (2011). Unpublished manuscriptGoogle Scholar
  17. 79.
    A. Gelman, J.B. Carlin, H.S. Stern, D.B. Rubin, Bayesian Data Analysis (Chapman and Hall, New York, 2004)Google Scholar
  18. 80.
    C.C. Liu, M. Aitkin, J. Math. Psychol. 52, 362 (2008)CrossRefGoogle Scholar
  19. 81.
    Q.F. Gronau, A. Sarafoglou, D. Matzke, A. Ly, U. Boehm, M. Marsman, D.S. Leslie, J.J. Forster, E.J. Wagenmakers, H. Steingroever, J. Math. Psychol. 81, 80 (2018)CrossRefGoogle Scholar
  20. 82.
    I.J. Myung, M. Pitt, in Stevens’ Handbook of Experimental Psychology, 3rd edn., ed. by H. Pashler, J. Wixted (Wiley, New York, 2002), pp. 429–460Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Brandon M. Turner
    • 1
  • Birte U. Forstmann
    • 2
  • Mark Steyvers
    • 3
  1. 1.Department of PsychologyThe Ohio State UniversityColumbusUSA
  2. 2.Cognitive Science CenterUniversity of AmsterdamAmsterdamThe Netherlands
  3. 3.Department of Cognitive SciencesUniversity of California, IrvineIrvineUSA

Personalised recommendations