Advertisement

Collusion Detection Using Joint Response Time Models

  • Anne Thissen-RoeEmail author
  • Michael S. Finger
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 140)

Abstract

One method for detecting test collusion, or large-scale answer sharing, is the divergence framework (Belov, Journal of Educational Measurement 50: 141–163, 2013). It uses Kullback–Leibler divergence and a psychometric model to identify groups of test-takers with unusual person-fit distributions. A second phase examines individuals within anomalous groups. Another line of research considers collusion detection methods that depend on the identification of aberrant response times. These methods can be integrated for greater power, using joint statistical models for item response and response time. Here, we explore the value added when collusion detection is conducted under the divergence framework, using two joint models of responses and response times: the lognormal model within a hierarchical framework (van der Linden, Journal of Educational and Behavioral Statistics 31:181–204, 2006; van der Linden, Psychometrika 72:287–308, 2007), and a model extended from the diffusion family of models for choice reaction time (Ratcliff, Psychological Review 85:59–108, 1978; Ratcliff et al., Psychological Review 106:261–300, 1999).

Keyword

Response time 

References

  1. Belov, D. I. (2013). Detection of test collusion via Kullback–Leibler divergence. Journal of Educational Measurement, 50(2), 141–163.CrossRefGoogle Scholar
  2. Carroll, J. R. (1993). Human cognitive abilities: A survey of factor-analytic studies. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
  3. Finger, M., & Chuah, S. C. (2009). Response-time model estimation via confirmatory factor analysis. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego, CA.Google Scholar
  4. Laming, D. R. J. (1968). Information theory of choice reaction time. New York: Wiley.Google Scholar
  5. Link, S. W., & Heath, R. A. (1975). A sequential theory of psychological discrimination. Psychometrika, 40, 77–105.MathSciNetCrossRefzbMATHGoogle Scholar
  6. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59–108.CrossRefGoogle Scholar
  7. Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20, 873–922.CrossRefzbMATHGoogle Scholar
  8. Ratcliff, R., & Rouder, J. F. (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347–356.CrossRefGoogle Scholar
  9. Ratcliff, R., & Smith, P. L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychological Review, 111, 333–367.CrossRefGoogle Scholar
  10. Ratcliff, R., & Tuerlinckx, F. (2002). Estimating the parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomic Bulletin and Review, 9, 438–481.CrossRefGoogle Scholar
  11. Ratcliff, R., Van Zandt, T., & McKoon, G. (1999). Connectionist and diffusion models of reaction time. Psychological Review, 106, 261–300.CrossRefGoogle Scholar
  12. Stone, M. (1960). Models for choice reaction time. Psychometrika, 25, 251–260.CrossRefzbMATHGoogle Scholar
  13. Thissen-Roe, A., & Finger, M. S. (2014). Speed, speededness, and the price of high information. Paper presented at the Meeting of the Society for Industrial-Organizational Psychology, Honolulu, HI.Google Scholar
  14. Tuerlinckx, F., & De Boeck, P. (2005). Two interpretations of the discrimination parameter. Psychometrika, 70, 629–650.MathSciNetCrossRefGoogle Scholar
  15. van der Linden, W. J. (2006). A lognormal model for response times on test items. Journal of Educational and Behavioral Statistics, 31, 181–204.CrossRefGoogle Scholar
  16. van der Linden, W. J. (2007). A hierarchical framework for modeling speed and accuracy on test items. Psychometrika, 72, 287–308.MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.ComiraSan MateoUSA

Personalised recommendations