Abstract
The adage, “We learn from our mistakes,” is a familiar one. Most of us recognize that some of our most meaningful learning experiences have come about as a result of saying or doing the wrong thing. The value of mistakes, however, is dependent upon our ability to recognize them as such and to gather information from them that points us in a more positive direction. The errors that students make in classrooms can also be instructive if we acknowledge that mistakes typically arise from thoughtful, albeit misguided or incomplete, processing and if there is a systematic way to identify these mistakes and to unlock the diagnostic information they hold (Alexander, 1989; Alexander, Pate, Kulikowich, Farrell, & Wright, 1989).
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alexander, P. A. (1989). Categorizing learner responses on domain-specific analogy tests: A case for error analysis. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
Alexander, P. A. (1992). Domain knowledge: Evolving themes and emerging concerns. Educational Psychologist, 27, 33–51.
Alexander, P. A., & Judy, J. E. (1988). The interaction of domain-specific and strategic knowledge in academic performance. Review of Educational Research, 58, 375–404.
Alexander, P. A., Pate, P. E., Kulikowich, J. M., Farrell, D. M., & Wright, N. L. (1989). Domain-specific and strategic knowledge: Effects of training on students of differing ages or competence levels. Learning and Individual Differences, 1, 283–325.
Alexander, P. A., Willson, V. L., White, C. S., & Fuqua, J. D. (1987). Analogical reasoning in young children. Journal of Educational Psychology, 26, 401–408.
Ashlock, R. B. (1986). Error patterns in computation: A semi-programmed approach. Columbus, OH: Merrill.
Baker, E. L., & Herman, J. L. (1983). Task structure design: Beyond linkage. Journal of Educational Measurement, 20, 149–164.
Bishop, Y. M. M., Fienberg, S. E., & Holland, P. W. (1975). Discrete multivariate analysis: Theory and practice. Cambridge, MA: MIT Press.
Birenbaum, M., & Tatsuoka, K. K. (1983). The effect of a scoring system based on the algorithm underlying the students’ response patterns on the dimensionality of achievement test data of the problem solving type. Journal of Educational Measurement, 20, 17–26.
Bock, R. D. (1972). Estimating item parameters and latent proficiency when the responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.
Brown, J. S., & Burton, R. (1978). Diagnostic models for procedural bugs in basic mathematical skills. Cognitive Science, 2, 155–192.
Brown, J. S., & VanLehn, K. (1980). Repair theory: A generative theory of bugs in procedural skills. Cognitive Science, 4, 379–426.
Carey, S. (1985). Are children fundamentally different kinds of thinkers and learners than adults? In S. F. Chipman, J. W. Segal, and R. Glaser (Eds.), Thinking and learning skills (Vol. 2: pp. 485–517 ). Hillsdale, NJ: Lawrence Erlbaum.
Chi, M. T. H. (1985). Interactive roles of knowledge and strategies in the development of organized sorting and recall. In S. F. Chipman, J. W. Segal, and R. Glaser (Eds.), Thinking and learning skills (Vol. 2: pp. 457–484 ). Hillsdale, NJ: Lawrence Erlbaum.
Clement, J. (1982). Students’ preconceptions in introductory mechanics. American Journal of Physics, 50, 66–71.
Embretson, S. E. (1984). A general latent trait model for response processes. Psychometrika, 49, 175–186.
Embretson, S. E. (1985). Multicomponent latent trait models for test design. In S. E. Embretson (Ed.), Test design: Developments in psychology and psychometrics (pp. 195218 ). Orlando, FL: Academic Press.
Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.
Garner, R. (1987). Metacognition and reading comprehension. Norwood, NJ: Ablex. Garner, R., Alexander, P. A., Gillingham, M. G., Kulikowich, J. M., & Brown, R. (1991).
Interest and learning from text. American Educational Research Journal, 28,643–659.
Geboyts, R. J., & Claxton-Oldfield, S. P. (1989). Errors in the quantification of uncertainty: A product of heuristics or minimal probability knowledge base? Applied Cognitive Psychology, 3, 157–170.
Green, B. F., Crone, C. R., & Folk, V. G. (1989). A method of studying differential distractor functioning. Journal of Educational Measurement, 26, 147–160.
Gronlund, N. E., & Linn, R. L. (1990). Measurement and evaluation in teaching. New York: Macmillan.
Guttman, L., & Schlesinger, I. M. (1967). Systematic construction of distractors for ability and achievement test items. Educational and Psychological Measurement, 27, 569–580.
Hambleton, R. K., & Cook, L. L. (1977). Latent trait models and their use in the analysis of educational test data. Journal of Educational Measurement, 14, 75–96.
Hambleton, R. K., Roberts, D., & Traub, R. E. (1970). A comparison of the reliability and validity of two methods for assessing partial knowledge on a multiple-choice test. Journal of Educational Measurement, 7, 75–82.
Judy, J. E., Alexander, P. A., Kulikowich, J. M., & Willson, V. L. (1988). Effects of two instructional approaches and peer tutoring on gifted and nongifted sixth graders’ analogy performance. Reading Research Quarterly, 23, 236–256.
Kulikowich, J. M. (1990). Application of latent trait and multidimensional scaling models to cognitive domain-specific tests. Unpublished doctoral dissertation, Texas AandM University, College Station, TX.
Kulikowich, J. M., & Alexander, P. A. (1990). Application of a General Euclidean Model to analyze hierarchically-constructed achievement tests. Paper presented at the annual meeting of the American Educational Research Association, Boston.
Linn, R. L. (1990). Has item response theory increased the validity of achievement test scores? Applied Measurement in Education, 3, 115–141.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149174.
Matz, M. (1982). A process model for high school algebra errors. In D. Sleeman and J. S. Brown (Eds.), Intelligent tutoring systems. London: Academic.
Mislevy, R. J., Yamamoto, K., & Anacker, S. (1991). Toward a test theory for assessing student understanding. (Tech. Rep. No. RR–91–32–0NR). Princeton, NJ: Educational Testing Service.
Pate, P. E., Alexander, P. A., & Kulikowich, J. M. (1989). Assessing the effects of training social studies content and analogical reasoning processes on sixth-graders’ domain-specific and strategic knowledge. In D. B. Strahan (Ed.), Middle school research: Selected studies 1989 (pp. 19–29 ). Columbus, OH: Research Committee of the National Middle School Association.
Payne, S. J., & Squibb, H. R. (1990). Algebra mal-rules and cognitive accounts of error. Cognitive Science, 14, 445–481.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.
Resnick, L. B. (1989). Treating mathematics as an ill-structured discipline. In R. I. Charles and E. A. Silver (Eds.), The teaching and assessing of mathematical problem solving (pp. 32–60 ). Reston, VA: National Council of Teachers of Mathematics.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement No. 17.
Sax, G. (1989). Principles of educational and psychological measurement and evaluation. Belmont, CA: Wadsworth.
Sheehan, K., & Mislevy, R. J. (1990). Integrating cognitive and psychometric models to measure document literary. Journal of Educational Measurement, 27, 255–272.
Smith, R. (1987). Assessing partial knowledge in vocabulary. Journal of Educational Measurement, 13, 130–141.
Snow, R. E., & Mandinach, E. B. (1991). Integrating assessment and instruction: A research and development agenda. (Tech. Rep. No. RR-91–8). Princeton, NJ: Educational Testing Service.
Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on Item Response Theory. Journal of Educational Measurement, 20, 345–354.
Tatsuoka, K. K., & Tatsuoka, M. M. (1983). Spotting erroneous rules of operation by the individual consistency index. Journal of Educational Measurement, 3, 221–230.
Tatsuoka, K. K., & Tatsuoka, M. M. (1987). Bug distributions and statistical pattern classification. Psychometrika, 52, 193–206.
Thissen, D. (1976). Information in wrong responses to the Ravens Progressive Matrices. Journal of Educational Measurement, 13, 201–214.
Thissen, D., & Steinberg, L. (1984). A response model for multiple choice items. Psychometrika, 49, 501–519.
Thissen, D., Steinberg, L., & Fitzpatrick, A. R. (1989). Multiple-choice models: The dis-tractors are also part of the item. Journal of Educational Measurement, 26, 161–176.
White, R. T. (1985). Interview protocols and dimensions of cognitive structure. In L. H. T. West and A. L. Pines (Eds.), Cognitive structure and conceptual change (pp. 51–59 ). New York: Academic Press.
Whitely, S. E. (1980). Multicomponent latent trait models for ability tests. Psychometrika, 45, 479–494.
Wilson, M. R. (1989). Saltus: A psychometric model of discontinuity in cognitive development. Psychological Bulletin, 105, 276–289.
Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: MESA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer Science+Business Media New York
About this chapter
Cite this chapter
Kulikowich, J.M., Alexander, P.A. (1994). Evaluating Students’ Errors on Cognitive Tasks: Applications of Polytomous Item Response Theory and Log-Linear Modeling. In: Reynolds, C.R. (eds) Cognitive Assessment. Perspectives on Individual Differences. Springer, Boston, MA. https://doi.org/10.1007/978-1-4757-9730-5_7
Download citation
DOI: https://doi.org/10.1007/978-1-4757-9730-5_7
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-9732-9
Online ISBN: 978-1-4757-9730-5
eBook Packages: Springer Book Archive