A Comparison of Bayesian and Traditional Indices for Measuring Information Gain Sensitivity in a Cloze Test
Standardized reading comprehension tests have been criticized for their inability to assess what a reader has gleaned from the passage during the reading process (Tuinman, 1973). Tuinman reported scores as high as 65 percent correct on multiple-choice comprehension tests which subjects answered without having had access to the passages on which the questions were based. Tuinman’s paper, among others, has caused reading researchers to focus on the distinction between comprehension and information gain (IG). In general, the concept of IG involves comparing the reader’s state of knowledge before and after reading the test passage. One method of assessing IG, suggested by Coleman and Miller (1967), is to obtain percent correct cloze scores before and after the subjects have had an opportunity to read the test passage in its original, unmutilated form; the difference between the posttest scores and the pretest scores is considered to be the IG score.
KeywordsInformation Gain Item Difficulty Foreign Student Posttest Score Pretest Score
Unable to display preview. Download preview PDF.
- Brennan, R. L. and L. M. Stolurow. 1971. An empirical decision process for formative evaluation. Research Memorandum No. 4. Cambridge, MA: Harvard University CAI Laboratory.Google Scholar
- Cox, R. C. and J. Vargas. 1966. A comparison of item selection techniques for norm-referenced and criterian-referenced tests. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.Google Scholar
- Helmstadter, G. C. 1974. A comparison of Bayesian and traditional indexes of test item effectiveness. Paper presented at the annual meeting of the National Council of Measurement in Education, Chicago.Google Scholar
- Iversen, G. R. 1984. Bayesian statistical inference. (Sage University paper No. 43. Series; Quantitative Applications in the Social Sciences). Beverly Hills, CA: Sage Publications, Inc.Google Scholar
- Popham, W. J. 1971. Indices of adequacy for criterion-referenced tests. In Popham, W. J., editor, Criterion-referenced measurement. Englewood Cliffs, NJ: Educational Technology Publications.Google Scholar
- Roid, G. and T. Haladyna. 1982. A technology for test-item writing. New York: Academic Press.Google Scholar