Dynamic Reliability Assessment of Multiple Choice Tests in distributed E-Leaning Environments: A Case Study
The development of high-quality e-learning products is one of the most demanding areas in the field of educational research. Reliability of the students’ grading mechanisms especially in the case of virtual classrooms, which lack in physical student-instructor interaction, is extremely important. In this paper, based on real data, we utilize two reliability estimation methods to calculate several multiple choice tests’ reliability. Moreover, since multiple choice tests are an imperfect measure of students’ knowledge, we also estimate the students’ true ability of scoring using the tests’ standard error of measurement. Concluding this study embeds reliability assessment methods in the e-learning process and then carefully analyzes the produced data to provide the strengths and weaknesses of the analyzed course’s multiple choice tests.
KeywordsStudent Evaluation Multiple Choice Test Virtual Classroom True Ability Reliability Estimation Method
- 1.Wallace R. Blischke, D. N. Prabhakar Murthy, Reliability Modeling Prediction and Optimization, Wiley Series in Probability and statistics, 2000, p.18,19Google Scholar
- 2.Renee Bradley, Reliability Issues And Evidence, U.S Department of Education, Office of Special Education Programs (OSEP), Toolkit on Teaching and Assessing students with DisabilitiesGoogle Scholar
- 3.Richard A. Zeller, Edward G. Carmines, Reliability and Validity Assessment, Sage Publications, 1979Google Scholar
- 4.Rudner, L. M., & Schafer, W. D, Reliability, (ERIC Digest). College Park, MD: ERIC Clearinghouse on Assessment and Evaluation. (ERIC Document Reproduction Service No. ED458213), 2001Google Scholar