Advertisement

Dynamic Reliability Assessment of Multiple Choice Tests in distributed E-Leaning Environments: A Case Study

  • Ioanna Likourentzou
  • George Mpardis
  • Vassilis Nikolopoulos
  • Vassili Loumos
Part of the IFIP The International Federation for Information Processing book series (IFIPAICT, volume 247)

Abstract

The development of high-quality e-learning products is one of the most demanding areas in the field of educational research. Reliability of the students’ grading mechanisms especially in the case of virtual classrooms, which lack in physical student-instructor interaction, is extremely important. In this paper, based on real data, we utilize two reliability estimation methods to calculate several multiple choice tests’ reliability. Moreover, since multiple choice tests are an imperfect measure of students’ knowledge, we also estimate the students’ true ability of scoring using the tests’ standard error of measurement. Concluding this study embeds reliability assessment methods in the e-learning process and then carefully analyzes the produced data to provide the strengths and weaknesses of the analyzed course’s multiple choice tests.

Keywords

Student Evaluation Multiple Choice Test Virtual Classroom True Ability Reliability Estimation Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Wallace R. Blischke, D. N. Prabhakar Murthy, Reliability Modeling Prediction and Optimization, Wiley Series in Probability and statistics, 2000, p.18,19Google Scholar
  2. 2.
    Renee Bradley, Reliability Issues And Evidence, U.S Department of Education, Office of Special Education Programs (OSEP), Toolkit on Teaching and Assessing students with DisabilitiesGoogle Scholar
  3. 3.
    Richard A. Zeller, Edward G. Carmines, Reliability and Validity Assessment, Sage Publications, 1979Google Scholar
  4. 4.
    Rudner, L. M., & Schafer, W. D, Reliability, (ERIC Digest). College Park, MD: ERIC Clearinghouse on Assessment and Evaluation. (ERIC Document Reproduction Service No. ED458213), 2001Google Scholar
  5. 5.
    Leo M. Harvill, An NCME Instructional Module on. Standard Error of Measurement, Educational Measurement: Issues and Practice 10(2), 33–41, 1991CrossRefMathSciNetGoogle Scholar

Copyright information

© International Federation for Information Processing 2007

Authors and Affiliations

  • Ioanna Likourentzou
    • 1
  • George Mpardis
    • 1
  • Vassilis Nikolopoulos
    • 1
  • Vassili Loumos
    • 1
  1. 1.School of Electrical and Computer EngineeringNational Technical University of AthensZografou, Athens

Personalised recommendations