Computer-Automated Testing: An Evaluation of Student Performance
In the last few years, the need for an automated way to assess people has increased quickly because of the growing request from both private and public structures. Many Learning Management Systems (LMS) have been developed in order to automatize the learning and assessment process. In most of the cases these systems don’t allow a quality content evaluation and an efficient ability estimation. In this paper we analyze the features of the Proportional Odd Model (POM), belonging to the Item Response Theory. The POM enables to translate an automatic test deliver in an efficient way in order to get an evaluation through either a summative or a formative way. The data have been collected in some undergraduate courses of Bologna University, by using test delivering and by authoring system developed in ASP and Java, respectively.
KeywordsAutomatic test deliver automatic evaluation system undergraduate students ability system IRT models for ordered polytomous variables
- Gentner, D. and Stevens, A.L. (1983). Mental Models. New York: Lawrence Erlbaum Associates.Google Scholar
- Lord, F. M. and Novick, M.E. (1968). Statistical theories of mental test scores. New York: Addison-Wesley Publishing Co.Google Scholar
- Hambleton, R.K. and Swaminathan H. (1985). Item Response Theory. Boston: Kluwer-Nijhoff Publishing.Google Scholar
- Samejima, F. (1969). Estimation of ability using a response pattern of graded scores. Psychometrika Monograph, 17.Google Scholar