Evaluation of Data Aging: A Technique for Discounting Old Data during Student Modeling

Abstract

Student modeling systems must operate in an environment in which a student’s mastery of a subject matter is likely to change as a lesson progresses. A student model is formed from evaluation of evidence about the student’s mastery of the domain. However, given that such mastery will change, older evidence is likely to be less valuable than recent evidence. Data aging addresses this issue by discounting the value of older evidence. This paper provides experimental evaluation of the effects of data aging. While it is demonstrated that data aging can result in statistically significant increases in both the number and accuracy of predictions that a modeling system makes, it is also demonstrated that the reverse can be true. Further, the effects experienced are of only small magnitude. It is argued that these results demonstrate some potential for data aging as a general strategy, but do not warrant employing data aging in its current form.