Looking Beyond Transfer Models: Finding Other Sources of Power for Student Models
Student modeling plays an important role in educational research. Many techniques have been developed focusing on accurately estimating student performances. In this paper, using Performance Factors Analysis as our framework, we examine what components of the model enable us to better predict, and consequently better understand, student performance. Using transfer models to predict is very common across different student modeling techniques, as student proficiencies on those required skills are believed, to a large degree, to determine student performance. However, we found that problem difficulty is an even more important predictor than student knowledge of the required skills. In addition, we found that using student proficiencies across all skills works better than just using those skills thought relevant by the transfer model. We tested our proposed models with two transfer models of fine- and coarse-grain sizes; the results suggest that the improvement is not simply an illusion due to possible mistakes in associating skills with problems.
Keywordsperformance factors analysis question difficulty student overall proficiencies predicting student performance
Unable to display preview. Download preview PDF.
- 1.Koedinger, K.R., Anderson, J.R., Hadley, W.H., Mark, M.A.: Intelligent Tutoring Goes to School in the Big City. Int. J. Artificial Intelligence in Education (1997)Google Scholar
- 4.Reye, J.: Student Modelling Based on Belief Networks. International Journal of Artificial Intelligence in Education 14, 63–96 (2004)Google Scholar
- 6.Pavlik, P.I., Cen, H., Koedinger, K.: Learning Factors Transfer Analysis: Using Learning Curve Analysis to Automatically Generate Domain Models. In: Proceedings of the 2rd International Conference on Educational Data Mining, pp. 121–130 (2009)Google Scholar
- 7.Barnes, T.: The q-matrix method: Mining student response data for knowledge. In: Proceedings of the AAAI 2005 Workshop on Educational Data Mining (2005)Google Scholar
- 8.Gong, Y., Beck, J.E., Heffernan, N.T.: How to Construct More Accurate student models: Comparing and Optimizing Knowledge Tracing and Performance Factor Analysis. International Journal of Artificial Intelligence in Education (to appear)Google Scholar
- 9.Winters, T.: Topic Extraction from Item-Level Grades. In: AAAI 2005 Workshop on Educational Data Mining (2005)Google Scholar
- 11.Beck, J.E., Mostow, J.: How who should practice: Using learning decomposition to evaluate the efficacy of different types of practice for different types of students. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 353–362. Springer, Heidelberg (2008)CrossRefGoogle Scholar
- 12.Razzaq, L., Feng, M., Nuzzo-Jones, G., Heffernan, N.T., Koedinger, K.R., Junker, B., Ritter, S., Knight, A., Aniszczyk, C., Choksey, S., Livak, T., Mercado, E., Turner, T.E., Upalekar, R., Walonoski, J.A., Macasek, M.A., Rasmussen, K.P.: The Assistment project: Blending assessment and assisting. In: Proceedings of the 12th Artificial Intelligence in Education, pp. 555–562 (2005)Google Scholar