Abstract
This paper deals with PépiMep, a diagnosis system in school algebra. Our proposal to evaluate the students’ open-ended answers is based on a mixed theoretical and empirical approach. First, researchers in Math Education list different types of anticipated patterns of answers and the way to evaluate them. Then, this information is stored in an XML file used by the system to match a student’s input with an anticipated answer. Third, as it is impossible to anticipate every student’s answer, the system can improve: when an unknown form is detected, it is added to the XML file after expert inspection. Results from testing 360 students showed that, in comparison with human experts, PépiMep (1) was very effective in recognizing the different types of solutions when students’ input was an algebraic expression (2) but was less effective when students entered a reasoned response expressed by a mix of algebraic expressions and natural language utterances.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Delozanne, É., Vincent, C., Grugeon, B., Gélis, J.-M., Rogalski, J., Coulange, L.: From errors to stereotypes: Different levels of cognitive models in school algebra. In: E-Learn, Vancouver, pp. 262–269 (2005)
Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F.: Automatic Multi-Criteria Assessment of Open-Ended Questions: A Case Study in School Algebra. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 101–110. Springer, Heidelberg (2008)
Kieran, C.: Learning and teaching algebra at the middle school through college levels. In: Second Handbook of Research on Mathematics Teaching and Learning, pp. 707–762. Frank K. Lester (2007)
Grugeon, B.: Design and development of a multidimensional grid of analysis in algebra (in French). RDM Journal 17, 167–210 (1997)
Shute, V.J., Hansen, E.G., Almond, R.G.: You Can’t Fatten A Hog by Weighing It–Or Can You? Evaluating an Assessment for Learning System Called ACED. IJAIED 18, 289–316 (2008)
Feng, M., Heffernan, N., Koedinger, K.: Addressing the assessment challenge with an online system that tutors as it assesses. UMUAI 19, 243–266 (2009)
Melis, E., Ullrich, C., Goguadze, G., Libbrecht, P.: Culturally Aware Mathematics Education Technology. In: The Handbook of Research in Culturally-Aware Information Technology: Perspectives and Models, Blanchard E. and Allard D, pp. 543–557 (2009)
Hakem, K., Sander, E., Labat, J.-M., Richard, J.-F.: DIANE, a diagnosis system for arithmetical problem solving. In: AIED, Amsterdam, pp. 258–265 (2005)
Nicaud, J.-F., Chaachoua, H., Bittar, M.: Automatic Calculation of Students’ Conceptions in Elementary Algebra from Aplusix Log Files. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 433–442. Springer, Heidelberg (2006)
Artigue, M., Grugeon, B., Lenfant, A.: Teaching and Learning Algebra: approaching complexity through complementary perspectives. In: ICMI, Melbourne, pp. 21–32 (2001)
Sésamath (May 28, 2011), http://www.sesamath.net/
Delozanne, É., Le Calvez, F., Merceron, A., Labat, J.-M.: A Structured set of Design Patterns for Learners’ Assessment. JILR 18, 309–333 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
El-Kechaï, N., Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F. (2011). Evaluating the Performance of a Diagnosis System in School Algebra. In: Leung, H., Popescu, E., Cao, Y., Lau, R.W.H., Nejdl, W. (eds) Advances in Web-Based Learning - ICWL 2011. ICWL 2011. Lecture Notes in Computer Science, vol 7048. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25813-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-25813-8_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25812-1
Online ISBN: 978-3-642-25813-8
eBook Packages: Computer ScienceComputer Science (R0)