Abstract
Much research has been done on the development of an intelligent tutoring system (ITS), and small empirical studies have demonstrated the effectiveness of ITS at promoting student learning. However, large-scale implementation of ITS in school settings has not been researched thoroughly. In this paper, we describe an ongoing randomized controlled trial (RCT) to evaluate the efficacy of a web-based tutoring system—the ASSISTments—as support for homework. The program is used in 46 middle schools in the state of Maine, to provide immediate feedback to students, and to provide reports to teachers to support homework review and instruction adaptation. We describe the challenges for the RCT, approaches used to understand implementation of the system, and findings on how the system is being used.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4(2), 167–207 (1995)
Anderson, J.R.: Learning and memory: An integrated approach, 2nd edn. John Wiley and Sons, Inc., New York (2000)
Arroyo, I., Cooper, D., Burleson, W., Woolf, B.P., Muldner, K., Christopherson, R.: Emotion sensors go to school, Conference on Artificial Intelligence in Education (2009)
Cordray, D.S.: Fidelity of intervention implementation. Paper presented at the IES, Research Conference (2008)
Cooper, H., Robinson, J., Patall, E.: Does homework improve academic achievement? A synthesis of research, 1987-2003. Review of Educational Research 76, 1–62 (2006)
Dufresne, R., Mestre, J., Hart, D.M., Rath, K.A.: The effect of web-based homework on test performance in large enrollment introductory physics courses. Journal of Computers in Mathematics and Science Teaching 213, 229–251 (2002)
Karam, R., Pane, J.F., Griffin, B.A., Slaughter, M.E.: Evaluating Cognitive Tutor Algebra I curricula at scale: Focus on implementation (submitted)
Kelly, K., Heffernan, N., Heffernan, C., Goldman, S., Pellegrino, J., Soffer Goldstein, D.: Estimating the effect of web-based homework. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 824–827. Springer, Heidelberg (2013)
Koedinger, K.R., Anderson, J.R., Hadley, W.H., Mark, M.A.: Intelligent tutoring goes to school in the big city. Journal of Artificial Intelligence in Education 8, 30–43 (1997)
Kohn, A.: The homework myth: Why our kids get too much of a bad thing. Da Capo Press, Cambridge (2006)
Mendicino, M., Razzaq, L., Heffernan, N.T.: Comparison of traditional homework with computer supported homework: Improving learning from homework using intelligent tutoring systems. Journal of Research on Technology in Education (JRTE) 41(3), 331–359 (2009)
Pane, J.F., Griffin, B.A., McGaffrey, D.F., Karam, R.: Effectiveness of Cognitive Tutor Algebra I at Scale. Working paper (2013)
Singh, R., Saleem, M., Pradhan, P., Heffernan, C., Heffernan, N., Razzaq, L., Dailey, M.: Improving K-12 homework with computers. In: Proceedings of the Artificial Intelligence in Education Conference, Auckland, New Zealand (2011)
VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist 46(4), 197–221 (2011)
VanLehn, K., Lynch, C., Schulze, K., Shapiro, J.A., Shelby, R., Taylor, L., Treacy, D., Weinstein, A., Wintersgill, M.: The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence and Education 15(3), 1–47 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Feng, M., Roschelle, J., Heffernan, N., Fairman, J., Murphy, R. (2014). Implementation of an Intelligent Tutoring System for Online Homework Support in an Efficacy Trial. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds) Intelligent Tutoring Systems. ITS 2014. Lecture Notes in Computer Science, vol 8474. Springer, Cham. https://doi.org/10.1007/978-3-319-07221-0_71
Download citation
DOI: https://doi.org/10.1007/978-3-319-07221-0_71
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07220-3
Online ISBN: 978-3-319-07221-0
eBook Packages: Computer ScienceComputer Science (R0)