Abstract
Effects such as student dropout and the non-normal distribution of duration data confound the exploration of tutor efficiency, time-in-tutor vs. tutor performance, in intelligent tutors. We use an accelerated failure time (AFT) model to analyze the effects of using automatically generated hints in Deep Thought, a propositional logic tutor. AFT is a branch of survival analysis, a statistical technique designed for measuring time-to-event data and account for participant attrition. We found that students provided with automatically generated hints were able to complete the tutor in about half the time taken by students who were not provided hints. We compare the results of survival analysis with a standard between-groups mean comparison and show how failing to take student dropout into account could lead to incorrect conclusions. We demonstrate that survival analysis is applicable to duration data collected from intelligent tutors and is particularly useful when a study experiences participant attrition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4(2), 167–207 (1995)
Anderson, J.R., Reiser, B.J.: The lisp tutor. Byte 10(4), 159–175 (1985)
Blischke, W.R., Murthy, D.P.: Reliability: Modeling, prediction, and optimization, vol. 767. Wiley (2011)
Breen, R., Lindsay, R., Jenkins, A., Smith, P.: The role of information and communication technologies in a university learning environment. Studies in Higher Education 26(1), 95–114 (2001)
Crow, E.L., Shimizu, K.: Lognormal distributions: Theory and applications, vol. 88. CRC Press, LLC (1988)
Croy, M.J.: Graphic interface design and deductive proof construction. J. Comput. Math. Sci. Teach. 18, 371–385 (1999)
Hosmer, D.W., Lemeshow, S., May, S.: Applied Survival Analysis: Regression Modeling of Time to Event Data, 2nd edn. Wiley-Interscience, New York (2008)
McGuigan, K.A., Ellickson, P.L., Hays, R.D., Bell, R.M.: Adjusting for attrition in school-based samples bias, precision, and cost trade-offs of three methods. Evaluation Review 21(5), 554–567 (1997)
Meeker, W.Q., Escobar, L.A.: Statistical methods for reliability data, vol. 314. Wiley. com (1998)
Miller, R.B., Hollist, C.S.: Attrition bias (2007)
Scanlon, E., Issroff, K.: Activity theory and higher education: evaluating learning technologies. Journal of Computer Assisted Learning 21(6), 430–439 (2005)
Stamper, J., Eagle, M., Barnes, T., Croy, M.: Experimental evaluation of automatic hint generation for a logic tutor. International Journal of Artificial Intelligence in Education (IJAIED) 22(1), 3–18 (2012)
Stamper, J.C., Eagle, M., Barnes, T., Croy, M.: Experimental evaluation of automatic hint generation for a logic tutor. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS, vol. 6738, pp. 345–352. Springer, Heidelberg (2011)
Therneau, T.M., Grambsch, P.M.: Modeling Survival Data: Extending the Cox Model. Springer, New York (2000)
Therneau, T.M.: A Package for Survival Analysis in S, R package version 2.37-7 (2014)
Weibull, W., et al.: A statistical distribution function of wide applicability. Journal of Applied Mechanics 18(3), 293–297 (1951)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Eagle, M., Barnes, T. (2014). Survival Analysis on Duration Data in Intelligent Tutors. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds) Intelligent Tutoring Systems. ITS 2014. Lecture Notes in Computer Science, vol 8474. Springer, Cham. https://doi.org/10.1007/978-3-319-07221-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-07221-0_22
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07220-3
Online ISBN: 978-3-319-07221-0
eBook Packages: Computer ScienceComputer Science (R0)