Abstract
Affect dynamics, the study of how affect develops and manifests over the course of learning, has become a popular area of research in learning analytics. Despite some shared metrics and research questions, researchers in this area have some differences in how they pre-process the data for analysis [17]. Specifically, researchers differ in how they treat cases where a student remains in the same affective state in two successive observations, referred to as self-transitions. While most researchers include these cases in their data, D’Mello and others have argued over the last few years that these cases should be removed prior to analysis. While this choice reflects the intended focus in their research paradigm on the transitions out of an affective state, this difference in data preprocessing changes the meaning of the metric used. For around a decade, the community has used the metric L to evaluate the probability of transitions in affect. L is largely believed to have a value of 0 when a transition is at chance, and this is true for the original use of the metric. However, this paper provides mathematical evidence that this metric does not have a value of 0 at chance if self-transitions are removed. This shift is problematic because previously published statistical analyses comparing L values to the value at chance have used the wrong value, incorrectly producing lowered p values and in many cases reporting transitions as significantly more likely than chance when they are actually less frequent.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andres, J.M.L., Rodrigo, M.M.T.: The incidence and persistence of affective states while playing Newton’s playground. In: 7th IEEE International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (2014)
Baker, R.S.J.d., Rodrigo, M.M.T., Xolocotzin, U.E.: The dynamics of affective transitions in simulation problem-solving environments. In: Paiva, Ana C.R., Prada, R., Picard, Rosalind W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 666–677. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74889-2_58
Bosch, N., D’Mello, S.: Sequential patterns of affective states of novice programmers. In The 1st Workshop on AI-supported Education for Computer Science (AIEDCS 2013), pp. 1–10 (2013)
Bosch, N., D’Mello, S.: The affective experience of novice computer programmers. Int. J. Artif. Intell. Educ. 1–26 (2017)
Botelho, A.F., Baker, R., Ocumpaugh, J., Heffernan, N. Studying affect dynamics and chronometry using sensor-free detectors. In: Proceedings of the 11th International Conference on Educational Data Mining, pp. 157–166 (2018)
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37–46 (1960)
Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. J. Educ. Media 29(3), 241–250 (2004)
D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22, 145–157 (2012)
D’Mello, S., Person, N., Lehman, B.: Antecedent-consequent relationships and cyclical patterns between affective states and problem solving outcomes. In: AIED, pp. 57–64 (2009)
D’Mello, S., Taylor, R., Graesser, A.: Monitoring affective trajectories during complex learning. In: McNamara, D., Trafton, J. (eds.) Proceedings of 29th Annual Cognitive Science Society, pp. 203–208 (2007)
D’Mello, S., Graesser, A.: Modeling cognitive-affective dynamics with Hidden Markov models. In: Proceedings of the 32nd Annual Cognitive Science Society, pp. 2721–2726 (2010)
DeFalco, J.A., et al.: Detecting and addressing frustration in a serious game for military training. Int. J. Artif. Intell. Educ. 28(2), 152–193 (2018)
Guia, T.F.G., Rodrigo, M.M.T., Dagami, M., Sugay, J., Macam, F., Mitrovic, A.: An exploratory study of factors indicative of affective states of students using SQL-Tutor. Res. Pract. Technol. Enhanc. Learn. 8(3), 411–430 (2013)
Guia, T.F.G., Sugay, J., Rodrigo, M.M.T., Macam, F., Dagami, M., Mitrovic, A.: Transitions of affective states in an intelligent tutoring system. In: Proceedings of Philippine Computing Society, pp. 31–35 (2011)
Karumbaiah, S., Lizarralde, R., Allessio, D., Woolf, B.P., Arroyo, I., Wixon, N.: Addressing student behavior and affect with empathy and growth mindset. In: EDM (2017)
Karumbaiah, S., Rahimi, S., Baker, R.S., Shute, V.J., D’Mello, S.: Is student frustration in learning games more associated with game mechanics or conceptual understanding. In: International Conference of Learning Sciences (2018)
Karumbaiah, S., Andres, J.M.A.L., Botelho, A.F., Baker, R.S., Ocumpaugh, J.S.: The implications of a subtle difference in the calculation of affect dynamics. In: 26th International Conference for Computers in Education (2018)
Kuppens, P.: It’s about time: a special section on affect dynamics. Emot. Rev. 7(4), 297–300 (2015)
McQuiggan, S.W., Robison, J.L., Lester, J.C.: Affective transitions in narrative-centered learning environments. Educ. Technol. Soc. 13(1), 40–53 (2010)
McQuiggan, S.W., Robison, J.L., Lester, J.C.: Affective transitions in narrative-centered learning environments. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 490–499. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69132-7_52
Ocumpaugh, J., et al.: Affect dynamics in military trainees using vMedic: from engaged concentration to boredom to confusion. In: André, E., Baker, R., Hu, X., Rodrigo, M.Mercedes T., du Boulay, B. (eds.) AIED 2017. LNCS (LNAI), vol. 10331, pp. 238–249. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-61425-0_20
Pardos, Z.A., Baker, R.S., San Pedro, M.O., Gowda, S.M., Gowda, S.M.: Affective states and state tests: Investigating how affect throughout the school year predicts end of year learning outcomes. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp. 117–124. ACM, April 2013
Rodrigo, M.M.T., et al.: The effects of an embodied conversational agent on student affective dynamics while using an intelligent tutoring system. IEEE Trans. Affect. Comput. 2(4), 18–37 (2011)
Rodrigo, M.M.T., et al.: The effects of an interactive software agent on student affective dynamics while using; an intelligent tutoring system. IEEE Trans. Affect. Comput. 3(2), 224–236 (2012)
Rodrigo, M.M.T., et al.: The effects of motivational modeling on affect in an intelligent tutoring system. In: Proceedings of International Conference on Computers in Education, vol. 57, p. 64 (2008)
Acknowledgements
We would like to thank Penn Center for Learning Analytics and Nigel Bosch and Luc Paquette for comments and discussions that helped to motivate this research and our thinking about the issues in this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Karumbaiah, S., Baker, R.S., Ocumpaugh, J. (2019). The Case of Self-transitions in Affective Dynamics. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science(), vol 11625. Springer, Cham. https://doi.org/10.1007/978-3-030-23204-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-23204-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23203-0
Online ISBN: 978-3-030-23204-7
eBook Packages: Computer ScienceComputer Science (R0)