Advertisement

Education and Information Technologies

, Volume 24, Issue 6, pp 3767–3783 | Cite as

Fine-grained affect detection in learners’ generated content using machine learning

  • Emmanuel Awuni KologEmail author
  • Samuel Nii Odoi Devine
  • Kwame Ansong-Gyimah
  • Richard Osei Agjei
Article
  • 61 Downloads

Abstract

Learners’ adaptation to academic trajectory is shaped by several influencing factors that ought to be considered while attempting to design an intervention towards improving academic performance. Emotion is one factor that influences students’ academic orientation and performance. Tracking emotions in text by psychologists have long been a subject of concern to researchers. This is due to the challenges associated with determining the level of accuracy and consistency of decisions made from analysing such text by psychologists. Lately, Artificial Intelligence has complemented human efforts in tracking emotions in text. This paper provides an overview of machine learning application for detecting emotions in text through a Support vector machine learning system. In addition, we compared the performance of the system’s classifier to WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. Real time data from using the system in counselling delivery and collected students’ life stories were used for evaluating the performance of the classifiers. The evaluation results show that the Support vector machine, implemented in our system, is superior over WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. Nevertheless, the various classifiers performed beyond the acceptable threshold. The implication for the findings goes to indicate that machine learning algorithms can be implemented to track emotions in text, especially from students generated content.

Keywords

Emotion detection Counselling Machine learning Text classification 

Notes

References

  1. Al-Shihi, H., Sharma, S. K., & Sarrab, M. (2018). Neural network approach to predict mobile learning acceptance. Education and Information Technologies, 23(5), 1805–1824.  https://doi.org/10.1007/s10639-018-9691-9.CrossRefGoogle Scholar
  2. Arthur L. S. (1988). "Some studies in machine learning using the game of checkers. I". Computer Games I. Springer, New York. pp. 335–365.Google Scholar
  3. Artino, A. R., La Rochelle, J. S., & Durning, S. J. (2010). Second-year medical students’ motivational beliefs, emotions, and achievement. Medical Education, 44(12), 1203–1212.CrossRefGoogle Scholar
  4. Astleitner, H. (2000). Designing emotionally sound instruction: The FEASP-approach. Instructional Science, (3)28, 209-219.Google Scholar
  5. Balabantaray, R. C., Mohammad, M., & Sharma, N. (2012). Multi-class twitter emotion classification: A new approach. International Journal of Applied Information Systems, 4(1), 48–53.CrossRefGoogle Scholar
  6. Balahur, A., Hermida, J. M., & Montoyo, A. (2012). Detecting implicit expressions of emotion in text: A comparative analysis. Decision Support Systems, 53(4), 742-753.Google Scholar
  7. Barrett, L. F., & Russell, J. A. (1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74(4),  https://doi.org/10.1037/0022-3514.74.4.967.CrossRefGoogle Scholar
  8. Boekaerts, M. (2017). Motivation to learn. Educational practices 10. Available at https://iaoed.org/downloads/prac10e.pdf. Access: June 1, 2019
  9. Calefato, F., Lanubile, F., & Novielli, N. (2017, October). EmoTxt: a toolkit for emotion recognition from text. In 2017 seventh international conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 79-80). IEEE.Google Scholar
  10. Eisenberg, N., Spinrad, T. L., & Eggum, N. D. (2010). Emotion-related self-regulation and its relation to children's maladjustment. Annual review of clinical psychology, 6, (pp. 495-525).Google Scholar
  11. Ekman, P. (1992). Are There Basic Emotions? Psychological Review, 99(3), 550-553.CrossRefGoogle Scholar
  12. Frenzel, A. C., Pekrun, R., & Goetz, T. (2007). Perceived learning environment and students' emotional experiences: A multilevel analysis of mathematics classrooms. Learning and Instruction, 17(5), 478–493.CrossRefGoogle Scholar
  13. Goetz, T., Pekrun, R., Hall, N., & Haag, L. (2006). Academic emotions from a social-cognitive perspective: Antecedents and domain specificity of students' affect in the context of Latin instruction. British Journal of Educational Psychology, 76(2), 289–308.CrossRefGoogle Scholar
  14. Hadwin, A. F., Järvelä, S., & Miller, M. (2011). Self-regulated, co-regulated, and socially shared regulation of learning. Handbook of Self-regulation of Learning and Performance, 30, 65–84.Google Scholar
  15. Hashem, E., & Mabrouk, M. (2014). A study of support vector machine algorithm for liver disease diagnosis. American Journal of Intelligent Systems, 4(1), 9–14.Google Scholar
  16. Isen, A. M. (1999). Positive affect. Handbook of Cognition and Emotion, 20, 522–539.Google Scholar
  17. James, L. (2012). Evaluation of an adaptive learning technology as a predictor of student performance in undergraduate biology. Appalachian State University, North Carolina.Google Scholar
  18. Järvenoja, H., & Järvelä, S. (2009). Emotion control in collaborative learning situations: Do students regulate emotions evoked by social challenges. British Journal of Educational Psychology, 79(3), 463–481.CrossRefGoogle Scholar
  19. Kim, C., & Pekrun, R. (2014). Emotions and motivation in learning and performance. In Handbook of research on educational communications and technology (pp. 65–75). New York: Springer.CrossRefGoogle Scholar
  20. Kolog, E. A., & Suero Montero, C. (2018). Towards automated e-counselling system based on Counsellors' emotion perception. Education and Information Technologies, 23(2), 911-933..Google Scholar
  21. Kolog, E. A., Sutinen, E., Vanhalakka-Ruoho, M., Sohunen, J., & Anohah, E. (2015). Using unified theory of acceptance and use of technology model to predict students’ behavioral intention to adopt and use E - counseling in Ghana. International Journal of Modern Education and Computer Science, 7(11), 1–11.CrossRefGoogle Scholar
  22. Kolog E.A., Montero C.S., & Toivonen T. (2018). Using machine learning for sentiment and social influence analysis in text. In: Rocha Á., Guarda T. (eds) Proceedings of the international conference on Information Technology & Systems (ICITS 2018). ICITS 2018. Advances in intelligent systems and computing, vol 721. Springer, Cham.Google Scholar
  23. Landis, J., & Kouch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.CrossRefGoogle Scholar
  24. Levine, L. J., & Pizarro, D. A. (2004). Emotion and memory research: A grumpy overview. Social Cognition, 22(5: Special issue), 530–554.CrossRefGoogle Scholar
  25. Li, S., Huang, L., Wang, R. and Zhou, G (2015). Sentence-level emotion classification with label and context dependence. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International.Google Scholar
  26. Lugmayr, A., Sutinen, E., Suhonen, J., Sedano, C., Hlavacs, H., & Montero, C. (2016). Serious storytelling – A first definition and review. Multimedia Tools and Applications, 76(14), 15707-15733.Google Scholar
  27. Ohle, A., & McElvany, N. (2015). Teachers’ diagnostic competences and their practical relevance. Special Issue Editorial, Journal for Educational Research Online, 7(2).Google Scholar
  28. Ouano, J. A. (2011). Motivational antecedents of academic emotions in Filipino college students. Asia-Pacific Education Researcher, 20(1), 127–132.Google Scholar
  29. Parrott, W. G., & Spackman, M. P. (2000). Emotion and memory. Handbook of Emotions, 2, 476–490.Google Scholar
  30. Peffers, K., Tuunanen, T., Gengler, C. E., Rossi, M., Hui, W., Virtanen, V., & Bragge, J. (2006). The design science research process: A model for producing and presenting information systems research. In Proceedings of the first international conference on design science research in information systems and technology, (pp. 83–106).Google Scholar
  31. Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18, 315-341.  https://doi.org/10.1007/s10648-006-9029-9.CrossRefGoogle Scholar
  32. Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students' self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–105.CrossRefGoogle Scholar
  33. Pekrun, R., Elliot, A. J., & Maier, M. A. (2006). Achievement goals and discrete achievement emotions: A theoretical model and prospective test. Journal of Educational Psychology, 98(3), 583–597.CrossRefGoogle Scholar
  34. Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40.CrossRefGoogle Scholar
  35. Plutchik, R. (1980). Emotion: Theory, research, and experience: Theories of emotion (Vol. 1, p. 399). New York: Academic.Google Scholar
  36. Purver, M., & Battersby, S. (2012). Experimenting with distant supervision for emotion classification. In Proceedings of the 13th Conference of the European chapter of the Association for Computational Linguistics (pp. 482–491). Association for Computational Linguistics.Google Scholar
  37. Schwarz, N. (2000). Agenda 2000: Attitudes and social judgment—Warmer, more social, and less conscious. European Journal of Social Psychology, 30, 149–176CrossRefGoogle Scholar
  38. Shina, D., & Choib, M. (2014). Ecological views of big data: Perspective and issues. Telematics and informatics, (pp. 311-320).Google Scholar
  39. Vibulphol, J. (2016). Students’ motivation and learning and teachers’ motivational strategies in english classrooms in Thailand. Canadian Center of Science and Education. Vol. 9, No. 4.CrossRefGoogle Scholar
  40. Villavicencio, F. T., & Bernardo, A. B. (2013). Positive academic emotions moderate the relationship between self-regulation and academic achievement. British Journal of Educational Psychology, 83(2), 329–340.CrossRefGoogle Scholar
  41. Wang, C., Chen, M. H., Schifano, E., Wu, J., & Yan, J. (2016). Statistical methods and computing for big data. Statistics and its interface, 9(4), 399.09-6 Published online 2017 Aug 9.  https://doi.org/10.1002/cjs.11330.MathSciNetCrossRefGoogle Scholar
  42. You, J. W., & Kang, M. (2014). The role of academic emotions in the relationship between perceived academic control and self-regulated learning in online learning. Computers & Education, 77, 125–133.CrossRefGoogle Scholar
  43. Zhang, L., Jiang, M., Farid, D., & Hossain, M.A. (2013). Intelligent facial emotion recognition and semantic based topic detection for a humanoid robot. Expert Systems with Applications, 40 (13), 5160–5168.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  • Emmanuel Awuni Kolog
    • 1
    Email author
  • Samuel Nii Odoi Devine
    • 2
  • Kwame Ansong-Gyimah
    • 3
  • Richard Osei Agjei
    • 4
  1. 1.Department of Operations and Management Information SystemsUniversity of Ghana Business SchoolLegon AccraGhana
  2. 2.Department of Information and Communication TechnologyPresbyterian University CollegeAbetifiGhana
  3. 3.Department of Information Technology EducationUniversity of Education-WinnebaKumasiGhana
  4. 4.School of Public HealthUniversity of Central NicaraguaManaguaNicaragua

Personalised recommendations