Skip to main content

Detecting Emotions in Students’ Generated Content: An Evaluation of EmoTect System

  • Conference paper
  • First Online:
Technology in Education. Innovative Solutions and Practices (ICTE 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 843))

Included in the following conference series:

Abstract

In this paper, an intelligent e-counselling system for automatic detection of emotion in text is evaluated. A support vector machine classifier was used for the development of the e-counselling system, hence we compared the performance of the e-counselling system’s classifier with WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. While this paper is geared towards ascertaining the efficacy of the various classifiers for classifying emotions in learners’ generated text content, this paper also aims to ascertain the performance of the e-counselling system for complementing decision making concerning students in counselling delivery. In building the system, an annotated students’ life story corpus was developed and used for the experiment. Therefore, 85% of the total instances of the life stories was used as training data while the remaining 15% was used as test data with sample instances of real-time data from students’ textual submission through the e-counselling system. The results of the experiment show that the SVM, implemented in our proposed e-counselling system, is superior over the MNB and J48 classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    www.nlp4counselling.com.

  2. 2.

    http://www.cs.waikato.ac.nz/ml/weka/arff.html.

References

  • Balabantaray, R.C., Mohammad, M., Sharma, N.: Multi-class twitter emotion classification: a new approach. Int. J. Appl. Inf. Syst. 4(1), 48–53 (2012)

    Google Scholar 

  • Crowston, K., Liu, X., Allen, E.E.: Machine learning and rule-based automated coding of qualitative data. Proc. Am. Soc. Inf. Sci. Technol. 47, 1–2 (2010)

    Google Scholar 

  • Gandomi, A., Haider, M.: Beyond the hype: big data concepts, methods, and analytics. Int. J. Inf. Manag. 35(2), 137–144 (2015)

    Article  Google Scholar 

  • Glasheen, K., Campbell, M., Shochet, I.: Opportunities and challenges: school guidance counsellors’ perceptions of counselling students online. Aust. J. Guid. Couns. 23, 222–235 (2013)

    Article  Google Scholar 

  • Hashem, E., Mabrouk, M.: A study of support vector machine algorithm for liver disease diagnosis. Am. J. Intell. Syst. 4(1), 9–14 (2014)

    Google Scholar 

  • Hrastinski, S.: Introducing an informal synchronous medium in a distance learning course: how is participation affected? Internet High. Educ. 9(2), 117–131 (2006)

    Article  Google Scholar 

  • Igbokwe, J.C., Obidike, N.A., Ezeji, E.C.: Influence of electronic media on reading ability of school children (2012)

    Google Scholar 

  • Inman, A., Ngoubene-Atioky, A., Ladany, N., Mack, T.: School counselors in international school: critical issues and challenges. Int. J. Adv. Couns. 31, 80–99 (2009)

    Article  Google Scholar 

  • Jain, M.C., Kulkarni, V.Y.: TexEmo: conveying emotion from text-the study. Int. J. Comput. Appl. 86(4), 43–49 (2014)

    Google Scholar 

  • Jung, N., Wranke, C., Hamburger, K., Knauff, M.: How emotions affect logical reasoning: evidence from experiments with mood-manipulated participants, spider phobics, and people with exam anxiety. Front. Psychol. 5, 570 (2014)

    Google Scholar 

  • King, R., Bambling, M., Reid, W., Thomas, I.: Telephone and online counselling for young people: a naturalistic comparison of session outcome, session impact and therapeutic alliance. Couns. Psychother. Res. 6(3), 175–181 (2006)

    Article  Google Scholar 

  • Kołakowska, A., Landowska, A., Szwoch, M., Szwoch, W., Wróbel, M.R.: Emotion recognition and its applications. In: Hippe, Z.S., Kulikowski, J.L., Mroczek, T., Wtorek, J. (eds.) Human-Computer Systems Interaction: Backgrounds and Applications 3. AISC, vol. 300, pp. 51–62. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08491-6_5

    Chapter  Google Scholar 

  • Kolog, E.A.: Contextuallising the application of human language technologies for counselling. Ph.D. thesis, University of Eastern Finland (2017a)

    Google Scholar 

  • Kolog, E.A., Montero, C.S.: Towards automated e-counselling system based on counsellors’ emotion perception. Educ. Inf. Technol. 23(2), 911–933 (2018)

    Article  Google Scholar 

  • Kolog, E.A., Montero, C.S., Toivonen, T.: Using machine learning for sentiment and social influence analysis in text. In: Rocha, A., Guarda, T. (eds.) Proceedings of the International Conference on Information Technology & Systems (ICITS 2018). AISC, vol. 721, pp. 453–463. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73450-7_43

    Chapter  Google Scholar 

  • Kolog, E.A., Sutinen, E.,Vanhalakka-Ruoho, M.: E-counselling implementation: students’ life stories and counselling technologies in perspective. Int. J. Educ. Dev. Using Inf. Commun. Technol. 10(3), 32 (2014)

    Google Scholar 

  • Kolog, E.A., Sutinen, E., Vanhalakka-Ruoho, M., Sohunen, J., Anohah, E.: Using unified theory of acceptance and use of technology model to predict students’ behavioral intention to adopt and use e - counseling in Ghana. Int. J. Mod. Educ. Comput. Sci. 7(11), 1–11 (2015)

    Article  Google Scholar 

  • Kolog, E.A., Montero, S.C., Sutinen, E.: Annotation agreement of emotions in text: the influence of counselors’ emotional state on their emotion perception. In: Proceeding of International Conference on Advanced Learning Technologies (ICALT), pp. 357–359. IEEE (2016)

    Google Scholar 

  • Landis, J., Kouch, G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)

    Article  Google Scholar 

  • Lerner, J., Li, Y., Valdesolo, P., Kassam, K.S.: Emotion and decision making. Annu. Rev. Psychol. 66, 799–823 (2015)

    Article  Google Scholar 

  • Lugmayr, A., Sutinen, E., Suhonen, J., Sedano, C., Hlavacs, H., Montero, C.: Serious storytelling – a first definition and review. Multimed. Tools Appl. 76, 1–27 (2016)

    Google Scholar 

  • Mohammad, S.M.: Sentiment analysis: detecting valence, emotions, and other affectual states from text. In: Emotion measurement, pp. 201–238 (2015)

    Chapter  Google Scholar 

  • Odbal, S., Wang, Z.: Segment-based fine-grained emotion detection for chinese text. In: CLP, p. 52 (2014)

    Google Scholar 

  • Peffers, K., Tuunanen, T., Gengler, C.E., Rossi, M., Hui, W., Virtanen, V., Bragge, J.: The design science research process: a model for producing and presenting information systems research. In: Proceedings of the First International Conference on Design Science Research in Information Systems and Technology, pp. 83–106 (2006)

    Google Scholar 

  • Plutchik, R.: Emotion: Theory, Research, and Experience: Theories of Emotion, vol. 1, p. 399. Academic Press, New York (1980)

    Google Scholar 

  • Roser, M., Ortiz-Ospina, E.: Global Rise of Education (2017). From WorldInData.org: https://ourworldindata.org/global-rise-of-education. Retrieved 5 July 2017

  • Sebe, N., Cohen, I., Gevers, T., Huang, T.S.: Multimodal approaches for emotion recognition: a survey. In: Proceedings of SPIE, vol. 5670, pp. 56–67 (2005)

    Google Scholar 

  • Suttles, J., Ide, N.: Distant supervision for emotion classification with discrete binary values. In: Gelbukh, A. (ed.) Computational Linguistics and Intelligent Text Processing (CICLing 2013). LNCS, vol. 7817, pp. 121–136. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37256-8_11

    Chapter  Google Scholar 

  • UNESCO: Technical and vocational education and training in the 21st century: New roles and challenges for guidance and counselling (2002)

    Google Scholar 

  • Witten, I.H., Frank, E., Hall, M.A., Pal, C.J.: Data mining: practical machine learning tools and techniques (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Emmanuel Awuni Kolog .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kolog, E.A. (2018). Detecting Emotions in Students’ Generated Content: An Evaluation of EmoTect System. In: Cheung, S., Lam, J., Li, K., Au, O., Ma, W., Ho, W. (eds) Technology in Education. Innovative Solutions and Practices. ICTE 2018. Communications in Computer and Information Science, vol 843. Springer, Singapore. https://doi.org/10.1007/978-981-13-0008-0_22

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-0008-0_22

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-0007-3

  • Online ISBN: 978-981-13-0008-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics