Advertisement

Jointly Trained Convolutional Neural Networks for Online News Emotion Analysis

  • Xue Zhao
  • Ying ZhangEmail author
  • Wenya Guo
  • Xiaojie Yuan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11242)

Abstract

Emotion analysis, as a sub topic of sentiment analysis, crosses many fields so as philosophy, education, and psychology. Grasping the possible emotions of the public can help government develop their policies and help many businesses build their developing strategies properly. Online news services have attracted millions of web users to explicitly discuss their opinions and express their feelings towards the news. Most of the existing works are based on emotion lexicons. However, same word may trigger different emotions under different context, which makes lexicon-based methods less effective. Some works focus on predefined features for classification, which can be very labor intensive. In this paper, we build a convolutional neural network (CNN) based model to extract features that can represent both local and global information automatically. Additionally, due to the fact that most of online news share the similar word distributions and similar emotion categories, we train the neural networks on two data sets simultaneously so that the model can learn the knowledge from both dataset and benefit the classification on both data sets. In this paper, we elaborate our jointly trained CNN based model and prove its effectiveness by comparing with strong baselines.

Keywords

Emotion analysis CNN Joint training 

Notes

Acknowledgment

This research is supported by Natural Science Foundation of Tianjin (No. 16JCQNJC00500) and Fundamental Research Funds for the Central Universities.

References

  1. 1.
    LeCun, Y., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  2. 2.
    Zhang, Y., Zhang, N., Si, L., Lu, Y., Wang, Q., Yuan, X.: Cross-domain and cross-category emotion tagging for comments of online news. In: Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 627–636. ACM, July 2014Google Scholar
  3. 3.
    Mohammad, S.M., Turney, P.D.: Emotions evoked by common words and phrases: using mechanical turk to create an emotion lexicon. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pp. 26–34. Association for Computational Linguistics (2010)Google Scholar
  4. 4.
    Mohammad, S.M., Turney, P.D.: Crowdsourcing a word-emotion association lexicon. Comput. Intell. 29(3), 436–465 (2013)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Rao, Y., Lei, J., Wenyin, L., Li, Q., Chen, M.: Building emotional dictionary for sentiment analysis of online news. World Wide Web 17(4), 723–742 (2014)CrossRefGoogle Scholar
  6. 6.
    Staiano, J., Guerini, M.: DepecheMood: a lexicon for emotion analysis from crowd-annotated news. arXiv preprint arXiv:1405.1605 (2014)
  7. 7.
    Tang, Y., Chen, H.-H.: Mining sentiment words from microblogs for predicting writer-reader emotion transition. In: LREC 2012Google Scholar
  8. 8.
    Yang, C., Lin, K.H.-Y., Chen, H.-H.: Building emotion lexicon from weblog corpora. In: Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions. Association for Computational Linguistics (2007)Google Scholar
  9. 9.
    Yang, C., Lin, K.H.-Y., Chen, H.-H.: Writer meets reader: emotion analysis of social media from both the writer’s and reader’s perspectives. In: IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technologies, WI-IAT 2009, vol. 1. IEEE (2009)Google Scholar
  10. 10.
    Rao, Y., et al.: Affective topic model for social emotion detection. Neural Netw. 58, 29–37 (2014)CrossRefGoogle Scholar
  11. 11.
    Rao, Y., et al.: Sentiment topic models for social emotion mining. Inf. Sci. 266, 90–100 (2014)CrossRefGoogle Scholar
  12. 12.
    Li, X., et al.: Social emotion classification via reader perspective weighted model. In: AAAI (2016)Google Scholar
  13. 13.
    Bao, S., et al.: Joint emotion-topic modeling for social affective text mining. In: Ninth IEEE International Conference on Data Mining, ICDM 2009. IEEE (2009)Google Scholar
  14. 14.
    Bao, S., et al.: Mining social emotions from affective text. IEEE Trans. Knowl. Data Eng. 24(9), 1658–1670 (2012)CrossRefGoogle Scholar
  15. 15.
    Lin, K.H.-Y., Yang, C., Chen, H.-H.: What emotions do news articles trigger in their readers? In: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM (2007)Google Scholar
  16. 16.
    Lin, K.H.-Y., Yang, C., Chen, H.-H.: Emotion classification of online news articles from the reader’s perspective. In: Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, vol. 1. IEEE Computer Society (2008)Google Scholar
  17. 17.
    Strapparava, C., Mihalcea, R.: SemEval-2007 task 14: affective text. In: Proceedings of the 4th International Workshop on Semantic Evaluations. Association for Computational Linguistics (2007)Google Scholar
  18. 18.
    Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)
  19. 19.
    Lai, S., et al.: Recurrent convolutional neural networks for text classification. In: AAAI, vol. 333 (2015)Google Scholar
  20. 20.
    Zhang, X., Zhao, J., LeCun, Y.: Character-level convolutional networks for text classification. In: Advances in Neural Information Processing Systems (2015)Google Scholar
  21. 21.
    Ciresan, D.C., et al.: Flexible, high performance convolutional neural networks for image classification. In: IJCAI Proceedings-International Joint Conference on Artificial Intelligence, vol. 22, no. 1 (2011)Google Scholar
  22. 22.
    Johnson, R., Zhang, T.: Semi-supervised convolutional neural networks for text categorization via region embedding. In: Advances in Neural Information Processing Systems (2015)Google Scholar
  23. 23.
    dos Santos, C., Gatti, M.: Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers (2014)Google Scholar
  24. 24.
    Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning. ACM (2008)Google Scholar
  25. 25.
    Ruder, S.: An overview of multi-task learning in deep neural networks. arXiv preprint arXiv:1706.05098 (2017)
  26. 26.
    Zhang, Y., Yang, Q.: A survey on multi-task learning. arXiv preprint arXiv:1707.08114 (2017)
  27. 27.
    Christopher, D.M., Prabhakar, R., Hinrich, S.: An Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)zbMATHGoogle Scholar
  28. 28.
    Collobert, R., et al.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12(Aug), 2493–2537 (2011)zbMATHGoogle Scholar
  29. 29.
    Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.College of Computer ScienceNankai UniversityTianjinChina

Personalised recommendations