A Joint Model for Sentiment Classification and Opinion Words Extraction

  • Dawei Cong
  • Jianhua Yuan
  • Yanyan ZhaoEmail author
  • Bing Qin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11221)


In recent years, mining opinions from customer reviews has been widely explored. Aspect-level sentiment analysis is a fine-grained subtask, which aims to detect the sentiment polarity towards a particular target in a sentence. While most previous works focus on sentiment polarity classification, opinion words towards the target are also very important for that they provide details about target and contribute to judging polarity. To this end, we propose a hierarchical network for jointly modeling aspect-level sentiment classification and word-level opinion words extraction. Our joint model acquires superior performance in opinion words extraction and achieves comparable results in sentiment polarity classification on two datasets from SemEval 2014.


Aspect-level sentiment analysis Opinion words extraction Neural network Attention mechanism 



We thank the anonymous reviewers for their valuable suggestions. This work was supported by the National Natural Science Foundation of China (NSFC) via grant 61632011, 61772153 and 71490722.


  1. 1.
    Bailin, W., Lu, W.: Learning latent opinions for aspect-level sentiment classification (2018)Google Scholar
  2. 2.
    Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., Xu, K.: Adaptive recursive neural network for target-dependent Twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 49–54. Association for Computational Linguistics, Baltimore, June 2014.
  3. 3.
    Graves, A., Mohamed, A.R., Hinton, G.: Speech recognition with deep recurrent neural networks. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6645–6649 (2013)Google Scholar
  4. 4.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  5. 5.
    Kaji, N., Kitsuregawa, M.: Building lexicon for sentiment analysis from massive collection of HTML documents. In: Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (2007)Google Scholar
  6. 6.
    Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: NRC-Canada-2014: detecting aspects and sentiment in customer reviews. In: International Workshop on Semantic Evaluation, pp. 437–442 (2014)Google Scholar
  7. 7.
    Lakkaraju, H., Socher, R., Manning, C.D.: Aspect specific sentiment analysis using hierarchical deep learning (2014)Google Scholar
  8. 8.
    Li, F., et al.: Structure-aware review mining and summarization. In: International Conference on Computational Linguistics, pp. 653–661 (2010)Google Scholar
  9. 9.
    Liu, B.: Sentiment Analysis and Opinion Mining. Morgan Claypool Publishers, San Rafael (2012)Google Scholar
  10. 10.
    Mitchell, M., Aguilar, J., Wilson, T., Durme, B.V.: Open domain targeted sentiment (2014)Google Scholar
  11. 11.
    Mohammad, S.M., Kiritchenko, S., Zhu, X.: NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. In: Computer Science (2013)Google Scholar
  12. 12.
    Nguyen, T.H., Shirai, K.: PhraseRNN: phrase recursive neural network for aspect-based sentiment analysis. In: Conference on Empirical Methods in Natural Language Processing, pp. 2509–2514 (2015)Google Scholar
  13. 13.
    Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(12), 1–135 (2008)CrossRefGoogle Scholar
  14. 14.
    Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: Conference on Empirical Methods in Natural Language Processing, pp. 1532–1543 (2014)Google Scholar
  15. 15.
    Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of International Workshop on Semantic Evaluation at (SemEval 2014), pp. 27–35 (2014)Google Scholar
  16. 16.
    Prez-Rosas, V.: Learning sentiment lexicons in Spanish. In: Eighth International Conference on Language Resources and Evaluation (2013)Google Scholar
  17. 17.
    Qian, Q., Tian, B., Huang, M., Liu, Y., Zhu, X., Zhu, X.: Learning tag embeddings and tag-specific composition functions in recursive neural network. In: Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing, pp. 1365–1374 (2015)Google Scholar
  18. 18.
    Rao, D., Ravichandran, D.: Semi-supervised polarity lexicon induction. In: Eacl 2009, Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, 30 March–3 April 2009, Athens, Greece, pp. 675–682 (2009)Google Scholar
  19. 19.
    Tai, K.S., Socher, R., Manning, C.D.: Improved semantic representations from tree-structured long short-term memory networks. Comput. Sci. 5(1), 36 (2015)Google Scholar
  20. 20.
    Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: Computer Science (2015)Google Scholar
  21. 21.
    Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 214–224. Association for Computational Linguistics, Austin, November 2016.
  22. 22.
    Vo, D.T., Zhang, Y.: Deep learning for event-driven stock prediction. In: Proceedings of IJCAI, Buenos Aires, Argentina, August 2015Google Scholar
  23. 23.
    Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Recursive neural conditional random fields for aspect-based sentiment analysis. CoRR abs/1603.06679 (2016).
  24. 24.
    Wang, Y., Huang, M., Zhu, X., Zhao, L.: Attention-based LSTM for aspect-level sentiment classification. In: Conference on Empirical Methods in Natural Language Processing, pp. 606–615 (2016)Google Scholar
  25. 25.
    Zhang, M., Zhang, Y., Vo, D.T.: Gated neural networks for targeted sentiment analysis (2016)Google Scholar
  26. 26.
    Zhao, W.X., Jiang, J., Yan, H., Li, X.: Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Conference on Empirical Methods in Natural Language Processing, pp. 56–65 (2010)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Dawei Cong
    • 1
  • Jianhua Yuan
    • 1
  • Yanyan Zhao
    • 2
    Email author
  • Bing Qin
    • 1
  1. 1.Research Center for Social Computing and Information RetrievalHarbin Institute of TechnologyHarbinChina
  2. 2.Department of Media Technology and ArtHarbin Institute of TechnologyHarbinChina

Personalised recommendations