Skip to main content

Aspect-Based Sentiment Analysis Using Word Embedding Restricted Boltzmann Machines

  • Conference paper
  • First Online:
Computational Social Networks (CSoNet 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9795))

Included in the following conference series:

Abstract

Recent years, many studies have addressed problems in sentiment analysis at different levels, and building aspect-based methods has become a central issue for deep opinion mining. However, previous studies need to use two separated modules in order to extract aspect-sentiment word pairs, then predict the sentiment polarity. In this paper, we use Restricted Boltzmann Machines in combination with Word Embedding model to build the joined model which not only extracts aspect terms appeared and classifies them into respective categories, but also completes the sentiment polarity prediction task. The experimental results show that the method we use in aspect-based sentiment analysis tasks is better than other state-of-the-art approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://code.google.com/archive/p/word2vec/.

  2. 2.

    https://www.csie.ntu.edu.tw/~cjlin/libsvm/.

  3. 3.

    http://sentiwordnet.isti.cnr.it.

References

  1. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of KDD, pp. 168–177 (2004)

    Google Scholar 

  2. Blair-goldensohn, S., Neylon, T., Hannan, K., Reis, G.A., Mcdonald, R., Reynar, J.: Building a sentiment summarizer for local service reviews. In: NLP in the Information Explosion Era (2008)

    Google Scholar 

  3. Kumar, R.V., Raghuveer, K.: Web user opinion analysis for product features extraction and opinion summarization. Int. J. Web Semant. Technol. 3, 69–82 (2012)

    Article  Google Scholar 

  4. Wang, L., Liu, K., Cao, Z., Zhao, J., de Melo, G.: Sentiment-aspect extraction based on Restricted Boltzmann Machines. In: Proceedings of the 53rd Annual Meeting of the ACL, pp. 616–625 (2015)

    Google Scholar 

  5. Ding, X., Liu, B., Yu, P.S.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the Conference on Web Search and Web Data mining, pp. 231–240 (2008)

    Google Scholar 

  6. Wei, W., Gulla, J.A.: Sentiment learning on product reviews via sentiment ontology tree. In: Proceedings of the 48th Annual Meeting of the ACL, pp. 404–413 (2010)

    Google Scholar 

  7. Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T.: Target-dependent twitter sentiment classification. In: Proceedings of the 49th Annual Meeting of the ACL, pp. 151–160 (2011)

    Google Scholar 

  8. Erik, B., Moens, M.F.: A machine learning approach to sentiment analysis in multilingual web texts. Inf. Retrieval 12, 526–558 (2009)

    Article  Google Scholar 

  9. Jin, W., Ho, H.H.: A novel lexicalized hmm-based learning framework for web opinion mining. In: Proceedings of the International Conference on Machine Learning, pp. 465–472 (2009)

    Google Scholar 

  10. Varghese, R., Jayasree, M.: Aspect based sentiment analysis using support vector machine classifier. In: Advances in Computing, Communications and Informatics (ICACCI), pp. 1581–1586 (2013)

    Google Scholar 

  11. Yejin, C., Cardieo, C.: Hierarchical sequential learning for extracting opinions and their attributes. In: Proceedings of the Annual Meeting of the ACL, pp. 269–274 (2010)

    Google Scholar 

  12. Jakob, N., Gurevych, I.: Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: Proceedings of the Conference on Empirical Methods in NLP, pp. 1035–1045 (2010)

    Google Scholar 

  13. Liu, B.: Sentiment Analysis and Opinion Mining. Morgan and Claypool, San Rafael (2012)

    Google Scholar 

  14. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet Allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  15. Titov, I., McDonald, R.: A joint model of text and aspect ratings for sentiment summarization. In: Proceedings of the Annual Meeting of the ACL, pp. 308–316 (2008)

    Google Scholar 

  16. Brody, S., Elhadad, N.: An unsupervised aspect-sentiment model for online reviews. In: Proceedings of NAACL-HLT 2010, pp. 804–812 (2010)

    Google Scholar 

  17. Lin, C., He, Y.: Joint sentiment/topic model for sentiment analysis. In: Proceedings of the ACM International Conference on Information and Knowledge Management, pp. 375–384 (2009)

    Google Scholar 

  18. Mei, Q., Ling, X., Wondra, M., Su, H., Zhai, C.: Topic sentiment mixture: modeling facets and opinions in weblogs. In: Proceedings of the International Conference on World Wide Web, pp. 171–180 (2007)

    Google Scholar 

  19. Fischer, A., Igel, C.: Training Restricted Boltzmann Machines: an introduction. In: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, pp. 14–36 (2012)

    Google Scholar 

  20. Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. CoRR abs/1405.4053, pp. 1188–1196 (2014)

    Google Scholar 

  21. Řehůřek, R., Sojka, P.: Software framework for topic modelling with large corpora. In: Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, ELRA, pp. 45–50 (2010)

    Google Scholar 

  22. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 26, pp. 3111–3119. Curran Associates, Inc., Red Hook (2013)

    Google Scholar 

  23. Ganu, G., Elhadad, N., Marian, A.: Beyond the stars: Improving rating predictions using review text content. In: Proceedings of WebDB 2009, pp. 1–6 (2009)

    Google Scholar 

  24. Zhao, W.X., Jiang, J., Yan, H., Li, X.: Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of EMNLP 2010, pp. 56–65 (2010)

    Google Scholar 

  25. Chih-Chung, C., Chih-Jen, L.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27 (2011). Software, http://www.csie.ntu.edu.tw/~cjlin/libsvm

  26. Baccianella, S., Esuli, A., Sebastiani, F.: Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC 2010), pp. 2200–2204 (2010)

    Google Scholar 

Download references

Acknowledgments

This research is supported by research funding from Honors Program, University of Science, Vietnam National University - Ho Chi Minh City.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minh-Quoc Nghiem .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Nguyen-Hoang, BD., Ha, QV., Nghiem, MQ. (2016). Aspect-Based Sentiment Analysis Using Word Embedding Restricted Boltzmann Machines. In: Nguyen, H., Snasel, V. (eds) Computational Social Networks. CSoNet 2016. Lecture Notes in Computer Science(), vol 9795. Springer, Cham. https://doi.org/10.1007/978-3-319-42345-6_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42345-6_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42344-9

  • Online ISBN: 978-3-319-42345-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics