Abstract
Word vectors have become very important features for sentiment analysis. The aim of this paper is to encode sentimental context into pre-trained word vectors for sentiment analysis. The negation and intensity words in a context, as well as the sentimental words are combined to form context enhanced word vectors. Experiments on the datasets of SemEval show that the method of using intensity words has improved the result comparing with the baseline. The context enhanced words vectors from a distant supervision data can increase the similarity of the same polarity and decrease the similarity of the different polarity.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Tang, D., Wei, F., Yang, N., Zhou, M.: Learning sentiment-specific word embedding for twitter sentiment classification. In: ACL, pp. 1555–1565 (2014)
Miura, Y., Sakaki, S., Hattori, K., Ohkuma, T.: TeamX: a sentiment analyzer with enhanced lexicon mapping and weighting scheme for unbalanced data. In: Proceedings of SemEval, pp. 628–632 (2014)
Hagen, M., Potthast, M., Büchner, M., Stein, B.: Webis: an ensemble for twitter sentiment detection. In: Proceedings of SemEval, pp. 582–589 (2015)
Deriu, J., Gonzenbach, M., Uzdilli, F., Lucchi, A., De Luca, V., Jaggi, M.: SwissCheese at SemEval-2016 task 4: sentiment classification using an ensemble of convolutional neural networks with distant supervision. In: Proceedings of SemEval, pp. 1124–1128 (2016)
Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., Stoyanov, V.: SemEval-2016 task 4: sentiment analysis in Twitter. In: Proceedings of SemEval, pp. 1–18 (2016)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: EMNLP, pp. 1532–1543 (2014)
Bengio, Y., Ducharme, R., Vincent, P., Janvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)
Mrkšić, N., Séaghdha, D.O., Thomson, B., Gašić, M., Rojas-Barahona, L., Su, P.H., Vandyke, D., Wen, T.H. and Young, S.: Counter-fitting word vectors to linguistic constraints. arXiv preprint arXiv:1603.00892 (2016)
Schwartz, R., Reichart, R., Rappoport, A.: Symmetric patterns and coordinations: fast and enhanced representations of verbs and adjectives. In: HLT-NAACL, pp. 499–505 (2016)
Ling, W., Dyer, C., Black, A., Trancoso, I.: Two/Too simple adaptations of Word2Vec for syntax problems. In: NAACL, pp. 1299–1304 (2015)
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)
Rouvier, M., Favre, B.: SENSEI-LIF at SemEval-2016 task 4: polarity embedding fusion for robust sentiment analysis. In: Proceedings of SemEval, pp. 202–208 (2016)
Faruqui, M., Dodge, J., Jauhar, S., Dyer, C., Hovy, E., Smith, N.: Retrofitting word vectors to semantic lexicons. In: NAACL, pp. 1606–1615 (2015)
Yancheva, M., Rudzicz, F.: Vector-space topic models for detecting Alzheimer’s disease. In: ACL, pp. 2337–2346 (2016)
Becker, J.T., Boller, F., Lopez, O.L., Saxton, J., McGonigle, K.L.: The natural history of Alzheimer’s disease. Arch. Neurol. 51, 585–594 (1994)
Wilson, T., Wiebe, J., Hoffmann, P.: Recognizing contextual polarity in phrase-level sentiment analysis. In: EMNLP, pp. 347–354 (2005)
Mohammad, S., Kiritchenko, S., Zhu, X.: NRC-Canada: building the state-of-the-art in sentiment analysis of Tweets. In: Proceedings of SemEval, pp. 321–327 (2013)
Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)
Hill, F., Reichart, R., Korhonen, A.: SimLex-999: evaluating semantic models with genuine similarity estimation. Comput. Linguist. 41(4), 665–695 (2015)
Acknowledgments
We would like to thank the National Natural Science Foundation of China (Grant No. 61673266) for the financial support of this research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Ye, Z., Li, F. (2017). Context Enhanced Word Vectors for Sentiment Analysis. In: Cheng, X., Ma, W., Liu, H., Shen, H., Feng, S., Xie, X. (eds) Social Media Processing. SMP 2017. Communications in Computer and Information Science, vol 774. Springer, Singapore. https://doi.org/10.1007/978-981-10-6805-8_21
Download citation
DOI: https://doi.org/10.1007/978-981-10-6805-8_21
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-6804-1
Online ISBN: 978-981-10-6805-8
eBook Packages: Computer ScienceComputer Science (R0)