Leveraging Part-of-Speech Tagging for Sentiment Analysis in Short Texts and Regular Texts

  • Wai-Howe Khong
  • Lay-Ki SoonEmail author
  • Hui-Ngo Goh
  • Su-Cheng Haw
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11341)


Sentiment analysis has been approached from a spectrum of methodologies, including statistical learning using labelled corpus and rule-based approach where rules may be constructed based on the observations on the lexicons as well as the output from natural language processing tools. In this paper, the experiments to transform labelled datasets by using NLP tools and subsequently performing sentiment analysis via statistical learning algorithms are detailed. In addition to the common data pre-processing prior to sentiment analysis, we represent the tokens in the datasets using Part-Of-Speech (POS) tags. The aim of the experiments is to investigate the impact of POS tags on sentiment analysis, particularly on both short texts and regular texts. The experimental results on short texts show that the combination of adjective and adverb predicts the sentiment of short texts the best. While noun is generally deemed to be neutral in sentiment polarity, the experimental results show that it helps to increase the accuracy of sentiment analysis on regular texts. Besides, the role of negation analysis in the datasets has also been investigated and reported based on the experimental results obtained.


Part-of-speech tagging Sentiment analaysis 


  1. 1.
    Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R.: Sentiment analysis of Twitter data. In: Proceedings of the Workshop on Languages in Social Media, pp. 30–38. Association for Computational Linguistics, June 2011Google Scholar
  2. 2.
    Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: LREC, vol. 10, pp. 2200–2204, May 2010Google Scholar
  3. 3.
    Brody, S., Elhadad, N.: An unsupervised aspect-sentiment model for online reviews. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 804–812. Association for Computational Linguistics, June 2010Google Scholar
  4. 4.
    Fei, G., Liu, B., Hsu, M., Castellanos, M., Ghosh, R.: A dictionary-based approach to identifying aspects im-plied by adjectives for opinion mining. In: 24th International Conference on Computational Linguistics, p. 309, December 2012Google Scholar
  5. 5.
    Giesbrecht, E., Evert, S.: Is part-of-speech tagging a solved task? An evaluation of POS taggers for the German web as corpus. In: Proceedings of the Fifth Web as Corpus Workshop, pp. 27–35, September 2009Google Scholar
  6. 6.
    Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177. ACM, August 2004Google Scholar
  7. 7.
    Jin, H., Huang, M., Zhu, X.: Sentiment analysis with multi-source product reviews. In: Huang, D.-S., Jiang, C., Bevilacqua, V., Figueroa, J.C. (eds.) ICIC 2012. LNCS, vol. 7389, pp. 301–308. Springer, Heidelberg (2012). Scholar
  8. 8.
    Kanayama, H., Nasukawa, T.: Fully automatic lexicon expansion for domain-oriented sentiment analysis. In: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pp. 355–363. Association for Computational Linguistics, July 2006Google Scholar
  9. 9.
    Khong, W.H., Soon, L.K., Goh, H.N.: A comparative study of statistical and natural language processing techniques for sentiment analysis. Jurnal Teknologi 77(18), 155–161 (2015)CrossRefGoogle Scholar
  10. 10.
    Ku, L.W., Liang, Y.T., Chen, H.H.: Opinion extraction, summarization and tracking in news and blog corpora. In: AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs, vol. 100107, March 2006Google Scholar
  11. 11.
    Liu, B.: Sentiment Analysis and Opinion Mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRefGoogle Scholar
  12. 12.
    Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, vol. 10. Association for Computational Linguistics (2002)Google Scholar
  13. 13.
    Poria, S., Cambria, E., Ku, L.W., Gui, C., Gelbukh, A.: A rule-based approach to aspect extraction from product reviews. In: Proceedings of the Second Workshop on Natural Language Processing for Social Media (SocialNLP), pp. 28–37, August 2014Google Scholar
  14. 14.
    Qiu, G., Liu, B., Bu, J., Chen, C.: Opinion word expansion and target extraction through double propagation. Comput. Linguist. 37(1), 9–27 (2011)CrossRefGoogle Scholar
  15. 15.
    Tian, Y., Lo, D.: A comparative study on the effectiveness of part-of-speech tagging techniques on bug reports. In: 2015 IEEE 22nd International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 570–574. IEEE, March 2015Google Scholar
  16. 16.
    Zhang, Y., Zhu, W.: Extracting implicit features in online customer reviews for opinion mining. In: Proceedings of the 22nd International Conference on World Wide Web Companion, pp. 103–104. International World Wide Web Conferences Steering Committee, May 2013Google Scholar
  17. 17.
    Zhao, W.X., Jiang, J., Yan, H., Li, X.: Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 56–65. Association for Computational Linguistics, October 2010Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Wai-Howe Khong
    • 1
  • Lay-Ki Soon
    • 1
    • 2
    Email author
  • Hui-Ngo Goh
    • 1
  • Su-Cheng Haw
    • 1
  1. 1.Faculty of Computing and InformaticsMultimedia UniversityCyberjayaMalaysia
  2. 2.School of Information TechnologyMonash University MalaysiaSubang JayaMalaysia

Personalised recommendations