Skip to main content

Interpretability of Computational Models for Sentiment Analysis

  • Chapter
  • First Online:
Sentiment Analysis and Ontology Engineering

Part of the book series: Studies in Computational Intelligence ((SCI,volume 639))

Abstract

Sentiment analysis, which is also known as opinion mining, has been an increasingly popular research area focusing on sentiment classification/regression. In many studies, computational models have been considered as effective and efficient tools for sentiment analysis . Computational models could be built by using expert knowledge or learning from data. From this viewpoint, the design of computational models could be categorized into expert based design and data based design. Due to the vast and rapid increase in data, the latter approach of design has become increasingly more popular for building computational models. A data based design typically follows machine learning approaches, each of which involves a particular strategy of learning. Therefore, the resulting computational models are usually represented in different forms. For example, neural network learning results in models in the form of multi-layer perceptron network whereas decision tree learning results in a rule set in the form of decision tree. On the basis of above description, interpretability has become a main problem that arises with computational models. This chapter explores the significance of interpretability for computational models as well as analyzes the factors that impact on interpretability. This chapter also introduces several ways to evaluate and improve the interpretability for computational models which are used as sentiment analysis systems. In particular, rule based systems , a special type of computational models, are used as an example for illustration with respects to evaluation and improvements through the use of computational intelligence methodologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Schlager, J.: Systems engineering: key to modern development. IRE Trans. EM 3(3), 64–66 (1956)

    Google Scholar 

  2. Hall, A.D.: A Methodology for Systems Engineering. Van Nostrand Reinhold (1962)

    Google Scholar 

  3. Mitchell, T.M.: Machine Learning, McGraw Hill (1997)

    Google Scholar 

  4. Liu, H., Gegov, A., Stahl, F.: Categorization and construction of rule based systems. In: 15th International Conference on Engineering Applications of Neural Networks, Sofia, Bulgaria (2014)

    Google Scholar 

  5. Ross, T.J.: Fuzzy Logic with Engineering Applications. John Wiley & Sons Ltd, West Sussex (2004)

    MATH  Google Scholar 

  6. Simpson, S.G.: Mathematical Logic, PA (2013)

    Google Scholar 

  7. Tan, P.-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education, New Jersey (2006)

    Google Scholar 

  8. Higgins, C.M.: Classification and Approximation with Rule Based Networks. Pasadena, California (1993)

    Google Scholar 

  9. Uttley, A.M.: The design of conditional probability computers. Inf. Control 2, 1–24 (1959)

    Article  MATH  Google Scholar 

  10. Kononenko, I.: Bayesain Neual Networks. Biol. Cybern. 61, 361–370 (1989)

    Article  Google Scholar 

  11. Rosenblatt, F.: Principles of Neurodynamics: Perceptron and the Theory of Brain Mechanisms. Spartan Books, Washington, DC (1962)

    MATH  Google Scholar 

  12. Ekeberg, O., Lansner, A.: Automatic generation of internal representations in a probabilistic artificial neural network. In: Proceedings of the First European Conference on Neural Networks (1988)

    Google Scholar 

  13. Altrabsheh, N., Cocea, M., Fallahkhair, S.: Sentiment analysis: towards a tool for analysing real-time students feedback. In: 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, Limassol, Cyprus (2014)

    Google Scholar 

  14. Liu, B.: Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers (2012)

    Google Scholar 

  15. Stahl, F., Jordanov, I.: An overview of use of neural networks for data mining tasks. In: WIREs: Data Mining and Knowledge Discovery, pp. 193–208 (2012)

    Google Scholar 

  16. Liu, H., Gegov, A., Stahl, F.: J-measure based hybrid pruning for complexity reduction in classification rules. WSEAS Trans. Syst. 12(9), 433–446 (2013)

    Google Scholar 

  17. Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S.M. (eds.) Inforamtion Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209–230, Springer (2015)

    Google Scholar 

  18. Quinlan, R.: C4.5: Programs for Machine Learning, Morgan Kaufman (1993)

    Google Scholar 

  19. Fürnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3–54 (1999)

    Article  MATH  Google Scholar 

  20. Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man-Machine Stud. 27, 349–370 (1987)

    Article  MATH  Google Scholar 

  21. Deng, X.: A Covering-Based Algorithm for Classification: PRISM. Regina (2012)

    Google Scholar 

  22. Liu, H., Gegov, A., Cocea, M.: Network Based Rule Representation for Knowledge Discovery and Predictive Modelling. In: IEEE International Conference on Fuzzy Systems, Istanbul (2015)

    Google Scholar 

  23. Rish, I.: An empirical study of the Naïve Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, vol. 3, no. 22, pp. 41–46 (2001)

    Google Scholar 

  24. Liu, H., Gegov, A., Cocea, M.: Rule Based Systems for Big Data: A Machine Learning Approach, vol. 13. Springer, Berlin (2016)

    Google Scholar 

  25. Quinlan, R.: Discovering rules from large collections of examples: a case study. In: Michie, D. (ed.) Expert Systems in the Micro-Electronic Age, pp. 168–201. Edinburgh, Edinburgh (1979)

    Google Scholar 

  26. Lichman, M.: Machine Learning Repository, University of California, School of Information and Computer Science (2013). http://archive.ics.uci.edu/ml

  27. Elomaa, T., Kääriäinen, M.: An analysis of reduced error pruning. J. Artif. Intell. Res. 15(1), 163–187 (2001)

    MathSciNet  MATH  Google Scholar 

  28. Altrabsheh, N., Cocea, M., Fallahkhair, S.: Learning sentiment from students’ feedback for real-time interventions in classrooms. In: Adaptive and intelligent systems: Third International Conference, ICAIS 2014, Bournemouth (2014)

    Google Scholar 

  29. Kummer, O., Savoy, J.: Feature Selection in Sentiment Analysis. In: CORIA 2012, Bordeaux (2012)

    Google Scholar 

  30. Shanno, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27(3), 379–423 (1948)

    Article  MathSciNet  Google Scholar 

  31. Jolliffe, I.T.: Principal Component Analysis. Springer, New York (2002)

    MATH  Google Scholar 

  32. Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data—with application to face recognition. Patt. Recogn. 34(10), 2067–2069 (2001)

    Article  MATH  Google Scholar 

  33. Yates, D.S., Moore, D.S., Starnes, D.S.: The Practice of Statistics, 3rd ed. Freeman (2008)

    Google Scholar 

  34. Deming, W.E.: On probability as a basis for action. Am. Stat. 29(4), 146–152 (1975)

    Google Scholar 

  35. Kerry, S.M., Bland, J.M.: The intracluster correlation coefficient in cluster randomisation. Br. Med. J. 316(7142), 1455–1460 (1998)

    Article  Google Scholar 

  36. Kerber, R.: ChiMerge: discretization of numeric attributes. In: Proceedings of the 10th National Conference on Artificial Intelligence, California (1992)

    Google Scholar 

  37. Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)

    Article  Google Scholar 

  38. Yi, H., Li, W.: Document sentiment classification by exploring description model of topical terms. Comput. Speech Lang. 50, 386–403 (2011)

    Google Scholar 

  39. Lewis, D.D., Ringuette, M.: A comparison of two learning algorithms for text categorization. In: Third Annual Symposium on Document Analysis and Information Retrieval, Las Vegas (1994)

    Google Scholar 

  40. Chakrabarti, S., Roy, S., Soundalgekar, M.V.: Fast and accurate text classification via multiple linear discriminant projections. Int. J. Very Large Data Bases 12(2), 170–185 (2003)

    Article  Google Scholar 

  41. Zhao, C., Wang, S., Li, D.: Fuzzy sentiment membership determining for sentiment classification. In: IEEE International Conference on Data Mining Workshop (ICDMW), Shenzhen (2014)

    Google Scholar 

  42. Nadali, S., Murad, M., Kadir, R.: Sentiment classification of customer reviews based on fuzzy logic. In: International Symposium in Information Technology (ITSim), Kuala Lumpur (2010)

    Google Scholar 

  43. Colace, F., Santo, M.D., Greco, L.: A probabilistic approach to Tweets’ sentiment classification. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Han Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Liu, H., Cocea, M., Gegov, A. (2016). Interpretability of Computational Models for Sentiment Analysis. In: Pedrycz, W., Chen, SM. (eds) Sentiment Analysis and Ontology Engineering. Studies in Computational Intelligence, vol 639. Springer, Cham. https://doi.org/10.1007/978-3-319-30319-2_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-30319-2_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-30317-8

  • Online ISBN: 978-3-319-30319-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics