Item-Based Collaborative Filtering Using Sentiment Analysis of User Reviews

  • Abhishek DubeyEmail author
  • Ayush Gupta
  • Nitish Raturi
  • Pranshu Saxena
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 899)


Traditional Collaborative filtering algorithm works by using only the past experience of a user. To overcome the limitations of the traditional collaborative algorithm, an item based collaborative filtering system was introduced. In this paper, an improved recommender system is proposed. A dictionary of sentiment scores is created. These sentiment scores are calculated by finding the probability of the reviews to be positive. This sentiment score is used by an item based collaborative filtering system to improve the recommendations and filter out items with overall negative user opinion. The performance of the proposed system is compared with previous work done in this field.


Collaborative filtering Item based Logistic regression Recommender systems Sentiment analysis 


  1. 1.
    Maas, A.L., Daly, R.E., Pham, P.T., Huang, D., Ng, A.Y., Potts, C.: Learning word vectors for sentiment analysis. In: The 49th Annual Meeting of the Association for Computational Linguistics (2018, updated)Google Scholar
  2. 2.
    Jena, K.C., Mishra, S., Sahoo, S., Mishra, B.K.: Principles, techniques and evaluation of recommendation systems. In: International Conference on Inventive Systems and Control, pp. 1–6 (2017)Google Scholar
  3. 3.
    Guo, G., Zhang, J., Yorke-Smith, N.: A novel recommendation model regularized with user trust and item ratings. IEEE Trans. Knowl. Data Eng. 28, 1607–1620 (2016)CrossRefGoogle Scholar
  4. 4.
    Beel, J., Gipp, B., Langer, S., Breitinger, C.: Research-paper recommender systems: a literature survey. Int. J. Digit. Libr. 17(4), 305–338 (2016)CrossRefGoogle Scholar
  5. 5.
    Guimarães, R., Rodríguez, D.Z., Rosa, R.L., Bressan, G.: Recommendation system using sentiment analysis considering the polarity of the adverb. In: IEEE International Symposium on Consumer Electronics, pp. 71–72 (2016)Google Scholar
  6. 6.
    Zhang, Y., Jin, R., Zhou, Z.-H.: Understanding bag-of-words model: a statistical framework. Int. J. Mach. Learn. Cybern. 1(1–4), 43–52 (2010)CrossRefGoogle Scholar
  7. 7.
    Harper, F.M., Konstan, J.A.: The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. (TiiS) 5(4), 19:1–19:19 (2015). Regular Articles and Special issue on New Directions in Eye Gaze for Interactive Intelligent Systems (Part 1 of 2)Google Scholar
  8. 8.
    Krishna, P.V., Misra, S., Joshi, D., Obaidat, M.S.: Learning automata based sentiment analysis for recommender system on cloud. In: 2013 International Conference on Computer, Information and Telecommunication Systems, pp. 1–5 (2014)Google Scholar
  9. 9.
    Hailong, Z., Wenyan, G., Bo, J.: Machine learning and Lexicon based methods for sentiment classification: a survey. In: WISA 2014 Proceeding 11th Web Information System and Application Conference, pp. 262–265 (2014)Google Scholar
  10. 10.
    Zhang, D., Hsu, C.H., Chen, M., Chen, Q., Xiong, N., Lloret, J.: Cold-start recommendation using bi-clustering and fusion for large-scale social recommender systems. IEEE Trans. Emerg. Top. Comput. 2(2), 239–250 (2013)CrossRefGoogle Scholar
  11. 11.
    Neethu, M.S., Rajasree, R.: Sentiment analysis in twitter using machine learning techniques. In: 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), pp. 1–5 (2013)Google Scholar
  12. 12.
    Feldman, R.: Techniques and applications for sentiment analysis. Commun. ACM 56(4), 82–89 (2013)CrossRefGoogle Scholar
  13. 13.
    Faridani, S.: Using canonical correlation analysis for generalized sentiment analysis, product recommendation and search. In: Proceedings of the Fifth ACM Conference on Recommender Systems, pp. 355–358 (2011)Google Scholar
  14. 14.
    Chakraborty, P.S.: A scalable collaborative filtering-based recommender system using incremental clustering. In: IEEE International Conference on Advance Computing, pp. 1526–1529 (2009)Google Scholar
  15. 15.
    Ye, Q., Law, R., Gu, B.: The impact of online user reviews on hotel room sales. Int. J. Hosp. Manag. 28(1), 180–182 (2009)CrossRefGoogle Scholar
  16. 16.
    Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRefGoogle Scholar
  17. 17.
    Wan, X., Ninomiya, T., Okamoto, T.: A learner’s role-based multi-dimensional collaborative recommendation (LRMDCR) for group learning support. In: IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp. 3912–3917 (2008)Google Scholar
  18. 18.
    Kotsiantis, S.B.: Supervised machine learning: a review of classification techniques. In: Proceedings of the 2007 Conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies, pp. 3–24 (2007)Google Scholar
  19. 19.
    Leung, C.W., Chan, S.C., Chung, F.: Integrating collaborative filtering and sentiment analysis: a rating inference approach. In: ECAI 2006 Workshop on Recommender Systems, pp. 62–66 (2006)Google Scholar
  20. 20.
    Caruana, R., Niculescu-Mizil, A.: An empirical comparison of supervised learning algorithms. In: ICML 2006 Proceedings of the 23rd International Conference on Machine Learning, pp. 161–168 (2006)Google Scholar
  21. 21.
    Su, X., Khoshgoftaar, T.M.: Collaborative filtering for multi-class data using belief nets algorithms. In: ICTAI 2006 Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence, pp. 497–504 (2006)Google Scholar
  22. 22.
    Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)CrossRefGoogle Scholar
  23. 23.
    Hu, M., Liu, B.: Mining opinion features in customer reviews. In: AAAI 2004 Proceedings of the 19th National Conference on Artificial Intelligence, pp. 755–760 (2004)Google Scholar
  24. 24.
    Miller, B.N., Albert, I., Lam, S.K., Konstan, J.A., Riedl, J.: MovieLens unplugged: experiences with an occasionally connected recommender system. In: IUI 2003 Proceedings of the 8th International Conference on Intelligent User Interfaces, pp. 263–266 (2003)Google Scholar
  25. 25.
    Nasukawa, T., Yi, J.: Sentiment analysis: capturing favorability using natural language processing. In: K-CAP 2003 Proceedings of the 2nd International Conference on Knowledge Capture, pp. 70–77 (2003)Google Scholar
  26. 26.
    Linden, G., Smith, B., York, J.: recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 7(1), 76–80 (2003)CrossRefGoogle Scholar
  27. 27.
    Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? sentiment classification using machine learning techniques. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 79–86 (2002)Google Scholar
  28. 28.
    Turney, P.D.: Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 417–424 (2002)Google Scholar
  29. 29.
    Hanani, U., Shapira, B., Shoval, P.: Information filtering: overview of issues, research and systems. User Modeling User-Adapt. Interact. 11(3), 203–259 (2001)CrossRefGoogle Scholar
  30. 30.
    Getoor, L., Sahami, M.: Using probabilistic relational models for collaborative filtering. In: Proceedings of the Workshop Web Usage Analysis and User Profiling (WEBKDD 1999) (1999)Google Scholar
  31. 31.
    Nakamura, A., Abe, N.: Collaborative filtering using weighted majority prediction algorithms. In: ICML 1998 Proceedings of the Fifteenth International Conference on Machine Learning, pp. 395–403 (1998)Google Scholar
  32. 32.
    Billsus, D., Pazzani, M.J.: Learning collaborative information filters. In: ICML 1998 Proceedings of the Fifteenth International Conference on Machine Learning, pp. 46–54 (1998)Google Scholar
  33. 33.
    Breese, J.S., Heckerman, D., Kadie, C.: Empirical analysis of predictive algorithms for collaborative filtering. In: UAI 1998 Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pp. 43–52 (1998)Google Scholar
  34. 34.
    Shardanand, U., Maes, P.: Social information filtering: algorithms for automating “word of mouth”. In: CHI 1995 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 210–217 (1995)Google Scholar
  35. 35.
    Hill, W., Stead, L., Rosenstein, M., Furnas, G.: Recommending and evaluating choices in a virtual community of use. In: CHI 1995 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 194–201 (1995)Google Scholar
  36. 36.
    Resnick, P., Lacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of netnews. In: CSCW 1994 Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, pp. 175–186 (1994)Google Scholar
  37. 37.
    Cavnar, W.B., Trenkle, J.M.: N-gram-based text categorization. In: Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pp. 161–175 (1994)Google Scholar
  38. 38.
    Goldberg, D., Nichols, D., Oki, B.M., Terry, D.: Using collaborative filtering to weave an information tapestry. Commun. ACM – Spec. Issue Inf. Filter. 35(12), 61–70 (1992)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Abhishek Dubey
    • 1
    Email author
  • Ayush Gupta
    • 1
  • Nitish Raturi
    • 1
  • Pranshu Saxena
    • 1
  1. 1.Department of Computer Science and EngineeringInderprastha Engineering CollegeGhaziabadIndia

Personalised recommendations