Comparison of Sentiment Analysis and User Ratings in Venue Recommendation

  • Xi WangEmail author
  • Iadh Ounis
  • Craig Macdonald
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11437)


Venue recommendation aims to provide users with venues to visit, taking into account historical visits to venues. Many venue recommendation approaches make use of the provided users’ ratings to elicit the users’ preferences on the venues when making recommendations. In fact, many also consider the users’ ratings as the ground truth for assessing their recommendation performance. However, users are often reported to exhibit inconsistent rating behaviour, leading to less accurate preferences information being collected for the recommendation task. To alleviate this problem, we consider instead the use of the sentiment information collected from comments posted by the users on the venues as a surrogate to the users’ ratings. We experiment with various sentiment analysis classifiers, including the recent neural networks-based sentiment analysers, to examine the effectiveness of replacing users’ ratings with sentiment information. We integrate the sentiment information into the widely used matrix factorization and GeoSoCa multi feature-based venue recommendation models, thereby replacing the users’ ratings with the obtained sentiment scores. Our results, using three Yelp Challenge-based datasets, show that it is indeed possible to effectively replace users’ ratings with sentiment scores when state-of-the-art sentiment classifiers are used. Our findings show that the sentiment scores can provide accurate user preferences information, thereby increasing the prediction accuracy. In addition, our results suggest that a simple binary rating with ‘like’ and ‘dislike’ is a sufficient substitute of the current used multi-rating scales for venue recommendation in location-based social networks.


  1. 1.
    Manotumruksa, J., Macdonald, C., Ounis, I.: Modelling user preferences using word embeddings for context-aware venue recommendation. In: Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval (2016)Google Scholar
  2. 2.
    Noulas, A., Scellato, S., Lathia, N., Mascolo, C.: A random walk around the city: new venue recommendation in location-based social networks. In: Proceedings of SocialCom-PASSAT (2012)Google Scholar
  3. 3.
    Lian, D., et al.: Scalable content-aware collaborative filtering for location recommendation. IEEE Trans. Knowl. Data Eng. 30(6), 1122–1135 (2018)CrossRefGoogle Scholar
  4. 4.
    Frankowski, D., Herlocker, J., Sen, S., et al.: Collaborative filtering recommender systems. Adapt. Web 4321, 291–324 (2007)CrossRefGoogle Scholar
  5. 5.
    Hu, L., Sun, A., Liu, Y.: Your neighbors affect your ratings: on geographical neighborhood influence to rating prediction. In: Proceedings of SIGIR (2014)Google Scholar
  6. 6.
    Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)CrossRefGoogle Scholar
  7. 7.
    Manotumruksa, J., Macdonald, C., Ounis, I.: A contextual attention recurrent architecture for context-aware venue recommendation. In: Proceedings of SIGIR (2018)Google Scholar
  8. 8.
    Zhang, J.D., Chow, C.Y.: GeoSoSa: exploiting geographical, social and categorical correlations for point-of-interest recommendations. In: Proceedings of SIGIR (2015)Google Scholar
  9. 9.
    Zhu, Q., Wang, S., Cheng, B., Sun, Q., Yang, F., Chang, R.N.: Context-aware group recommendation for point-of-interests. IEEE Access 6, 12129–12144 (2018)CrossRefGoogle Scholar
  10. 10.
    Hu, R., Pu, P.: Exploring relations between personality and user rating behaviors. In: Proceedings of Workshop on Emotions and Personality in Personalized Services (EMPIRE at UMAP) (2013)Google Scholar
  11. 11.
    Cosley, D., Lam, S.K., Albert, I., Konstan, J.A., Riedl, J.: Is seeing believing?: how recommender system interfaces affect users’ opinions. In: Proceedings of SIGCHI (2003)Google Scholar
  12. 12.
    Knijnenburg, B.P., Willemsen, M.C., Gantner, Z., Soncu, H., Newell, C.: Explaining the user experience of recommender systems. User Model. User-Adap. Inter. 22(4–5), 441–504 (2012)CrossRefGoogle Scholar
  13. 13.
    Han, J., Pei, J., Kamber, M.: Data Mining: Concepts and Techniques. Elsevier, New York (2011)CrossRefGoogle Scholar
  14. 14.
    López Barbosa, R.R., Sánchez-Alonso, S., Sicilia-Urban, M.A.: Evaluating hotels rating prediction based on sentiment analysis services. Aslib J. Inf. Manage. 67(4), 392–407 (2015)CrossRefGoogle Scholar
  15. 15.
    Yang, D., Zhang, D., Yu, Z., Wang, Z.: A sentiment-enhanced personalized location recommendation system. In: Proceedings of ACM Conference on Hypertext and Social Media (2013)Google Scholar
  16. 16.
    Gurini, D.F., Gasparetti, F., Micarelli, A., Sansonetti, G.: Temporal people-to-people recommendation on social networks with sentiment-based matrix factorization. Future Gener. Comput. Syst. 78(P1), 430–439 (2018)CrossRefGoogle Scholar
  17. 17.
    Wang, H., Fu, Y., Wang, Q., Yin, H., Du, C., Xiong, H.: A location-sentiment-aware recommender system for both home-town and out-of-town users. In: Proceedings of SIGKDD (2017)Google Scholar
  18. 18.
    Lak, P., Turetken, O.: Star ratings versus sentiment analysis-a comparison of explicit and implicit measures of opinions. In: Proceedings of HICSS (2014)Google Scholar
  19. 19.
    Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)
  20. 20.
    Baziotis, C., Pelekis, N., Doulkeridis, C.: Datastories at SemEval-2017 task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of SemEval (2017)Google Scholar
  21. 21.
    Mohammad, S., Kiritchenko, S., Zhu, X.D.: NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. In: Proceedings of SemEval (2013)Google Scholar
  22. 22.
    Kiritchenko, S., Zhu, X., Mohammad, S.M.: Sentiment analysis of short informal texts. J. Artif. Intell. Res. 50, 723–762 (2014)CrossRefGoogle Scholar
  23. 23.
    Cheng, C., Yang, H., King, I., Lyu, M.R.: Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of AAAI (2012)Google Scholar
  24. 24.
    Manotumruksa, J., Macdonald, C., Ounis, I.: Regularising factorised models for venue recommendation using friends and their comments. In: Proceedings of CIKM (2016)Google Scholar
  25. 25.
    Amoo, T., Friedman, H.: Do numeric values influence subjects’ responses to rating scales. Int. Mark. Mark. Res. 26(1), 41–46 (2001)Google Scholar
  26. 26.
    Pennock, D.M., Horvitz, E., Lawrence, S., Giles, C.L.: Collaborative filtering by personality diagnosis: a hybrid memory-and model-based approach. In: Proceedings of UAI (2000)Google Scholar
  27. 27.
    Ohana, B., Tierney, B.: Sentiment classification of reviews using SentiWordNet. In: Proceedings of Information Technology & Telecommunication (2009)Google Scholar
  28. 28.
    Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of LREC (2010)Google Scholar
  29. 29.
    Rosenthal, S., Farra, N., Nakov, P.: SemEval-2017 task 4: sentiment analysis in Twitter. In: Proceedings of SemEval (2017)Google Scholar
  30. 30.
    Gao, H., Tang, J., Hu, X., Liu, H.: Content-aware point of interest recommendation on location-based social networks. In: Proceedings of AAAI (2015)Google Scholar
  31. 31.
    Zhao, K., Cong, G., Yuan, Q., Zhu, K.Q.: SAR: a sentiment-aspect-region model for user preference analysis in geo-tagged reviews. In: Proceedings of ICDE (2015)Google Scholar
  32. 32.
    Bird, S., Loper, E.: NLTK: the natural language toolkit. In: Proceedings of ACL (2004)Google Scholar
  33. 33.
    Lian, D., Zhao, C., Xie, X., Sun, G., Chen, E., Rui, Y.: GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation. In: Proceedings of SIGKDD (2014)Google Scholar
  34. 34.
    Zhao, G., Qian, X., Xie, X.: User-service rating prediction by exploring social users’ rating behaviors. Trans. Multimedia 18(3), 496–506 (2016)CrossRefGoogle Scholar
  35. 35.
    He, J., Li, X., Liao, L., Song, D., Cheung, W.K.: Inferring a personalized next point-of-interest recommendation model with latent behavior patterns. In: Proceedings of AAAI (2016)Google Scholar
  36. 36.
    Zhao, S., Zhao, T., King, I., Lyu, M.R.: Geo-teaser: geo-temporal sequential embedding rank for point-of-interest recommendation. In: Proceedings of WWW (2017)Google Scholar
  37. 37.
    Zhao, S., Zhao, T., Yang, H., Lyu, M.R., King, I.: Stellar: sapatial-temporal latent ranking for successive point-of-interest recommendation. In: Proceedings of AAAI (2016)Google Scholar
  38. 38.
    Guerini, M., Gatti, L., Turchi, M.: Sentiment analysis: how to derive prior polarities from sentiwordnet. In: Proceedings of EMNLP (2013)Google Scholar
  39. 39.
    Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of ACL (2002)Google Scholar
  40. 40.
    Koppel, M., Schler, J.: The importance of neutral examples for learning sentiment. Comput. Intell. 22(2), 100–109 (2006)MathSciNetCrossRefGoogle Scholar
  41. 41.
    Yang, X., Macdonald, C., Ounis, I.: Using word embeddings in Twitter election classification. Inf. Retrieval J. 21(2–3), 183–207 (2018)CrossRefGoogle Scholar
  42. 42.
    Zimba, B., Chibuta, S., Chisanga, D., Banda, F., Phiri, J.: Point of interest recommendation methods in location based social networks: traveling to a new geographical region. arXiv preprint arXiv:1711.09471 (2017)
  43. 43.
    Yuan, F., Jose, J.M., Guo, G., Chen, L., Yu, H., Alkhawaldeh, R.S.: Joint geo-spatial preference and pairwise ranking for point-of-interest recommendation. In: Proceedings of ICTAI (2016)Google Scholar
  44. 44.
    Guo, Q., Sun, Z., Zhang, J., Chen, Q., Theng, Y.L.: Aspect-aware point-of-interest recommendation with geo-social influence. In: Proceedings of UMAP (2017)Google Scholar
  45. 45.
    Liu, Y., Pham, T.A.N., Cong, G., Yuan, Q.: An experimental evaluation of point-of-interest recommendation in location-based social networks. In: Proceedings of VLDB (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of GlasgowGlasgowUK

Personalised recommendations