Skip to main content

Collaborative Filtering Based on Attention Mechanism

  • Conference paper
  • First Online:
Artificial Intelligence (ICAI 2019)

Abstract

Each item has different characteristics. Different users place different importance to these aspects which can be thought of as a preference/attention weight vector. Therefore, using the traditional method to predict the unknown ratings ignores this difference in importance, resulting in a false assumption that all users have the same attention to different characteristics of the same item. In this paper, we propose a collaborative filtering system based on attention mechanism and design the feature-topic model to extract the characteristics of the item from review texts. Then, we use an attention network to get the importance of the item’s characteristic to the user. Considering the shortcomings of linear interaction features, we adopt the idea of collaboration to predict unknown scores. Extensive experiments on real-world datasets show significant improvements in our proposed CFAM framework over the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. He, X., Zhang, H., Kan, M.-Y., Chua, T.-S.: Fast matrixfactorization for online recommendation with implicit feedback. In: SIGIR, pp. 549–558 (2016)

    Google Scholar 

  2. He, X., Chen, T., Kan, M.-Y., Chen, X.: Trirank: review-aware explainable recommendation by modeling aspects. In: ACM CIKM, pp. 1661–1670 (2015)

    Google Scholar 

  3. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3(Jan), 993–1022 (2003)

    MATH  Google Scholar 

  4. McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text. In: ACM RecSys, pp. 165–172 (2013)

    Google Scholar 

  5. Ling, G., Lyu, M.R., King, I.: Ratings meet reviews, a combined approach to recommend. In: ACM RecSys, pp. 105–112 (2014)

    Google Scholar 

  6. Tan, Y., Zhang, M., Liu, Y., Ma, S.: Rating-boosted latent topics: understanding users and items with ratings and reviews. In: IJCAI (2016)

    Google Scholar 

  7. Cheng, Z., Ding, Y., Zhu, L., Kankanhalli, M.: Aspect-aware latent factor model: rating prediction with ratings and reviews. In: WWW, pp. 639–648 (2018)

    Google Scholar 

  8. Tan, Y., Zhang, M., Liu, Y., Ma, S.: Rating-boosted latent topics: understanding users and items with ratings and reviews. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp. 2640–2646 (2016)

    Google Scholar 

  9. Qiu, L., Gao, S., Cheng, W., Guo, J.: Aspect-based latent factor model by integrating ratings and reviews for recommender system. Knowl.-Based Syst. 110, 233–243 (2016)

    Article  Google Scholar 

  10. Bao, Y., Fang, H., Zhang, J.: TopicMF: simultaneously exploiting ratings and reviews for recommendation. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence. pp. 2–8 (2014)

    Google Scholar 

  11. Zhang, W., Wang, J.: Integrating topic and latent factors for scalable personalized review based rating prediction. IEEE Trans. Knowl. Data Eng. 28(11), pp. 3013–3027 (2016)

    Article  Google Scholar 

  12. Wang, C., Blei, D.: Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD International conference on Knowledge Discovery and Data Mining, pp. 448–456. ACM (2011)

    Google Scholar 

  13. Ling, G., Lyu, M., King, I.: Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM Conference on Recommender systems, pp. 105–112. ACM (2014)

    Google Scholar 

  14. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  15. Kingma, D.P., Ba, J.: Adam.: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  16. Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural network acoustic models. In: Proceedings ICML (2013)

    Google Scholar 

  17. Cheng, Z., Ding, Y., He, X., Zhu, L., Song, X., Kankanhalli, M.: A3NCF: an adaptive aspect attention model for rating prediction. In: IJCAI (2018)

    Google Scholar 

  18. He, X., Liao, L., Zhang, H., et al.: Proceedings of the 26th International Conference on World Wide Web, Neural Collaborative Filtering, pp. 173–182 (2017)

    Google Scholar 

  19. Shen, Y., Jin, R.: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Social Latent Factor Model for Social Recommendation, p. 1303 (2012)

    Google Scholar 

Download references

Acknowledgment

We would like to acknowledge the support from the National Science Foundation of China (61472095).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongbin Dong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dong, H., Yang, L., Han, K. (2019). Collaborative Filtering Based on Attention Mechanism. In: Knight, K., Zhang, C., Holmes, G., Zhang, ML. (eds) Artificial Intelligence. ICAI 2019. Communications in Computer and Information Science, vol 1001. Springer, Singapore. https://doi.org/10.1007/978-981-32-9298-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-32-9298-7_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-32-9297-0

  • Online ISBN: 978-981-32-9298-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics