Deep Collaborative Filtering Combined with High-Level Feature Generation on Latent Factor Model

  • Xu Li
  • Xu Chen
  • Zheng QinEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11301)


Recommender System becomes indispensable in the era of information explosion nowadays. Former researchers have noticed the important role of high-level feature playing on semantic factor cases. However, in more common scenes where semantic features cannot be reached, research involving high-level feature on latent factor models is lacking. Analogizing to the idea of the convolutional neural network in image processing, we proposed a Weighted Feature Interaction Network to generate high-level features from the low-level latent factors. An intuitive interpretation is also given to help understand. Then it is integrated into a Deep Collaborative Filtering Model. The results on two real-world datasets show that weighted feature interaction network works and our Deep Collaborative Filtering Model outperforms some conventional and state-of-the-art models. Our work improves the feature representation and recommendation performance on Latent Factor Model.


Recommender systems Latent factor model Collaborative filtering Deep neural network Implicit feedback 


  1. 1.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). Scholar
  2. 2.
    Cheng, H., et al.: Wide & deep learning for recommender systems. In: Conference On Recommender Systems, pp. 7–10 (2016)Google Scholar
  3. 3.
    Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: DeepFM: a factorization-machine based neural network for CTR prediction. In: International Joint Conference on Artificial Intelligence, pp. 1725–1731 (2017)Google Scholar
  4. 4.
    Juan, Y., Zhuang, Y., Chin, W.S., Lin, C.J.: Field-aware factorization machines for CTR prediction. In: ACM Conference on Recommender Systems, pp. 43–50 (2016)Google Scholar
  5. 5.
    Zhao, Z.D., Shang, M.S.: User-based collaborative-filtering recommendation algorithms on Hadoop. In: International Conference on Knowledge Discovery and Data Mining, pp. 478–481 (2010)Google Scholar
  6. 6.
    Font, F., Serra, J., Serra, X.: Class-based tag recommendation and user-based evaluation in online audio clip sharing. Knowl. Based Syst. 67, 131–142 (2014)CrossRefGoogle Scholar
  7. 7.
    Tung, W., Chen, Y.: User-based social ranking service design for tagging search and recommendation. J. Converg. Inf. Technol. 6(10), 385–390 (2011)Google Scholar
  8. 8.
    Jamali, M., Ester, M.: TrustWalker : a random walk model for combining trust-based and item-based recommendation. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 397–406 (2009)Google Scholar
  9. 9.
    Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: International Conference on World Wide Web, pp. 285–295 (2001)Google Scholar
  10. 10.
    Li, C., Luo, Z.: A hybrid item-based recommendation algorithm against segment attack in collaborative filtering systems. In: International Conference on Information Management, Innovation Management and Industrial Engineering, pp. 403–406 (2011)Google Scholar
  11. 11.
    Rendle, S.: Factorization machines with libFM. ACM Trans. Intell. Syst. Technol. 3(3), 1–22 (2012)CrossRefGoogle Scholar
  12. 12.
    Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 426–434 (2008)Google Scholar
  13. 13.
    Vozalis, M.G., Margaritis, K.G.: Applying SVD on item-based filtering. In: Proceedings of the International Conference on Intelligent Systems Design and Applications, Isda 2005, pp. 464–469 (2006)Google Scholar
  14. 14.
    Bryt, O., Elad, M.: Compression of facial images using the K-SVD algorithm. Academic Press Inc (2008)Google Scholar
  15. 15.
    Rendle, S., Freudenthaler, C., Gantner, Z., Schmidtthieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Uncertainty in Artificial Intelligence, pp. 452–461 (2009)Google Scholar
  16. 16.
    Wang, H., Wang, N., Yeung,D.Y.: Collaborative deep learning for recommender systems. In: Knowledge Discovery and Data Mining, pp. 1235–1244 (2015)Google Scholar
  17. 17.
    Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetzbMATHGoogle Scholar
  18. 18.
    Ebadi, A.: An intelligent hybrid multi-criteria hotel recommender system using explicit and implicit feedbacks. Ebadi Ashkan 9, 1431–1441 (2016)Google Scholar
  19. 19.
    Tkalčič, M., Odić, A., Košir, A., Tasič, J.F.: Impact of implicit and explicit affective labeling on a recommender system’s performance. In: Ardissono, L., Kuflik, T. (eds.) UMAP 2011. LNCS, vol. 7138, pp. 342–354. Springer, Heidelberg (2012). Scholar
  20. 20.
    Li, Q., Zheng, X.: Deep collaborative autoencoder for recommender systems: a unified framework for explicit and implicit feedback (2017). arXiv: Learning
  21. 21.
    Socher, R., Chen, D., Manning, C.D., Ng, A.Y.: Reasoning with neural tensor networks for knowledge base completion. In: International Conference on Neural Information Processing Systems, pp. 926–934 (2013)Google Scholar
  22. 22.
    He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.: Neural collaborative filtering. In: International World Wide Web Conferences, pp. 173–182 (2017)Google Scholar
  23. 23.
    He, X., Chua, T.S.: Neural factorization machines for sparse predictive analytics. In: The International ACM SIGIR Conference, pp. 355–364 (2017)Google Scholar
  24. 24.
    Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.: Attentional factorization machines: learning the weight of feature interactions via attention networks. In: International Joint Conference on Artificial Intelligence, pp. 3119–3125 (2017)Google Scholar
  25. 25.
    Wang, H., Zhang, F., Xie, X., Guo,M.: Dkn: deep knowledge-aware network for news recommendation. In: International World Wide Web Conferences, pp. 1835–1844 (2018)Google Scholar
  26. 26.
    Yu, W., Zhang, H., He, X., Chen, X., Xiong, L., Qin, Z.: Aesthetic-based clothing recommendation. In: World Wide Web Conference, pp. 649–658 (2018)Google Scholar
  27. 27.
    Wang, Y., et al.: Telepath: understanding users from a human vision perspective in large-scale recommender systems. In: National Conference on Artificial Intelligence (2018)Google Scholar
  28. 28.
    Lu, Y., Dong, R., Smyth, B.: Coevolutionary recommendation model: mutual learning between ratings and reviews. In: World Wide Web Conference, pp. 773–782 (2018)Google Scholar
  29. 29.
    Cheng, Z., Ding, Y., Zhu, L., Kankanhalli, M.S.: Aspect-aware latent factor model: rating prediction with ratings and reviews. In: International World Wide Web Conferences, pp. 639–648 (2018)Google Scholar
  30. 30.
    Yao, X., Tan, B., Hu, C., Li, W., Xu, Z., Zhang, Z.: Recommend algorithm combined user-user neighborhood approach with latent factor model. In: International Conference on Mechatronics and Intelligent Robotics, pp. 275–280 (2017)Google Scholar
  31. 31.
    He, Z.: Personalized recommendation based on latent factor model and trust of users. Comput. Knowl. Technol. 4, 044 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.School of SoftwareTsinghua UniversityBeijingChina

Personalised recommendations