Abstract
The recommendation system can effectively and quickly provide valuable information for users by filtering out massive useless data. User behavior modeling can extract all kinds of aggregated features over the heterogeneous behaviors to help recommendation. However, the existing user behavior modeling method cannot solve the cold-start problem caused by data sparse. Recent recommender systems which exploit reviews for learning representation can alleviate the above problem to a certain extent. Therefore, a user behavior modeling is proposed for recommendation task using attention neural network based on user reviews (AT-UBM). Firstly vanilla attention was used to sample reviews, and then CNN+Pooling method was applied to extract user behavior features. Finally the long-term behavior was combined with short-term behavior in feature spaces. Experimental results on real datasets show that the review-based user behavior model has better prediction accuracy and generalization capability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
He, L., Jiang, B., Lv, S., Liu, Y., Li, D.: A review of research on recommendation systems based on deep learning. Chin. J. Comput. 7, 11 (2018)
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.-S. (eds.): Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee (2007)
Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.-S.: Attentional factorization machines: learning the weight of feature interactions via attention networks. arXiv preprint arXiv:04617 (2017)
Xiong, C., Zhong, V., Socher, R.: Dynamic coattention networks for question answering. arXiv preprint arXiv:01604 (2016)
Batmaz, Z., Yurekli, A., Bilge, A., Kaleli, C.: A review on deep learning for recommender systems: challenges and remedies. Artif. Intell. Rev., 1–37 (2018)
Zhou, C., Bai, J., Song, J., Liu, X., Zhao, Z., Chen, X., et al. (eds.): ATRank: an attention-based user behavior modeling framework for recommendation. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., et al. (eds.): Attention is all you need. In: Advances in Neural Information Processing Systems (2017)
Zheng, L., Noroozi, V., Yu, P.S. (eds.): Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. ACM (2017)
Tay, Y., Luu, A.T., Hui, S.C. (eds.): Multi-pointer co-attention networks for recommendation. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM (2018)
Rendle, S., Gantner, Z., Freudenthaler, C., Schmidt-Thieme, L. (eds.): Fast context-aware recommendations with factorization machines. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM (2011)
Hariri, N., Mobasher, B., Burke, R. (eds.): Context-aware music recommendation based on latenttopic sequential patterns. In: Proceedings of the Sixth ACM Conference on Recommender Systems. ACM (2012)
Jang, E., Gu, S., Poole, B.: Categorical Reparameterization with Gumbel-Softmax (2016)
Gehring, J., Auli, M., Grangier, D., Yarats, D., Dauphin, Y.N. (eds.): Convolutional sequence to sequence learning. In: Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR.org (2017)
Acknowledgment
This work was supported in part by the National Science Foundation of China (61100048, 61602159), the Natural Science Foundation of Heilongjiang Province (F2016034), the Education Department of Heilongjiang Province (12531498).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yang, K., Zhu, J. (2019). Attention Neural Network for User Behavior Modeling. In: Cheng, X., Jing, W., Song, X., Lu, Z. (eds) Data Science. ICPCSEE 2019. Communications in Computer and Information Science, vol 1058. Springer, Singapore. https://doi.org/10.1007/978-981-15-0118-0_3
Download citation
DOI: https://doi.org/10.1007/978-981-15-0118-0_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-0117-3
Online ISBN: 978-981-15-0118-0
eBook Packages: Computer ScienceComputer Science (R0)