Skip to main content
SpringerLink
Log in

Identifying representative users in matrix factorization-based recommender systems: application to solving the content-less new item cold-start problem

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Matrix factorization has proven to be one of the most accurate recommendation approaches. However, it faces one major shortcoming: the latent features that result from the factorization are not directly interpretable. Providing interpretation for these features is important not only to help explain the recommendations presented to users, but also to understand the underlying relations between the users and the items. This paper consists of 2 contributions. First, we propose to automatically interpret features as users, referred to as representative users. This interpretation relies on the study of the matrices that result from the factorization and on their link with the original rating matrix. Such an interpretation is not only performed automatically, as it does not require any human expertise, but it also helps to explain the recommendations. The second proposition of this paper is to exploit this interpretation to alleviate the content-less new item cold-start problem. The experiments conducted on several benchmark datasets confirm that the features discovered by a Non-Negative Matrix Factorization can be interpreted as users and that representative users are a reliable source of information that allows to accurately estimate ratings on new items. They are thus a promising way to solve the new item cold-start problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. https://movielens.org/

  2. http://www.ieor.berkeley.edu/goldberg/jester-data/

References

  • Adomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734–749.

    Article  Google Scholar 

  • Agarwal, D., & Chen, B.C. (2010). flda: matrix factorization through latent dirichlet allocation. In Proceedings of the 3d ACM international conference on web search and data mining (pp. 91–100): ACM.

  • Aleksandrova, M., Brun, A., Boyer, A., & Chertov, O. (2014). Search for user-related features in matrix factorization-based recommender systems. In Proceedings of European conference on machine learning and principles and practice of knowledge discovery in databases - Doctoral session (p. 10).

  • Amatriain, X., Lathia, N., Pujol, J.M., Kwak, H., & Oliver, N. (2009). The wisdom of the few: a collaborative filtering approach based on expert opinions from the web. In Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval (pp. 532–539): ACM.

  • Behnke, S. (2003). Discovering hierarchical speech features using convolutional non-negative matrix factorization. In Proceedings of the international joint conference on neural networks, (Vol. 4 pp. 2758–2763): IEEE.

  • Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013). Recommender systems survey. Knowledge-Based Systems, 46, 109–132.

    Article  Google Scholar 

  • Brun, A., Aleksandrova, M., & Boyer, A. (2014). Can latent features be interpreted as users in matrix factorization-based recommender systems?. In Proceedings of 2014 IEEE/WIC/ACM international joint conferences on web intelligence and intelligent agent technologies, (Vol. 2 pp. 226–233): IEEE.

  • Chagoyen, M., Carmona-Saez, P., Shatkay, H., Carazo, J.M., & Pascual-Montano, A. (2006). Discovering semantic features in the literature: a foundation for building functional associations. BMC Bioinformatics, 7(1), 41.

    Article  Google Scholar 

  • Das, A.S., Datar, M., Garg, A., & Rajaram, S. (2007). Google news personalization: scalable online collaborative filtering. In Proceedings of the 16th international conference on world wide web (pp. 271–280): ACM.

  • Desrosiers, C., & Karypis, G. (2011). A comprehensive survey of neighborhood-based recommendation methods. In Recommender systems handbook (pp. 107–144): Springer.

  • Devarajan, K. (2008). Nonnegative matrix factorization: an analytical and interpretive tool in computational biology. PLoS Computational Biology, 4(7), 12.

    Article  Google Scholar 

  • Enrich, M., Braunhofer, M., & Ricci, F. (2013). Cold-start management with cross-domain collaborative filtering and tags. In E-commerce and web technologies, (Vol. 152 pp. 101–112): Springer.

  • Esslimani, I., Brun, A., & Boyer, A. (2013). Towards leader based recommendations. In The influence of technology on social network analysis and mining (pp. 455–470): Springer.

  • Gantner, Z., Drumond, L., Freudenthaler, C., Rendle, S., & Schmidt-thieme, L. (2010). Learning attribute-to-feature mappings for cold-start recommendations. In Proceedings of 2010 IEEE 10th international conference on data mining (ICDM) (pp. 176–185): IEEE.

  • Goreinov, S., Oseledets, I., Savostyanov, D., Tyrtyshnikov, E., & Zamarashkin, N. (2010). How to find a good submatrix. Matrix methods: theory, algorithms and applications, 247–256.

  • Graus, M. (2011). Understanding the latent features of matrix factorization algorithms in movie recommender systems: Master’s thesis, Technische Universiteit Eindhoven.

  • Guermeur, Y., Lifchitz, A., & Vert, R. (2004). A kernel for protein secondary structure prediction. In Kernel methods in computational biology (pp. 193–206): MIT Press.

  • Herlocker, J.L., Konstan, J.A., & Riedl, J. (2000). Explaining collaborative filtering recommendations. In Proceedings of the 2000 ACM conference on computer supported cooperative work (pp. 241–250): ACM.

  • Houlsby, N., Hernandez-lobato, J.M., & Ghahramani, Z. (2014). Cold-start active learning with robust ordinal matrix factorization. In Proceedings of the 31st international conference on machine learning (ICML-14) (pp. 766–774).

  • Hu, G.N., Dai, X.Y., Song, Y., Huang, S.J., & Chen, J.J. (2015). A synthetic approach for recommendation: combining ratings, social relations, and reviews. In Proceedings of the 24th international joint conference on artificial intelligence (pp. 1756–1762): AAAI Press.

  • Hu, Y., Koren, Y., & Volinsky, C. (2008). Collaborative filtering for implicit feedback datasets. In Proceedings of 8th IEEE international conference on data mining (pp. 263–272): IEEE.

  • Huang, S. (2011). Designing utility-based recommender systems for e-commerce: evaluation of preference-elicitation methods. Electronic Commerce Research and Applications, 10(4), 398–407.

    Article  Google Scholar 

  • Huang, Y.J., Xiang, E.W., & Pan, R. (2012). Constrained collective matrix factorization. In Proceedings of the 6th ACM conference on recommender systems (pp. 237–240): ACM.

  • Jamali, M., & Ester, M. (2011). A transitivity aware matrix factorization model for recommendation in social networks. In Proceedings of IJCAI, the 22nd international joint conference on artificial intelligence, (Vol. 11 pp. 2644–2649): Citeseer.

  • Karatzoglou, A., Amatriain, X., Baltrunas, L., & Oliver, N. (2010). Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In Proceedings of the 4th ACM conference on recommender systems (pp. 79–86): ACM.

  • Klašnja-Milićević, A., Ivanović, M., & Nanopoulos, A. (2015). Recommender systems in e-learning environments: a survey of the state-of-the-art and possible extensions. Artificial Intelligence Review, 44(4), 571–604.

    Article  Google Scholar 

  • Koren, Y (2008). Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 426–434): ACM.

  • Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8), 30–37.

    Article  Google Scholar 

  • Lam, X.N., Vu, T., Le, T.D., & Duong, A.D. (2008). Addressing cold-start problem in recommendation systems. In Proceedings of the 2nd international conference on ubiquitous information management and communication (pp. 208–211): ACM.

  • Lee, D.D., & Seung, H.S. (1999). Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755), 788–791.

    Article  Google Scholar 

  • Lee, D.D., & Seung, H.S. (2001). Algorithms for non-negative matrix factorization. In Proceedings of advances in neural information processing systems (pp. 556–562).

  • Liu, N.N., Meng, X., Liu, C., & Yang, Q. (2011). Wisdom of the better few: cold start recommendation via representative based rating elicitation. In Proceedings of the 5th ACM conference on recommender systems (pp. 37–44): ACM.

  • Lops, P., De Gemmis, M., & Semeraro, G. (2011). Content-based recommender systems: State of the art and trends. In Recommender systems handbook (pp. 73–105): Springer.

  • Ma, H., Zhou, D., Liu, C., Lyu, M.R., & King, I. (2011). Recommender systems with social regularization. In Proceedings of the 4th ACM international conference on web search and data mining (pp. 287–296): ACM.

  • McAuley, J., & Leskovec, J. (2013). Hidden factors and hidden topics: understanding rating dimensions with review text. In Proceedings of the 7th ACM conference on recommender systems (pp. 165–172): ACM.

  • Melville, P., Mooney, R.J., & Nagarajan, R. (2002). Content-boosted collaborative filtering for improved recommendations: American Association for Artificial Intelligence.

  • Mnih, A., & Salakhutdinov, R. (2007). Probabilistic matrix factorization. In Proceedings of advances in neural information processing systems, (Vol. 2007 pp. 1257–1264).

  • Ortega, F., Bobadilla, J., & Hernando, A. (2014). Using hierarchical graph maps to explain collaborative filtering recommendations. International Journal of Intelligent Systems, 29(5), 462–477.

    Article  Google Scholar 

  • Park, S.T., & Chu, W. (2009). Pairwise preference regression for cold-start recommendation. In Proceedings of the ACM conference on recommender systems (RecSys) (pp. 21–28): ACM.

  • Pessiot, J.F., Truong, T.V., Usunier, N., Amini, M.R., & Gallinari, P. (2006). Factorisation en matrices non-négatives pour le filtrage collaboratif. In Proceedings of 3rd conference en recherche d’Information et applications (pp. 315–326).

  • Rashid, A.M. (2007). Mining influence in recommender systems: PhD thesis, University of Minnesota.

  • Rashid, A.M., Albert, I., Cosley, D., Lam, S.K., McNee, S.M., Konstan, J.A., & Riedl, J. (2002). Getting to know you: learning new user preferences in recommender systems. In Proceedings of the 7th international conference on intelligent user interfaces (pp. 127–134): ACM.

  • Rossetti, M. (2014). Advancing recommender systems from the algorithm interface and methodological perspective: PhD thesis, Università Degli Studi di Milano - BICOCCA.

  • Salakhutdinov, R., & Mnih, A. (2008). Bayesian probabilistic matrix factorization using markov chain monte carlo. In Proceedings of the 25th international conference on machine learning (pp. 880–887).

  • Sarwar, B., Karypis, G., Konstan, J., & Riedl, J.T. (2000). Application of dimensionality reduction in recommender system, a case study. In Proceedings of ACM WebKDD 2000 web mining for E-commerce workshop (p. 12).

  • Saveski, M. (2013). Cold start recommendations: a non-negative matrix factorization approach: Master’s thesis, Universidad Politecnica de Cataluna.

  • Schafer, J.B., Frankowski, D., Herlocker, J., & Sen, S. (2007). Collaborative filtering recommender systems. In The adaptive web (pp. 291–324): Springer.

  • Seminario, C.E., & Wilson, D.C. (2014). Assessing impacts of a power user attack on a matrix factorization collaborative recommender system. In Proceedings of the 27th international florida artificial intelligence research society conference (pp. 81–86).

  • Shani, G., & Gunawardana, A. (2011). Evaluating recommendation systems. In Recommender systems handbook (pp. 257–297): Springer.

  • Singh, A.P., & Gordon, G.J. (2008). Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 650–658): ACM.

  • Sinha, R., & Swearingen, K. (2002). The role of transparency in recommender systems. In Proceedings of CHI’02 extended abstracts on human factors in computing systems (pp. 830–831): ACM.

  • Smyth, B., & McClave, P. (2001). Similarity vs. diversity. In Case-based reasoning research and development (pp. 347–361): Springer.

  • Sun, M., Li, F., Lee, J., Zhou, K., Lebanon, G., & Zha, H. (2013). Learning multiple-question decision trees for cold-start recommendation. In Proceedings of the 6th ACM international conference on web search and data mining (pp. 445–454): ACM.

  • Takacs, G., Pilaszy, I., Nemeth, B., & Tikk, D. (2009). Scalable collaborative filtering approaches for large recommender systems. Journal of Machine Learning Research, 10, 623–656.

    Google Scholar 

  • Verbert, K., Manouselis, N., Ochoa, X., & Wolpers, M. (2012). Context-aware recommender systems for learning: a survey and future challenges. IEEE Transactions on Learning Technologies, 5(4), 318–335.

    Article  Google Scholar 

  • Willemsen, M.C., Knijnenburg, B.P., Graus, M.P., Velter-Bremmers, L.C., & Fu, K. (2011). Using latent features diversification to reduce choice difficulty in recommendation lists. In Proceedings of RecSys11 workshop on human decision making in recommender systems (pp. 14–20).

  • Xie, Y., Chen, Z., Zhang, K., Jin, C., Cheng, Y., Agrawal, A., & Choudhary, A. (2013). Elver: recommending facebook pages in cold start situation without content features. In Proceedings of 2013 IEEE international conference on big data (pp. 475–479).

  • Xin, X., Lin, C.Y., Wei, X.C., & Huang, H.Y. (2015). When factorization meets heterogeneous latent topics: an interpretable cross-site recommendation framework. Journal of Computer Science and Technology, 30(4), 917–932.

    Article  MathSciNet  Google Scholar 

  • Yoo, J., & Choi, S. (2009). Weighted nonnegative matrix co-tri-factorization for collaborative prediction. Advances in Machine Learning, 5828, 396–411.

    Google Scholar 

  • Zanker, M., Fuchs, M., Hpken, W., Tuta, M., & Muller, N. (2008). Evaluating recommender systems in tourism a case study from austria: Springer.

  • Zhang, S., Wang, W., Ford, J., & Makedon, F. (2006). Learning from incomplete ratings using non-negative matrix factorization. In Proceedings of the 6th SIAM conference on data mining, (Vol. 6 pp. 548–552).

  • Zhang, Y., Lai, G., Zhang, M., Zhang, Y., Liu, Y., & Ma, S. (2014). Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In Proceedings of the 37th international ACM SIGIR conference on research & development in information retrieval (pp. 83–92): ACM.

  • Zhao, D., Wang, J., Gao, A., & Yue, P. (2015). Learning to recommend with hidden factor models and social trust ensemble. In Proceedings of international conference on computer science and intelligent communication (pp. 87–91).

  • Zhou, K., Yang, S.H., & Zha, H. (2011). Functional matrix factorizations for cold-start recommendation. In Proceedings of the 34th international ACM SIGIR conference on research and development in information retrieval (pp. 315–324): ACM.

  • Zhou, Y., Wilkinson, D., Schreiber, R., & Pan, R. (2008). Large-scale parallel collaborative filtering for the netflix prize. In Algorithmic aspects in information and management (pp. 337–348): Springer.

  • Ziegler, C.N., McNee, S.M., Konstan, J.A., & Lausen, G. (2005). Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on world wide web (pp. 22–32): ACM.

Download references

Author information

Authors and Affiliations

  1. Université de Lorraine - LORIA, Campus Scientifique, 54506, Vandøeuvre lès Nancy, France

    Marharyta Aleksandrova, Armelle Brun & Anne Boyer

  2. National Technical University of Ukraine “Kyiv Polytechnic Institute”, Kyiv, Ukraine

    Marharyta Aleksandrova & Oleg Chertov

Authors
  1. Marharyta Aleksandrova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Armelle Brun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anne Boyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Oleg Chertov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marharyta Aleksandrova.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aleksandrova, M., Brun, A., Boyer, A. et al. Identifying representative users in matrix factorization-based recommender systems: application to solving the content-less new item cold-start problem. J Intell Inf Syst 48, 365–397 (2017). https://doi.org/10.1007/s10844-016-0418-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-016-0418-3

Keywords

Search

Navigation