Collaborative Filtering, Matrix Factorization and Population Based Search: The Nexus Unveiled

  • Ayangleima LaishramEmail author
  • Satya Prakash Sahu
  • Vineet Padmanabhan
  • Siba Kumar Udgata
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9949)


Collaborative Filtering attempts to solve the problem of recommending m items by n users where the data is represented as an \(n \times m\) matrix. A popular method is to assume that the solution lies in a low dimensional space, and the task then reduces to the one of inferring the latent factors in that space. Matrix Factorization attempts to find those latent factors by treating it as a matrix completion task. The inference is done by minimizing an objective function by gradient descent. While it’s a robust technique, a major drawback of it is that gradient descent tends to get stuck in local minima for non-convex functions. In this paper we propose four frameworks which are novel combinations of population-based heuristics with gradient descent. We show results from extensive experiments on the large scale MovieLens dataset and demonstrate that our approach provides better and more consistent solutions than gradient descent alone.


  1. 1.
    Abbas, A., Zhang, L., Khan, S.U.: A survey on context-aware recommender systems based on computational intelligence techniques. Computing 97(7), 667–690 (2015)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Alam, S., Dobbie, G., Riddle, P.: Towards recommender system using particle swarm optimization based web usage clustering. In: Cao, L., Huang, J.Z., Bailey, J., Koh, Y.S., Luo, J. (eds.) PAKDD 2011. LNCS (LNAI), vol. 7104, pp. 316–326. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-28320-8_27 CrossRefGoogle Scholar
  3. 3.
    Alam, S., Dobbie, G., Riddle, P., Koh, Y.S.: Hierarchical PSO clustering based recommender system. In: 2012 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE (2012)Google Scholar
  4. 4.
    Bakshi, S., Jagadev, A.K., Dehuri, S., Wang, G.-N.: Enhancing scalability and accuracy of recommendation systems using unsupervised learning and particle swarm optimization. Appl. Soft Comput. 15, 21–29 (2014)CrossRefGoogle Scholar
  5. 5.
    Barla-Szabó, D.: A study of gradient based particle swarm optimisers. Ph.D thesis, University of Pretoria, Pretoria, (2010)Google Scholar
  6. 6.
    Devi, V.S., Rao, K.V., Pujari, A.K., Padmanabhan, V.: Collaborative filtering by PSO-based MMMF. In: 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 569–574. IEEE (2014)Google Scholar
  7. 7.
    Diaz-Aviles, E., Georgescu, M., Nejdl, W.: Swarming to rank for recommender systems. In: Proceedings of the Sixth ACM Conference on Recommender Systems, RecSys 2012, pp. 229–232. ACM, New York (2012)Google Scholar
  8. 8.
    Ghosh, P., Zarfar, H., Das, S., Abraham, A.: Hierarchical dynamic neighborhood based PSO for global optimization. In: 2011 IEEE Congress on Evolutionary Computation (CEC), pp. 757–764. IEEE (2011)Google Scholar
  9. 9.
    Kennedy, J., Eberhart, R.C.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)Google Scholar
  10. 10.
    Navgaran, D.Z., Moradi, P., Akhlaghian, F.: Evolutionary based matrix factorization method for collaborative filtering systems. In: 2013 21st Iranian Conference on Electrical Engineering (ICEE), pp. 1–5, (2013)Google Scholar
  11. 11.
    Rennie, J.D.M., Srebro, N.: Fast maximum margin matrix factorization for collaborative prediction. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, pp. 713–719. ACM, New York (2005)Google Scholar
  12. 12.
    Srebro, N., Rennie, J., Jaakkola, T.S.: Maximum-margin matrix factorization. In: Advances in Neural Information Processing Systems, pp. 1329–1336 (2004)Google Scholar
  13. 13.
    Ujjin, S., Bentley, P.J.: Particle swarm optimization recommender system. In: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, SIS 2003, pp. 124–131. IEEE (2003)Google Scholar
  14. 14.
    Wasid, M., Kant, V.: A particle swarm approach to collaborative filtering based recommender systems through fuzzy features. Procedia Comput. Sci. 54, 440–448 (2015)CrossRefGoogle Scholar
  15. 15.
    Mingrui, W.: Collaborative filtering via ensembles of matrix factorization. In: KDDCup 2007, pp. 43–47 (2007)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Ayangleima Laishram
    • 1
    Email author
  • Satya Prakash Sahu
    • 1
  • Vineet Padmanabhan
    • 1
  • Siba Kumar Udgata
    • 1
  1. 1.School of Computer and Information SciencesUniversity of HyderabadHyderabadIndia

Personalised recommendations