Skip to main content

Deep Bayesian Matrix Factorization

  • Conference paper
  • First Online:
Advances in Knowledge Discovery and Data Mining (PAKDD 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10235))

Included in the following conference series:

Abstract

Matrix factorization is a popular collaborative filtering technique, assuming that the matrix of ratings can be written as the inner product of two low-rank matrices, comprising latent features assigned to each user/item. Recently, several researchers have developed Bayesian treatments of matrix factorization, that infer posterior distributions over the postulated user and item latent features. As it has been shown, by allowing for taking uncertainty into account, such Bayesian inference approaches can better model sparse data, which are prevalent in real-world applications. In this paper, we consider replacing the inner product in the likelihood function of Bayesian matrix factorization with an arbitrary function that we learn from the data at the same time as we learn the latent feature posteriors; specifically, we parameterize the likelihood function using dense layer (DL) deep networks. In addition, to allow for addressing the cold-start problem, we also devise a model extension that takes into account item content, treated as side information. We provide extensive experimental evaluations on several real-world datasets; we show that our method completely outperforms state-of-the-art alternatives, without compromising computational efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://deeplearning.net/software/theano/.

  2. 2.

    http://grouplens.org/datasets/movielens/100k/.

  3. 3.

    http://grouplens.org/datasets/movielens/1m/.

  4. 4.

    http://7digital.com.

References

  1. Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I.J., Bergeron, A., Bouchard, N., Bengio, Y.: Theano: new features and speed improvements. In: Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop (2012)

    Google Scholar 

  2. Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. JMLR 12, 2121–2159 (2010)

    MathSciNet  MATH  Google Scholar 

  3. Jaakkola, T., Jordan, M.: Bayesian parameter estimation via variational methods. Stat. Comput. 10, 25–37 (2000)

    Article  Google Scholar 

  4. Kingma, D., Welling, M.: Auto-encoding variational Bayes. In: Proceedings of the ICLR (2014)

    Google Scholar 

  5. Kingma, D.P., Rezende, D.J., Mohamed, S., Welling, M.: Semi-supervised learning with deep generative models. In: Proceedings of the NIPS (2014)

    Google Scholar 

  6. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the ACM SIGKDD, pp. 426–434 (2008)

    Google Scholar 

  7. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 512, 436–444 (2015)

    Article  Google Scholar 

  8. McFee, B., Bertin-Mahieux, T., Ellis, D.P.W., Lanckriet, G.R.G.: The million song dataset challenge. In: Proceedings of the WWW, pp. 909–916 (2012)

    Google Scholar 

  9. Nair, V., Hinton, G.: Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the ICML (2010)

    Google Scholar 

  10. Pan, R., Zhou, Y., Cao, B., Liu, N.N., Lukose, R., Scholz, M., Yang, Q.: One-class collaborative filtering. In: Proceedings of the ICDM, pp. 502–511 (2008)

    Google Scholar 

  11. Park, S., Kim, Y.D., Choi, S.: Hierarchical Bayesian matrix factorization with side information. In: Proceedings of the IJCAI (2013)

    Google Scholar 

  12. Porteous, I., Asuncion, A., Welling, M.: Bayesian matrix factorization with side information and Dirichlet process mixtures. In: Proceedings of the AAAI (2010)

    Google Scholar 

  13. Rezende, D.J., Mohamed, S., Wierstra, D.: Stochastic backpropagation and approximate inference in deep generative models. In: Proceedings of the ICML (2014)

    Google Scholar 

  14. Rezende, D.J., Mohamed, S.: Variational inference with normalizing flows. In: Proceedings of the ICML (2015)

    Google Scholar 

  15. Salakhutdinov, R., Murray, I.: On the quantitative analysis of deep belief networks. In: Proceedings of the ICML, pp. 872–879. ACM Press (2008)

    Google Scholar 

  16. Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: Proceedings of the NIPS (2007)

    Google Scholar 

  17. Salakhutdinov, R., Mnih, A.: Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In: Proceedings of ICML (2008)

    Google Scholar 

  18. Shi, J., Wang, N., Xia, Y., Yeung, D.Y., King, I., Jia, J.: SCMF: sparse covariance matrix factorization for collaborative filtering. In: Proceedings of the IJCAI (2013)

    Google Scholar 

  19. Wang, X., Wang, Y.: Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the ACM MultiMedia (2014)

    Google Scholar 

Download references

Acknowledgment

This work has been partially supported by the NVIDIA Corporation, as well as the EU H2020 NOTRE project (grant 692058).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sotirios P. Chatzis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Chatzis, S.P. (2017). Deep Bayesian Matrix Factorization. In: Kim, J., Shim, K., Cao, L., Lee, JG., Lin, X., Moon, YS. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2017. Lecture Notes in Computer Science(), vol 10235. Springer, Cham. https://doi.org/10.1007/978-3-319-57529-2_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-57529-2_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-57528-5

  • Online ISBN: 978-3-319-57529-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics