Skip to main content

Variational Autoencoders Versus Denoising Autoencoders for Recommendations

  • Conference paper
  • First Online:
Book cover WITS 2020

Abstract

Recommender systems help users explore new content such as music and news by showing them what they will find potentially interesting. There are many methods and algorithms that can help recommender systems create personalized recommendations. All recommendation approaches can be divided into three categories: Content-based recommendation, Collaborative filtering and Hybrid methods. In this paper, we explore and compare Variational Autoencoders and Denoising Autoencoders for Collaborative Filtering with implicit feedback. A Variational Autoencoders(VAE) is a non-linear model, so it can capture patterns that are more complex in the data and since the forward pass is sufficient to obtain the recommendation of a given user then the query time is fast. A Denoising AutoEncoder is a specific type of AutoEncoder, which is generally classed as a type of deep neural network and is trained to use a hidden layer to reconstruct a particular model based on its inputs. Comparison results between Variational Autoencoders (VAE) and Denoising Autoencoders (DAE) show that VAE has the upper hand when it comes to large datasets while DAE is better when using small datasets. We explore and evaluate both methods on three public datasets and using different metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl Based Syst 46:109–132. https://doi.org/10.1016/j.knosys.2013.03.012

    Article  Google Scholar 

  2. Batmaz Z, Yurekli A, Bilge A, Kaleli C (2018) A review on deep learning for recommender systems: challenges and remedies. Artif Intell Rev. https://doi.org/10.1007/s10462-018-9654-y

    Article  Google Scholar 

  3. Hossein A, Rafsanjani N, Salim N, Aghdam AR (2013) Recommendation systems: a review Karamollah Bagheri Fard. Int J Comput Eng Res 3(5):47–52

    Google Scholar 

  4. Nilashi M, Bagherifard K, Ibrahim O, Alizadeh H, Nojeem LA, Roozegar N (2013) Collaborative filtering recommender systems. Res J Appl Sci Eng Technol 5(16):4168–4182. https://doi.org/10.1007/978-3-540-72079-9_9

    Article  Google Scholar 

  5. Miao Y, Yu L, Blunsom P (2016) Neural variational inference for text processing. In: 33rd international conference on machine learning, ICML 2016, vol 4, no. Mcmc, pp 2589–2600

    Google Scholar 

  6. Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, vol 2015, pp 1235–1244, https://doi.org/10.1145/2783258.2783273

  7. Liang D, Krishnan RG, Hoffman MD, Jebara T (2018) Variational autoencoders for collaborative filtering. In: Web conference on 2018—proceedings of world wide web conference WWW 2018, pp 689–698. https://doi.org/10.1145/3178876.3186150

  8. Doersch C (2016) Tutorial on variational autoencoders, pp 1–23 [Online]. Available: https://arxiv.org/abs/1606.05908

  9. Xu L, Cao M, Song B, Zhang J, Liu Y, Alsaadi FE (2018) Open-circuit fault diagnosis of power rectifier using sparse autoencoder based deep neural network. Neurocomputing 311:1–10. https://doi.org/10.1016/j.neucom.2018.05.040

    Article  Google Scholar 

  10. Dolz J et al (2016) Stacking denoising auto-encoders in a deep network to segment the brainstem on MRI in brain cancer patients: a clinical study. Comput Med Imaging Graph 52:8–18. https://doi.org/10.1016/j.compmedimag.2016.03.003

    Article  Google Scholar 

  11. Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009(3):1–19. https://doi.org/10.1155/2009/421425

  12. Kingma DP, Welling M (2014) Auto-encoding variational bayes. In: 2nd international conference on learning and representant ICLR 2014—conference track process, no. Ml, pp 1–14

    Google Scholar 

  13. Mescheder L, Nowozin S, Geiger A (2017) Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: 34th international conference on machine and learning. ICML 2017, vol 5, pp 3694–3707

    Google Scholar 

  14. Li X, She J (2017) Collaborative variational autoencoder for recommender systems. In: Proceedings of ACM SIGKDD international conference on knowledge discovery data mining, vol. Part F1296, pp 305–314. https://doi.org/10.1145/3097983.3098077

  15. https://grouplens.org/datasets/movielens/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Khadija Bennouna .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bennouna, K., Chougrad, H., Khamlichi, Y., El Boushaki, A., El Haj Ben Ali, S. (2022). Variational Autoencoders Versus Denoising Autoencoders for Recommendations. In: Bennani, S., Lakhrissi, Y., Khaissidi, G., Mansouri, A., Khamlichi, Y. (eds) WITS 2020. Lecture Notes in Electrical Engineering, vol 745. Springer, Singapore. https://doi.org/10.1007/978-981-33-6893-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-981-33-6893-4_17

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-33-6892-7

  • Online ISBN: 978-981-33-6893-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics