Skip to main content

Movie Recommender System Based on Collaborative Filtering Using Apache Spark

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 839))

Abstract

Recently, the building of recommender systems becomes a significant research area that attractive several scientists and researchers across the world. The recommender systems are used in a variety of areas including music, movies, books, news, search queries, and commercial products. Collaborative Filtering algorithm is one of the popular successful techniques of RS, which aims to find users closely similar to the active one in order to recommend items. Collaborative filtering (CF) with alternating least squares (ALS) algorithm is the most imperative techniques which are used for building a movie recommendation engine. The ALS algorithm is one of the models of matrix factorization related CF which is considered as the values in the item list of user matrix. As there is a need to perform analysis on the ALS algorithm by selecting different parameters which can eventually help in building efficient movie recommender engine. In this paper, we propose a movie recommender system based on ALS using Apache Spark. This research focuses on the selection of parameters of ALS algorithms that can affect the performance of a building robust RS. From the results, a conclusion is drawn according to the selection of parameters of ALS algorithms which can affect the performance of building of a movie recommender engine. The model evaluation is done using different metrics such as execution time, root mean squared error (RMSE) of rating prediction, and rank in which the best model was trained. Two best cases are chosen based on best parameters selection from experimental results which can lead to building good prediction rating for a movie recommender.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Verma, J. P., Patel, B., & Patel, A. (2015). Big data analysis: Recommendation system with Hadoop framework. In 2015 IEEE International Conference on Computational Intelligence & Communication Technology (CICT). IEEE.

    Google Scholar 

  2. Katarya, R., & Verma, O. P. (2016). A collaborative recommender system enhanced with particle swarm optimization technique. Multimedia Tools and Applications, 75(15), 9225–9239.

    Article  Google Scholar 

  3. https://docs.databricks.com/_static/notebooks/cs100x-2015-introduction-to-big-data/module-5--machine-learning-lab.html.

  4. Wei, J., et al. (2016). Collaborative filtering and deep learning based hybrid recommendation for cold start problem. In 2016 IEEE 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech). IEEE.

    Google Scholar 

  5. Kupisz, B., & Unold, O. (2015). Collaborative filtering recommendation algorithm based on Hadoop and Spark. In 2015 IEEE International Conference on Industrial Technology (ICIT). IEEE.

    Google Scholar 

  6. Zeng, X., et al. (2016). Parallelization of latent group model for group recommendation algorithm. In IEEE International Conference on Data Science in Cyberspace (DSC). IEEE.

    Google Scholar 

  7. Ponnam, L. T., et al. (2016). Movie recommender system using item based collaborative filtering technique. In International Conference on Emerging Trends in Engineering, Technology, and Science (ICETETS). IEEE.

    Google Scholar 

  8. Halder, S., Sarkar, A. M. J., & Lee, Y.-K. (2012). Movie recommendation system based on movie swarm. In 2012 Second International Conference on Cloud and Green Computing (CGC). IEEE.

    Google Scholar 

  9. Dev, A. V., & Mohan, A. (2016). Recommendation system for big data applications based on set similarity of user preferences. In International Conference on Next Generation Intelligent Systems (ICNGIS). IEEE.

    Google Scholar 

  10. Chen, Y.-C., et al. (2016). User behavior analysis and commodity recommendation for point-earning apps. In 2016 Conference on Technologies and Applications of Artificial Intelligence (TAAI). IEEE.

    Google Scholar 

  11. Zhou, Y. H., Wilkinson, D., & Schreiber, R. (2008). Large scale parallel collaborative filtering for the Netflix prize. In Proceedings of 4th International Conference on Algorithmic Aspects in Information and Management (pp. 337–348). Shanghai: Springer.

    Google Scholar 

  12. https://spark.apache.org/docs/latest/. Accessed March 10, 2017.

  13. https://grouplens.org/datasets/movielens/. Accessed May 15, 2017.

  14. Delgado, J. A. (2000, February). Agent-based information filtering and recommender systems on the internet (Ph.D. thesis). Nagoya Institute of Technology.

    Google Scholar 

  15. Mooney, R. J., & Roy, L. (1999). Content-based book recommendation using learning for text categorization. In Proceedings of the Workshop on Recommender Systems: Algorithms and Evaluation (SIGIR ‘99). Berkeley, CA, USA.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Mohammed Fadhel Aljunid or D. H. Manjaiah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Aljunid, M.F., Manjaiah, D.H. (2019). Movie Recommender System Based on Collaborative Filtering Using Apache Spark. In: Balas, V., Sharma, N., Chakrabarti, A. (eds) Data Management, Analytics and Innovation. Advances in Intelligent Systems and Computing, vol 839. Springer, Singapore. https://doi.org/10.1007/978-981-13-1274-8_22

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-1274-8_22

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-1273-1

  • Online ISBN: 978-981-13-1274-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics