Abstract
Recently, the building of recommender systems becomes a significant research area that attractive several scientists and researchers across the world. The recommender systems are used in a variety of areas including music, movies, books, news, search queries, and commercial products. Collaborative Filtering algorithm is one of the popular successful techniques of RS, which aims to find users closely similar to the active one in order to recommend items. Collaborative filtering (CF) with alternating least squares (ALS) algorithm is the most imperative techniques which are used for building a movie recommendation engine. The ALS algorithm is one of the models of matrix factorization related CF which is considered as the values in the item list of user matrix. As there is a need to perform analysis on the ALS algorithm by selecting different parameters which can eventually help in building efficient movie recommender engine. In this paper, we propose a movie recommender system based on ALS using Apache Spark. This research focuses on the selection of parameters of ALS algorithms that can affect the performance of a building robust RS. From the results, a conclusion is drawn according to the selection of parameters of ALS algorithms which can affect the performance of building of a movie recommender engine. The model evaluation is done using different metrics such as execution time, root mean squared error (RMSE) of rating prediction, and rank in which the best model was trained. Two best cases are chosen based on best parameters selection from experimental results which can lead to building good prediction rating for a movie recommender.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Verma, J. P., Patel, B., & Patel, A. (2015). Big data analysis: Recommendation system with Hadoop framework. In 2015 IEEE International Conference on Computational Intelligence & Communication Technology (CICT). IEEE.
Katarya, R., & Verma, O. P. (2016). A collaborative recommender system enhanced with particle swarm optimization technique. Multimedia Tools and Applications, 75(15), 9225–9239.
Wei, J., et al. (2016). Collaborative filtering and deep learning based hybrid recommendation for cold start problem. In 2016 IEEE 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech). IEEE.
Kupisz, B., & Unold, O. (2015). Collaborative filtering recommendation algorithm based on Hadoop and Spark. In 2015 IEEE International Conference on Industrial Technology (ICIT). IEEE.
Zeng, X., et al. (2016). Parallelization of latent group model for group recommendation algorithm. In IEEE International Conference on Data Science in Cyberspace (DSC). IEEE.
Ponnam, L. T., et al. (2016). Movie recommender system using item based collaborative filtering technique. In International Conference on Emerging Trends in Engineering, Technology, and Science (ICETETS). IEEE.
Halder, S., Sarkar, A. M. J., & Lee, Y.-K. (2012). Movie recommendation system based on movie swarm. In 2012 Second International Conference on Cloud and Green Computing (CGC). IEEE.
Dev, A. V., & Mohan, A. (2016). Recommendation system for big data applications based on set similarity of user preferences. In International Conference on Next Generation Intelligent Systems (ICNGIS). IEEE.
Chen, Y.-C., et al. (2016). User behavior analysis and commodity recommendation for point-earning apps. In 2016 Conference on Technologies and Applications of Artificial Intelligence (TAAI). IEEE.
Zhou, Y. H., Wilkinson, D., & Schreiber, R. (2008). Large scale parallel collaborative filtering for the Netflix prize. In Proceedings of 4th International Conference on Algorithmic Aspects in Information and Management (pp. 337–348). Shanghai: Springer.
https://spark.apache.org/docs/latest/. Accessed March 10, 2017.
https://grouplens.org/datasets/movielens/. Accessed May 15, 2017.
Delgado, J. A. (2000, February). Agent-based information filtering and recommender systems on the internet (Ph.D. thesis). Nagoya Institute of Technology.
Mooney, R. J., & Roy, L. (1999). Content-based book recommendation using learning for text categorization. In Proceedings of the Workshop on Recommender Systems: Algorithms and Evaluation (SIGIR ‘99). Berkeley, CA, USA.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Aljunid, M.F., Manjaiah, D.H. (2019). Movie Recommender System Based on Collaborative Filtering Using Apache Spark. In: Balas, V., Sharma, N., Chakrabarti, A. (eds) Data Management, Analytics and Innovation. Advances in Intelligent Systems and Computing, vol 839. Springer, Singapore. https://doi.org/10.1007/978-981-13-1274-8_22
Download citation
DOI: https://doi.org/10.1007/978-981-13-1274-8_22
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1273-1
Online ISBN: 978-981-13-1274-8
eBook Packages: EngineeringEngineering (R0)