Dimension Reduction Based on Effects of Experienced Users in Recommender Systems
The paradox of huge volume with high sparsity of rating data in collaborative filtering (CF) system motivates the present paper to utilize information underlying sparsity to reduce the dimensionality of data. This difference in user experiences resembles factor underlying widely used term frequency weighting scheme in information retrieval. Hypothesis of Rational Authorities Bias (H-RAB) is proposed, supposing that higher prediction accuracy can be attained to emphasize referential users with higher experiences. Dimension reduction suggests pruning all referential users with less experience than a given maturity threshold. Empirical results from a series of experiments on three major public available CF datasets justify the soundness of both modifications and validity of H-RAB. A few open issues are also proposed for future efforts.
KeywordsCollaborative filtering recommender Sparsity Rater maturity Rational Authorities Bias Dimension reduction
This work is partly funded by UESTC Fundamental Research Funds for Central Universities (ZYGX2015J069), Grant: JSEB-201303 of e-Commerce Key Laboratory of Jiangsu Province, and Grant 2017GZYZF0014 of Sichuan Sci-Tech Plan.
- 2.Breese JS, Heckerman D, Kadie C. Empirical analysis of predictive algorithms for collaborative filtering. In: Proceedings of the 14th conference on uncertainty in artificial intelligence; 1998. p. 43–52.Google Scholar
- 3.McLaughlin MR, Herlocker JL. A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In: Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (Sheffield, United Kingdom, July 25 – 29, 2004). SIGIR’04; New York: ACM Press; 2004. p.329–36.Google Scholar
- 7.Billsus D, Pazzani MJ. Learning collaborative information filters. In: Proceedings of the 15th international conference on machine learning; 1998. San Francisco, CA: Morgan Kaufmann. p. 46–54.Google Scholar
- 8.Herlocker Jl, Konstan JA, Borchers A, Riedl J. An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval; 1999; Berkeley, California, United States. p. 230–7.Google Scholar
- 10.Sarwar B, Karypis, G, Konstan J, Riedl J. Item-Based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international world wide web conference; 2001. p. 285–95.Google Scholar