Recommending Research Article Based on User Queries Using Latent Dirichlet Allocation

  • P. SubathraEmail author
  • P. N. Kumar
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1118)


The researchers need to access a large number of articles so as to keep abreast with recent developments in their respective research areas. Finding a relevant article from a huge collection of information, therefore, becomes a huge challenge. Recommender systems play a vital role in assisting researchers to filter correlated information from large volume articles. In this work, we have used the topic modeling approach, latent Dirichlet allocation (LDA), for recommending research articles based on user queries. We have collected reference articles of a query given by the user from the Wikipedia site. The proposed algorithm comprises four steps: 1. LDA first iteration to find the top N words. 2. LDA second iteration elicits weighted topic distribution. 3. Pointwise mutual information (PMI) obtains the correlation between the top N words and the weighted topic distribution words. 4. Reference articles are collected for top correlated words, and the top-ranked articles are recommended to the user by applying collaborative filtering algorithm. The two-pass LDA helps to avoid the ambiguities. The proposed algorithm performance is evaluated using the parameters of precision and recall. As compared to the results obtained from the existing recommender systems, our work demonstrates that the LDA-based algorithm gives a powerful recommender framework.


LDA Ranking Recommendation algorithm 


  1. 1.
    Beel, J., Langer, S.: Research paper recommender systems: a literature survey. J. Mach. Learn. (2012)Google Scholar
  2. 2.
    Reisenbichler, M., Reutterer, T.: Topic modeling in marketing: recent advances and research opportunities. J. Bus. Econ. 89(3), 327–356 (2019)Google Scholar
  3. 3.
    Chang, T.-M., Hsiao, W.-F.: LDA-based personalized document recommendation (2013)Google Scholar
  4. 4.
    Sebastiani, F., Zanasi, A.: Text Mining and its Applications, pp. 109–129. WIT Press, Southampton, UK (2005)Google Scholar
  5. 5.
    Jipeng, Q., Zhenyu, Q., Yun, L., Yunhao, Y., Xindong, W.: Short Text Topic Modeling Techniques, Applications, and Performance: A Survey. 1904.07695 (2019)Google Scholar
  6. 6.
    Grun, B., Hornik, K.: An R package for fitting topic models. J. Stat. Softw. 40(13), 1–30 (2011)Google Scholar
  7. 7.
    Bindu, K.R., Parameswaran, L., Soumya, K.V.: Performance evaluation of topic modelling algorithms with an application of Q & A dataset. Int. J. Appl. Eng. Res. 10(73), 23–27, ISSN 0973-4562 (2015)Google Scholar
  8. 8.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–102 (2003)Google Scholar
  9. 9.
    Blei, D.M., Lafferty, J.D.: Topic modeling. J. Mach. Learn. Res. 3, 993–1022 (2014)Google Scholar
  10. 10.
    Menaka, S., Radha, N.: Text classification using keyword extraction technique. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(12) (2013)Google Scholar
  11. 11.
    Evangelopoulos, N., Zhang, X., Prybutok, V.: Latent semantic analysis: five methodological recommendations. Eur. J. Inf. Syst. 21, 70–86 (2012)CrossRefGoogle Scholar
  12. 12.
    Blei, D.M., et al.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)Google Scholar
  13. 13.
    Forman, G.: An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res. 3, 1289–1305 (2003)zbMATHGoogle Scholar
  14. 14.
    Yang, M., Wu, X.-B., Deng, Z.-H., Zhang, M., Yang, D.-Q.: Modification of feature selection methods using relative term frequency. In: Proceedings of ICMLC, pp. 1432–1436 (2002)Google Scholar
  15. 15.
    Shyamala, C.K., Hemaashri, S., Swetha, R.: An improved recommendation system for social networks. Int. J. Control Theor. Appl. 8, 1903–1910 (2015)Google Scholar
  16. 16.
    Shi, X.Y., Ye, H.W., Gong, S.J.: A personalized recommender integrating item based and user based collaborative filtering. IEEE (2008)Google Scholar
  17. 17.
    Guo, Y., Cheng, X., Dong, D., Luo, C., Wang, R.: An Improved Collaborative Filtering Algorithm Based on Trust in e-Commerce Recommendation System. IEEE (2010)Google Scholar
  18. 18.
    Jaysri, S., Priyadharshini, J., Subathra, P., Kumar, P.N.: Analysis and performance of collaborative filtering algorithm. J. Appl. Eng. Res. 10, 24529–24540 (2015)Google Scholar
  19. 19.
    Wang, Y., Shen, X., Wang, J.: Topic Retrieval and Articles Recommendation (2011)Google Scholar
  20. 20.
    Sriurai, W., Meesad, P., Haruechaiyasak, C.: Recommending Related Articles in Wikipedia via a Topic-Based Model (2009)Google Scholar
  21. 21.
    Wang, C., Blei, D.M.: Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM International Conference on Knowledge Discovery and Data Mining. ACM (2011)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringAmrita School of EngineeringCoimbatoreIndia

Personalised recommendations