T-MPP: A Novel Topic-Driven Meta-path-Based Approach for Co-authorship Prediction in Large-Scale Content-Based Heterogeneous Bibliographic Network in Distributed Computing Framework by Spark

  • Phuc DoEmail author
  • Phu Pham
  • Trung Phan
  • Thuc Nguyen
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 866)


Recently, heterogeneous network mining has gained tremendous attention from researcher due to its wide applications. Link prediction is one of the most important task in information network mining. From the past, most of the networked data mining approaches are mainly applied for homogenous network which is considered as single-typed objects and links. Moreover, there are remained challenges related to thoroughly evaluating the content of linked objects which are considered as important in predicting the potential relationships between objects. Like a common problem of predicting co-authorship in bibliographic network such as: DBLP, DBIS, etc. There is no doubt that an author who is interesting in “data mining” field tend to cooperate with the other authors who contribute on this field only. Hence, predicting co-authorships between authors work on “data mining” with others who work on “hardware” is dull as well. Moreover, in the context of large-scaled network, traditional standalone computing mechanism also is not affordable due to low-performance in time-consuming. To overcome these challenges, n this paper, we propose an approach of topic-driven meta-path-based prediction in heterogeneous network, called T-MPP which is implemented on distributed computing environment of Spark. The T-MPP not only enables to discover potential relationships in given bibliographic network but also supports to capture the topic similarity between authors. We present experiments on a real-world DBLP network. The outputs show that our proposed T-MPP model can generate more accurate prediction results as compared to previous approaches.


Information network HIN Link prediction Meta-path-based link prediction Topic-driven link prediction Large-scaled HIN Distributed graph-based computing Spark 



This research is funded by Vietnam National University Ho Chi Minh City (VNU-HCMC) under the grant number B2017-26-02.


  1. 1.
    Sun, Y., Han, J.: Mining heterogeneous information networks: principles and methodologies. Synth. Lectures Data Min. Knowl. Discov. 3(2), 1–159 (2012)CrossRefGoogle Scholar
  2. 2.
    Sun, Y.; Han, J.: Mining heterogeneous information networks: a structural analysis approach. ACM SIGKDD Explor. Newsl. 14(2), 20–28 (2013)CrossRefGoogle Scholar
  3. 3.
    Shi, C., et al.: A survey of heterogeneous information network analysis. IEEE Trans. Knowl. Data Eng. 29(1), 17–37 (2017)CrossRefGoogle Scholar
  4. 4.
    Liben-Nowell, D., Kleinberg, J.: The link-prediction problem for social networks. J. Assoc. Inf. Sci. Technol. 58(7), 1019–1031 (2007)CrossRefGoogle Scholar
  5. 5.
    Wang, P., et al.: Link prediction in social networks: the state-of-the-art. Sci. China Inf. Sci. 58(1), 1–38 (2015)Google Scholar
  6. 6.
    Sun, Y., et al.: Co-author relationship prediction in heterogeneous bibliographic networks. In: 2011 International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 121–128. IEEE (2011)Google Scholar
  7. 7.
    Yu, X., et al.: Citation prediction in heterogeneous bibliographic networks. In: Proceedings of the 2012 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics, pp. 1119–1130 (2012)CrossRefGoogle Scholar
  8. 8.
    Adamic, L.A.. Adar, E.: Friends and neighbors on the web. Soc. Netw. 25(3), 211–230 (2001)CrossRefGoogle Scholar
  9. 9.
    Kuo, T.-T., et al.: Unsupervised link prediction using aggregative statistics on heterogeneous social networks. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 775–783. ACM (2013)Google Scholar
  10. 10.
    Al Hasan, M., et al.: Link prediction using supervised learning. In: SDM 2006: Workshop on Link Analysis, Counter-Terrorism and Security (2007)Google Scholar
  11. 11.
    Benchettara, N., Kanawati, R., Rouveirol, C.: Supervised machine learning applied to link prediction in bipartite social networks. In: 2010 International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 326–330. IEEE (2010)Google Scholar
  12. 12.
    Lu, Z., et al.: Supervised link prediction using multiple sources. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), pp. 923–928. IEEE (2010)Google Scholar
  13. 13.
    Cao, B., Kong, X., Philip, S.Y.: Collective prediction of multiple types of links in heterogeneous information networks. In: 2014 IEEE International Conference on Data Mining (ICDM), pp. 50–59. IEEE (2014)Google Scholar
  14. 14.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 993–1022 (2003)Google Scholar
  15. 15.
    Zaharia, M., et al.: Apache spark: a unified engine for big data processing. Commun. ACM 59(11), 56–65 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of Information Technology (UIT), VNU-HCMHo Chi Minh CityVietnam

Personalised recommendations