Advertisement

Distributed Core Decomposition in Probabilistic Graphs

  • Qi Luo
  • Dongxiao YuEmail author
  • Feng LiEmail author
  • Zhenhao Dou
  • Zhipeng Cai
  • Jiguo YuEmail author
  • Xiuzhen Cheng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11917)

Abstract

This paper initializes distributed algorithm studies for core decomposition in probabilistic graphs. Core decomposition has been proven to be a useful primitive for a wide range of graph analyses, but it has been rarely studied in probabilistic graphs, especially in a distributed environment. In this work, under a distributed model underlying Pregel and live distributed systems, we present the first known distributed solutions for core decomposition in probabilistic graphs, where there is an existence probability for each edge. In the scenario that the existence probability of edges are known to nodes, the proposed algorithm can get the exact coreness of nodes with a high probability guarantee. In the harsher case that the existence probability is unknown, we present a novel method to estimate the existence probability of edges, based on which the coreness of nodes with small approximation ratio guarantee can be computed. Extensive experiments are conducted on different types of real-world graphs and synthetic graphs. The results illustrate that the proposed algorithms exhibit good efficiency, stability and scalability.

Keywords

Uncertain graph Core decomposition Distributed algorithm 

Notes

Acknowledgement

This work is partially supported by NSFC (No. 61971269, 61832012, 61672321, 61771289, 61702304) and Shandong Provincial Natural Science Foundation (No. ZR2017QF005).

References

  1. 1.
    Albert, R., Barabási, A.: Statistical mechanics of complex networks. CoRR cond-mat/0106096 (2001)Google Scholar
  2. 2.
    Altaf-Ul-Amin, M., Koma, T., Kurokawa, K., Kanaya, S.: Prediction of protein functions based on protein-protein interaction networks: a min-cut approach. In: Proceedings of the 21st International Conference on Data Engineering Workshops, ICDE, p. 1156 (2005)Google Scholar
  3. 3.
    Alvarez-Hamelin, J.I., Dall’Asta, L., Barrat, A., Vespignani, A.: Large scale networks fingerprinting and visualization using the K-core decomposition. In: Neural Information Processing Systems, NIPS, pp. 41–50 (2005)Google Scholar
  4. 4.
    Alvarez-Hamelin, J.I., Dall’Asta, L., Barrat, A., Vespignani, A.: K-core decomposition of internet graphs: hierarchies, self-similarity and measurement biases. NHM 3(2), 371–393 (2008)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Aridhi, S., Brugnara, M., Montresor, A., Velegrakis, Y.: Distributed K-core decomposition and maintenance in large dynamic graphs. In: Proceedings of the 10th ACM International Conference on Distributed and Event-based Systems, DEBS, pp. 161–168 (2016)Google Scholar
  6. 6.
    Bader, G.D., Hogue, C.W.V.: An automated method for finding molecular complexes in large protein interaction networks. BMC Bioinform. 4, 2 (2003)CrossRefGoogle Scholar
  7. 7.
    Batagelj, V., Mrvar, A., Zaversnik, M.: Partitioning approach to visualization of large graphs. In: Proceedings of the 7th International Symposium Graph Drawing, GD 1999, Stirín Castle, Czech Republic, pp. 90–97, September 1999CrossRefGoogle Scholar
  8. 8.
    Batagelj, V., Zaversnik, M.: An o(m) algorithm for cores decomposition of networks. CoRR cs.DS/0310049 (2003)Google Scholar
  9. 9.
    Bonchi, F., Gullo, F., Kaltenbrunner, A., Volkovich, Y.: Core decomposition of uncertain graphs. In: The 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014, pp. 1316–1325 (2014)Google Scholar
  10. 10.
    Carmi, S., Havlin, S., Kirkpatrick, S.: From the cover: a model of internet topology using K-shell decomposition. Proc. Nat. Acad. Sci. 104(27), 11150–11154 (2007)CrossRefGoogle Scholar
  11. 11.
    Ceccarello, M., Fantozzi, C., Pietracaprina, A., Pucci, G., Vandin, F.: Clustering uncertain graphs. PVLDB 11(4), 472–484 (2017)Google Scholar
  12. 12.
    Chakrabarti, D., Zhan, Y., Faloutsos, C.: R-mat: a recursive model for graph mining. In: Proceedings of the Fourth SIAM International Conference on Data Mining, pp. 442–446 (2004)Google Scholar
  13. 13.
    Cheng, J., Ke, Y., Chu, S., Özsu, M.T.: Efficient core decomposition in massive networks. In: Proceedings of the 27th International Conference on Data Engineering, ICDE, pp. 51–62 (2011)Google Scholar
  14. 14.
    Collins, S.R., Kemmeren, P., Zhao, X.C., Greenblatt, J.F., Spencer, F., Holstege, F.C., Weissman, J.S., Krogan, N.J.: Toward a comprehensive atlas of the physical interactome of saccharomyces cerevisiae. Mol. Cell. Proteomics Mcp 6(3), 439 (2007)CrossRefGoogle Scholar
  15. 15.
    Dasari, N.S., Ranjan, D., Zubair, M.: Park: an efficient algorithm for K-core decomposition on multicore processors. In: IEEE International Conference on Big Data, ICBD, pp. 9–16 (2014)Google Scholar
  16. 16.
    Faloutsos, M., Faloutsos, P., Faloutsos, C.: On power-law relationships of the internet topology. In: Proceedings of the ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM, pp. 251–262 (1999)Google Scholar
  17. 17.
    Gavin, A.C., et al.: Proteome survey reveals modularity of the yeast cell machinery. Nature 440(7084), 631–636 (2006)CrossRefGoogle Scholar
  18. 18.
    Hahn, G.J., Doganaksoy, N.: A career in statistics. Wiley Online Library (2011) Google Scholar
  19. 19.
    Huang, X., Cheng, H., Li, R., Qin, L., Yu, J.X.: Top-K structural diversity search in large networks. PVLDB 6(13), 1618–1629 (2013)Google Scholar
  20. 20.
    Huang, X., Lu, W., Lakshmanan, L.V.S.: Truss decomposition of probabilistic graphs: semantics and algorithms. In: Proceedings of the International Conference on Management of Data, SIGMOD, pp. 77–90 (2016)Google Scholar
  21. 21.
    Li, C., Tang, Y., Lin, H., Chengzhe, Y., Mai, H.: Parallel overlapping community detection algorithm in complex networks based on label propagation. Scientia Sinica 46(2), 212 (2016)Google Scholar
  22. 22.
    Krogen, N.J.: Global landscape of protein complexes in the yeast saccharomyces cerevisiae. Nature 440(7084), 637–643 (2006)CrossRefGoogle Scholar
  23. 23.
    Jin, R., Liu, L., Aggarwal, C.C.: Discovering highly reliable subgraphs in uncertain graphs. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 992–1000 (2011)Google Scholar
  24. 24.
    Khaouid, W., Barsky, M., Venkatesh, S., Thomo, A.: K-core decomposition of large networks on a single PC. PVLDB 9(1), 13–23 (2015)Google Scholar
  25. 25.
    Krepska, E., Kielmann, T., Fokkink, W., Bal, H.E.: A high-level framework for distributed processing of large-scale graphs. In: Proceedings of The 12th International Conference Distributed Computing and Networking, ICDCN, pp. 155–166 (2011)CrossRefGoogle Scholar
  26. 26.
    Kitsak, M., et al.: Identification of influential spreaders in complex networks. Nature Phys. 6(11), 888–893 (2010)CrossRefGoogle Scholar
  27. 27.
    Malewicz, G., et al.: Pregel: a system for large-scale graph processing. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD, pp. 135–146 (2010)Google Scholar
  28. 28.
    Mandal, A., Hasan, M.A.: A distributed K-core decomposition algorithm on spark. In: IEEE International Conference on Big Data, ICBD, pp. 976–981 (2017)Google Scholar
  29. 29.
    Meyer, P., Siy, H.P., Bhowmick, S.: Identifying important classes of large software systems through K-core decomposition. Adv. Complex Syst. 17(7–8), 1550004 (2014)MathSciNetCrossRefGoogle Scholar
  30. 30.
    Montresor, A., Pellegrini, F.D., Miorandi, D.: Distributed K-core decomposition. In: Proceedings of the 30th Annual ACM Symposium on Principles of Distributed Computing, PODC, pp. 207–208 (2011)Google Scholar
  31. 31.
    Peng, Y., Zhang, Y., Zhang, W., Lin, X., Qin, L.: Efficient probabilistic K-core computation on uncertain graphs. In: 34th IEEE International Conference on Data Engineering, ICDE, pp. 1192–1203 (2018)Google Scholar
  32. 32.
    Potamias, M., Bonchi, F., Gionis, A., Kollios, G.: K-nearest neighbors in uncertain graphs. PVLDB 3(1), 997–1008 (2010)Google Scholar
  33. 33.
    Robert, A.H., Mark, R.: Introduction to social network methods. Department of Sociology, University of California Riverside (2005)Google Scholar
  34. 34.
    Sariyüce, A.E., Seshadhri, C., Pinar, A., Çatalyürek, Ü.V.: Finding the hierarchy of dense subgraphs using nucleus decompositions. In: Proceedings of the 24th International Conference on World Wide Web, WWW, pp. 927–937 (2015)Google Scholar
  35. 35.
    Zhang, H., Zhao, H., Cai, W., Liu, J., Zhou, W.: Using the k-core decomposition to analyze the static structure of large-scale software systems. J. Supercomput. 53(2), 352–369 (2010)CrossRefGoogle Scholar
  36. 36.
    Zhao, X., Liu, F., Xing, S., Wang, Q.: Identifying influential spreaders in social networks via normalized local structure attributes. IEEE Access 6, 66095–66104 (2018)CrossRefGoogle Scholar
  37. 37.
    Zhu, R., Zou, Z., Li, J.: Diversified coherent core search on multi-layer graphs. In: 34th IEEE International Conference on Data Engineering, ICDE, pp. 701–712 (2018)Google Scholar
  38. 38.

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.School of Computer Science and TechnologyShandong UniversityQingdaoPeople’s Republic of China
  2. 2.Department of Computing ScienceGeorgia State UniversityAtlantaUSA
  3. 3.School of Computer Science and TechnologyQilu University of TechnologyJinanPeople’s Republic of China

Personalised recommendations