International Workshop on Combinatorial Algorithms

IWOCA 2014: Combinatorial Algorithms pp 110-121 | Cite as

Computing Heat Kernel Pagerank and a Local Clustering Algorithm

  • Fan Chung
  • Olivia SimpsonEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8986)


Heat kernel pagerank is a variation of Personalized PageRank given in an exponential formulation. In this work, we present a sublinear time algorithm for approximating the heat kernel pagerank of a graph. The algorithm works by simulating random walks of bounded length and runs in time \(O\big (\frac{\log (\epsilon ^{-1})\log n}{\epsilon ^3\log \log (\epsilon ^{-1})}\big )\), assuming performing a random walk step and sampling from a distribution with bounded support take constant time.

The quantitative ranking of vertices obtained with heat kernel pagerank can be used for local clustering algorithms. We present an efficient local clustering algorithm that finds cuts by performing a sweep over a heat kernel pagerank vector, using the heat kernel pagerank approximation algorithm as a subroutine. Specifically, we show that for a subset S of Cheeger ratio \(\phi \), many vertices in S may serve as seeds for a heat kernel pagerank vector which will find a cut of conductance \(O(\sqrt{\phi })\).


Heat kernel pagerank Heat kernel Local algorithms 


  1. 1.
    Andersen, R., Chung, F.: Detecting sharp drops in pagerank and a simplified local partitioning algorithm. In: Cai, J.-Y., Cooper, S.B., Zhu, H. (eds.) TAMC 2007. LNCS, vol. 4484, pp. 1–12. Springer, Heidelberg (2007) CrossRefGoogle Scholar
  2. 2.
    Andersen, R., Chung, F., Lang, K.: Local graph partitioning using pagerank vectors. In: IEEE 47th Annual Symposium on Foundations of Computer Science, pp. 475–486. IEEE (2006)Google Scholar
  3. 3.
    Andersen, R., Peres, Y.: Finding sparse cuts locally using evolving sets. In: Proceedings of the 41st Annual Symposium on Theory of Computing, pp. 235–244. ACM (2009)Google Scholar
  4. 4.
    Borgs, C., Brautbar, M., Chayes, J., Teng, S.-H.: A sublinear time algorithm for pagerank computations. In: Bonato, A., Janssen, J. (eds.) WAW 2012. LNCS, vol. 7323, pp. 41–53. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  5. 5.
    Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30(1), 107–117 (1998)CrossRefGoogle Scholar
  6. 6.
    Chung, F.: The heat kernel as the pagerank of a graph. Proc. Natl. Acad. Sci. 104(50), 19735–19740 (2007)CrossRefGoogle Scholar
  7. 7.
    Chung, F.: A local graph partitioning algorithm using heat kernel pagerank. Internet Math. 6(3), 315–330 (2009)zbMATHMathSciNetCrossRefGoogle Scholar
  8. 8.
    Chung, F., Simpson, O.: Solving linear systems with boundary conditions using heat kernel pagerank. In: Bonato, A., Mitzenmacher, M., Prałat, P. (eds.) WAW 2013. LNCS, vol. 8305, pp. 203–219. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  9. 9.
    Gharan, S.O., Trevisan, L.: Approximating the expansion profile and almost optimal local graph clustering. In: IEEE 53rd Annual Symposium on Foundations of Computer Science, pp. 187–196. IEEE (2012)Google Scholar
  10. 10.
    Kannan, R., Vempala, S., Vetta, A.: On clusterings: good, bad and spectral. J. ACM (JACM) 51(3), 497–515 (2004)zbMATHMathSciNetCrossRefGoogle Scholar
  11. 11.
    Kloster, K., Gleich, D.F.: A nearly-sublinear method for approximating a column of the matrix exponential for matrices from large, sparse networks. In: Bonato, A., Mitzenmacher, M., Prałat, P. (eds.) WAW 2013. LNCS, vol. 8305, pp. 68–79. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  12. 12.
    Leskovec, J., Lang, K.J., Dasgupta, A., Mahoney, M.W.: Statistical properties of community structure in large social and information networks. In: Proceedings of the 17th International Conference on World Wide Web, pp. 695–704. ACM (2008)Google Scholar
  13. 13.
    Lin, F., Cohen, W.W.: Power iteration clustering. In: Proceedings of the 27th International Conference on Machine Learning (ICML 2010), pp. 655–662 (2010)Google Scholar
  14. 14.
    Lin, F., Cohen, W.W.: A very fast method for clustering big text datasets. In: Proceedings of the 19th European Conference on Artificial Intelligence, pp. 303–308 (2010)Google Scholar
  15. 15.
    Lovász, L., Simonovits, M.: The mixing rate of markov chains, an isoperimetric inequality, and computing the volume. In: Proceedings of the 31st Annual Symposium on Foundations of Computer Science, pp. 346–354. IEEE (1990)Google Scholar
  16. 16.
    Lovász, L., Simonovits, M.: Random walks in a convex body and an improved volume algorithm. Random Struct. Algorithms 4(4), 359–412 (1993)zbMATHCrossRefGoogle Scholar
  17. 17.
    Ng, A.Y., Jordan, M.I., Weiss, Y., et al.: On spectral clustering: analysis and an algorithm. Adv. Neural Inf. Proc. Syst. 2, 849–856 (2002)Google Scholar
  18. 18.
    Orecchia, L., Sachdeva, S., Vishnoi, N.K.: Approximating the exponential, the lanczos method and an \(\tilde{O}\)(m)-time spectral algorithm for balanced separator. In: Proceedings of the 44th Symposium on Theory of Computing, pp. 1141–1160. ACM (2012)Google Scholar
  19. 19.
    Sachdeva, S., Vishnoi, N.K.: Matrix inversion is as easy as exponentiation (2013). arXiv preprint arXiv:1305.0526
  20. 20.
    Spielman, D.A., Teng, S.H.: Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In: Proceedings of the thirty-sixth annual ACM symposium on Theory of Computing, pp. 81–90. ACM (2004)Google Scholar
  21. 21.
    Spielman, D.A., Teng, S.H.: A local clustering algorithm for massive graphs and its application to nearly-linear time graph partitioning. CoRR abs/0809.3232 (2008)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.University of California, San DiegoLa JollaUSA

Personalised recommendations