Random Walk Algorithms: Definitions, Weaknesses, and Learning Automata-Based Approach

  • Ali Mohammad SaghiriEmail author
  • M. Daliri Khomami
  • Mohammad Reza Meybodi
Part of the SpringerBriefs in Applied Sciences and Technology book series (BRIEFSAPPLSCIENCES)


Random walk algorithms are used to problem-solving, modeling, and simulation in many types of networks including computer networks, social networks, and biological networks. In real-world problems, the non-intelligent models of random walk may not be used as a problem-solving method. Recently, intelligent models of random walk have been reported in the literature. These models try to extend the basic versions of random walk to design a novel problem-solving method. The learning mechanism  of these models is based on learning automata. In these models, the design of feedback systems given by the theory of learning automata is used to design intelligent models of random walk. In this chapter, we discuss about the weaknesses of non-intelligent models of random walk as a problem-solving method in real-world applications. We also give the required information about random walk algorithms and the theory of learning automata.


Random walk algorithm Networks Feedback systems Learning automata 


  1. 1.
    Bar-Yossef Z, Berg A, Chien S, Fakcharoenphol J, Weitz D (2000) Approximating aggregate queries about web pages via random walks. In: Proceedings of the 26th international conference on very large data bases. ACM, Egypt, pp 535–544Google Scholar
  2. 2.
    Tong H, Faloutsos C, Pan J-Y (2006) Fast random walk with restart and its applications. Sixth International conference on data mining. IEEE, China, pp 613–622CrossRefGoogle Scholar
  3. 3.
    da Fontoura Costa L, Travieso G (2007) Exploring complex networks through random walks. Phys Rev E 75:16102CrossRefGoogle Scholar
  4. 4.
    Ma T, Xia Z, Yang F (2017) An ant colony random walk algorithm for overlapping community detection. International Conference on Intelligent Data Engineering and Automated Learning. Springer, China, pp 20–26Google Scholar
  5. 5.
    Backstrom L, Leskovec J (2011) Supervised random walks: predicting and recommending links in social networks. In: Proceedings of the fourth ACM international conference on Web search and data mining. ACM, pp 635–644Google Scholar
  6. 6.
    Ghorbani M, Meybodi MR, Saghiri AM (2013) A novel self-adaptive search algorithm for unstructured peer-to-peer networks utilizing learning automata. 3rd Joint conference of AI & Robotics and 5th RoboCup Iran open international symposium. IEEE, Qazvin, Iran, pp 1–6Google Scholar
  7. 7.
    Ghorbani M, Meybodi MR, Saghiri AM (2013) A new version of k-random walks algorithm in peer-to-peer networks utilizing learning automata. 5th Conference on information and knowledge technology. IEEE Computer Society, Shiraz, Iran, pp 1–6Google Scholar
  8. 8.
    Kwok YK (2011) Peer-to-Peer computing: applications, architecture, protocols, and challenges. CRC Press, United StatesCrossRefGoogle Scholar
  9. 9.
    Ghorbani M, Saghiri AM, Meybodi MR (2013) A Novel Learning based Search Algorithm for Unstructured Peer to Peer Networks. Tech J Eng Appl Sci 3:145–149Google Scholar
  10. 10.
    Gkantsidis C, Mihail M, Saberi A (2006) Random walks in peer-to-peer networks: algorithms and evaluation. Perform Eval 63:241–263CrossRefGoogle Scholar
  11. 11.
    de Guzzi Bagnato G, Ronqui JRF, Travieso G (2018) Community detection in networks using self-avoiding random walks. Physica A: Stat Mach Appl 505:1046–1055CrossRefGoogle Scholar
  12. 12.
    Xin Y, Xie Z-Q, Yang J (2016) The adaptive dynamic community detection algorithm based on the non-homogeneous random walking. Physica A: Stat Mach Appl 450:241–252CrossRefGoogle Scholar
  13. 13.
    Barabási A-L, Ravasz E, Vicsek T (2001) Deterministic scale-free networks. Physica A: Stat Mach Appl 299:559–564CrossRefGoogle Scholar
  14. 14.
    Rosvall M, Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci 105:1118–1123CrossRefGoogle Scholar
  15. 15.
    Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28:1768–1783CrossRefGoogle Scholar
  16. 16.
    Malkiel BG, McCue K (1985) A random walk down Wall Street. Norton New YorkGoogle Scholar
  17. 17.
    Van Horne JC, Parker GG (1967) The random-walk theory: an empirical test. Financ Anal J 87–92Google Scholar
  18. 18.
    Kallenberg O (2017) Random measures, theory and applications. SpringerGoogle Scholar
  19. 19.
    Narendra KS, Thathachar MA (1989) Learning automata: an introduction. Prentice-HallGoogle Scholar
  20. 20.
    Khomami MMD, Haeri MA, Meybodi MR, Saghiri AM (2017) An algorithm for weighted positive influence dominating set based on learning automata. In: 4th International conference on Knowledge-Based Engineering and Innovation (KBEI), IEEE, pp 734–740Google Scholar
  21. 21.
    Khomami MMD, Rezvanian A, Meybodi MR (2018) A new cellular learning automata-based algorithm for community detection in complex social networks. J Comput Sci 24:413–426CrossRefGoogle Scholar
  22. 22.
    Ghamgosar M, Khomami MMD, Bagherpour N, Reza M (2017) An extended distributed learning automata based algorithm for solving the community detection problem in social networks. In: Iranian Conference on Electrical Engineering (ICEE), IEEE, pp 1520–1526Google Scholar
  23. 23.
    Saghiri AM, Meybodi MR (2016) A self-adaptive algorithm for topology matching in unstructured peer-to-peer networks. J Netw Syst Manage 24:393–426CrossRefGoogle Scholar
  24. 24.
    Saghiri AM, Meybodi MR (2017) A distributed adaptive landmark clustering algorithm based on mOverlay and learning automata for topology mismatch problem in unstructured peer-to-peer networks. Int J Commun Syst 30:e2977CrossRefGoogle Scholar
  25. 25.
    Saghiri AM, Meybodi MR (2018) Open asynchronous dynamic cellular learning automata and its application to allocation hub location problem. Knowl-Based Syst 139:149–169CrossRefGoogle Scholar

Copyright information

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ali Mohammad Saghiri
    • 1
    Email author
  • M. Daliri Khomami
    • 1
  • Mohammad Reza Meybodi
    • 1
  1. 1.Amirkabir University of TechnologyTehranIran

Personalised recommendations