# Random Walk Algorithms: Definitions, Weaknesses, and Learning Automata-Based Approach

## Abstract

Random walk algorithms are used to problem-solving, modeling, and simulation in many types of networks including computer networks, social networks, and biological networks. In real-world problems, the non-intelligent models of random walk may not be used as a problem-solving method. Recently, intelligent models of random walk have been reported in the literature. These models try to extend the basic versions of random walk to design a novel problem-solving method. The learning mechanism of these models is based on learning automata. In these models, the design of feedback systems given by the theory of learning automata is used to design intelligent models of random walk. In this chapter, we discuss about the weaknesses of non-intelligent models of random walk as a problem-solving method in real-world applications. We also give the required information about random walk algorithms and the theory of learning automata.

## Keywords

Random walk algorithm Networks Feedback systems Learning automata## References

- 1.Bar-Yossef Z, Berg A, Chien S, Fakcharoenphol J, Weitz D (2000) Approximating aggregate queries about web pages via random walks. In: Proceedings of the 26th international conference on very large data bases. ACM, Egypt, pp 535–544Google Scholar
- 2.Tong H, Faloutsos C, Pan J-Y (2006) Fast random walk with restart and its applications. Sixth International conference on data mining. IEEE, China, pp 613–622CrossRefGoogle Scholar
- 3.da Fontoura Costa L, Travieso G (2007) Exploring complex networks through random walks. Phys Rev E 75:16102CrossRefGoogle Scholar
- 4.Ma T, Xia Z, Yang F (2017) An ant colony random walk algorithm for overlapping community detection. International Conference on Intelligent Data Engineering and Automated Learning. Springer, China, pp 20–26Google Scholar
- 5.Backstrom L, Leskovec J (2011) Supervised random walks: predicting and recommending links in social networks. In: Proceedings of the fourth ACM international conference on Web search and data mining. ACM, pp 635–644Google Scholar
- 6.Ghorbani M, Meybodi MR, Saghiri AM (2013) A novel self-adaptive search algorithm for unstructured peer-to-peer networks utilizing learning automata. 3rd Joint conference of AI & Robotics and 5th RoboCup Iran open international symposium. IEEE, Qazvin, Iran, pp 1–6Google Scholar
- 7.Ghorbani M, Meybodi MR, Saghiri AM (2013) A new version of k-random walks algorithm in peer-to-peer networks utilizing learning automata. 5th Conference on information and knowledge technology. IEEE Computer Society, Shiraz, Iran, pp 1–6Google Scholar
- 8.Kwok YK (2011) Peer-to-Peer computing: applications, architecture, protocols, and challenges. CRC Press, United StatesCrossRefGoogle Scholar
- 9.Ghorbani M, Saghiri AM, Meybodi MR (2013) A Novel Learning based Search Algorithm for Unstructured Peer to Peer Networks. Tech J Eng Appl Sci 3:145–149Google Scholar
- 10.Gkantsidis C, Mihail M, Saberi A (2006) Random walks in peer-to-peer networks: algorithms and evaluation. Perform Eval 63:241–263CrossRefGoogle Scholar
- 11.de Guzzi Bagnato G, Ronqui JRF, Travieso G (2018) Community detection in networks using self-avoiding random walks. Physica A: Stat Mach Appl 505:1046–1055CrossRefGoogle Scholar
- 12.Xin Y, Xie Z-Q, Yang J (2016) The adaptive dynamic community detection algorithm based on the non-homogeneous random walking. Physica A: Stat Mach Appl 450:241–252CrossRefGoogle Scholar
- 13.Barabási A-L, Ravasz E, Vicsek T (2001) Deterministic scale-free networks. Physica A: Stat Mach Appl 299:559–564CrossRefGoogle Scholar
- 14.Rosvall M, Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci 105:1118–1123CrossRefGoogle Scholar
- 15.Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28:1768–1783CrossRefGoogle Scholar
- 16.Malkiel BG, McCue K (1985) A random walk down Wall Street. Norton New YorkGoogle Scholar
- 17.Van Horne JC, Parker GG (1967) The random-walk theory: an empirical test. Financ Anal J 87–92Google Scholar
- 18.Kallenberg O (2017) Random measures, theory and applications. SpringerGoogle Scholar
- 19.Narendra KS, Thathachar MA (1989) Learning automata: an introduction. Prentice-HallGoogle Scholar
- 20.Khomami MMD, Haeri MA, Meybodi MR, Saghiri AM (2017) An algorithm for weighted positive influence dominating set based on learning automata. In: 4th International conference on Knowledge-Based Engineering and Innovation (KBEI), IEEE, pp 734–740Google Scholar
- 21.Khomami MMD, Rezvanian A, Meybodi MR (2018) A new cellular learning automata-based algorithm for community detection in complex social networks. J Comput Sci 24:413–426CrossRefGoogle Scholar
- 22.Ghamgosar M, Khomami MMD, Bagherpour N, Reza M (2017) An extended distributed learning automata based algorithm for solving the community detection problem in social networks. In: Iranian Conference on Electrical Engineering (ICEE), IEEE, pp 1520–1526Google Scholar
- 23.Saghiri AM, Meybodi MR (2016) A self-adaptive algorithm for topology matching in unstructured peer-to-peer networks. J Netw Syst Manage 24:393–426CrossRefGoogle Scholar
- 24.Saghiri AM, Meybodi MR (2017) A distributed adaptive landmark clustering algorithm based on mOverlay and learning automata for topology mismatch problem in unstructured peer-to-peer networks. Int J Commun Syst 30:e2977CrossRefGoogle Scholar
- 25.Saghiri AM, Meybodi MR (2018) Open asynchronous dynamic cellular learning automata and its application to allocation hub location problem. Knowl-Based Syst 139:149–169CrossRefGoogle Scholar