Adaptive Resource Discovery in Grid Computing Based on Reinforcement Learning

  • Mohammad Ali Jabraeil Jamali
  • Yalda Sani
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 99)


Grid is a distributed computing environment. There are lots of resources in grid environment that are heterogeneous and geographically distributed. By receiving a resource request the resource discovery mechanism should return an appropriate resource if there exist one. Resource discovery is a challenging problem because of the heterogeneity and distribution of resources. In this paper, we propose and evaluate an adaptive resource discovery algorithm using reinforcement learning for grid computing that can be used for multi resource requests. The algorithm achieves the most suitable node that can satisfy the requested resource by using the past experience of agents. We compare our model with random walk resource discovery through simulation and the results show that the proposed algorithm provides higher success rate, less message passing and shorter response time. Also the algorithm leads to load balancing in whole grid.


Grid Resource Discovery Multi Resource Requests Reinforcement Learning Adaptive 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ma, S., Sun, X., Guo, Z.: A Resource Discovery Mechanism Integrating P2P and Grid. IEEE, New York(2010), doi: 978-1-4244-5540-9/10Google Scholar
  2. 2.
    Chang, R.-S., Hu, M.-S.: A resource discovery tree using bitmap for grids. Future Generation Computer Systems 26, 29–37 (2010)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Shen, H., Li, Z.: SPPS: a scalable p2p-based proximity-aware multi-resource discovery scheme for grids. IEEE, New York (2008), doi: 978-1-4244-2677-5/08 Google Scholar
  4. 4.
    Messina, F., Pappalardo, G., Santoro, C.: HYGRA: A Decentralized Protocol for Resource Discovery and Job Allocation in Large Computational Grids. IEEE, New York(2010), doi: 978-1-4244-7755-5/10 Google Scholar
  5. 5.
    Filali, I., Huet, F., Vergoni, C.: A Simple Cache Based Mechanism For Peer To Peer Resource Discovery In Grid Environments. In: Eighth IEEE International Symposium on Cluster Computing and the Grid (2008), doi: 10.1109/CCGRID.2008.110 Google Scholar
  6. 6.
    Deng, Y., Wang, F., Ciura, A.: Ant colony optimization inspired resource discovery in P2P Grid systems. In: LLC 2008. Springer Science+Business Media (2008), doi: 10.1007/s11227-008-0214-0 Google Scholar
  7. 7.
    Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. A Bradford Book. MIT Press, Cambridge (1998)Google Scholar
  8. 8.
    Tangpongprasit, S., Katagiri, T., Kise, K., Honda, H., Yuba, T.: A time-to-live based reservation algorithm on fully decentralized resource discovery in grid computing. Parallel Computing 31(6), 529–543 (2005)CrossRefGoogle Scholar
  9. 9.
    Cui, J., He, Y., Wu, L., Li, F.: A resource discovery algorithm with probe feedback mechanism based on advance reservation. In: Proceedings of the Fifth International Conference on Grid and Cooperative Computing, GCC 2006, October 2006, pp. 281–286 (2006)Google Scholar
  10. 10.
    Jeanvoine, E., Morin, C.: RW-OGS: an Optimized RandomWalk Protocol for Resource Discovery in Large Scale Dynamic Grids. In: 9th Grid Computing Conference. IEEE, New York (2008), doi: 978-1-4244-2579-2/08Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Mohammad Ali Jabraeil Jamali
    • 1
  • Yalda Sani
    • 1
  1. 1.Shabestar BranchIslamic Azad UniversityShabestarIran

Personalised recommendations