Skip to main content

Estimation Based Load Balancing Algorithm for Data-Intensive Heterogeneous Grid Environments

  • Conference paper
High Performance Computing - HiPC 2006 (HiPC 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4297))

Included in the following conference series:

Abstract

Grid computing holds the great promise to effectively share geographically distributed heterogeneous resources to solve large-scale complex scientific problems. One of the distinct characteristics of the Grid system is resource heterogeneity. The effective use of the Grid requires an approach to manage the heterogeneity of the involved resources that can include computers, data, network, etc. In this paper, we proposed a de-centralized and adaptive load balancing algorithm for heterogeneous Grid environment. Our algorithm estimates different system parameters (such as job arrival rate, CPU processing rate, load at processor) and effectively performs load balancing by considering all necessary affecting criteria. Simulation results demonstrate that our algorithm outperforms conventional approaches in the event of heterogeneous environment and when communication overhead is significant.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Murata, Y., Takizawa, H., Inaba, T., Kobayashi, H.: A distributed and cooperative load balancing mechanism for large-scale P2P systems. In: International Symposium on Applications and Internet Workshops (SAINT 2006), January 2006, pp. 126–129 (2006)

    Google Scholar 

  2. Shan, H., Oliker, L., Biswas, R., Smith, W.: Scheduling in heterogeneous grid environments: The effects of data migration. In: Proceedings of ADCOM 2004: International Conference on Advanced Computing and Communication, Ahmedabad, Gujarat, India (December 2004)

    Google Scholar 

  3. Shan, H., Oliker, L., Biswas, R.: Job superscheduler architecture and performance in computational grid environments. In: ACM/IEEE Conference on Supercomputing (November 2003)

    Google Scholar 

  4. Subramani, V., Kettimuthu, R., Srinivasan, S., Sadayappan, P.: Distributed job scheduling on computational grid using multiple simultaneous requests. In: Proceedings of 11th IEEE Symposium on High Performance Distributed Computing (HPDC 2002) (July 2002)

    Google Scholar 

  5. Arora, M., Das, S.K., Biswas, R.: A De-centralized scheduling and load balancing algorithm for heterogeneous grid environments. In: Proceedings of the International Conference on Parallel Processing Workshops (ICPPW 2002), pp. 499–505 (2002)

    Google Scholar 

  6. Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications 15(3), 200–222 (2001)

    Article  Google Scholar 

  7. Anand, L., Ghose, D., Mani, V.: ELISA: An Estimated Load Information Scheduling Algorithm for distributed computing systems. International Journal on Computers and Mathematics with Applications 37(8), 57–85 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  8. Foster, I., Kesselman, C.: The Grid: Blueprint for a future computing infrastructure. Morgan Kaufmann Publishers, USA (1999)

    Google Scholar 

  9. Martin, R., Vahdat, A., Culler, D., Anderson, T.: Effects of communication latency, overhead and bandwidth in a cluster architecture. In: Proceedings 24th Annual International Symposium on Computer Architecture, June 1997, pp. 85–97 (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shah, R., Veeravalli, B., Misra, M. (2006). Estimation Based Load Balancing Algorithm for Data-Intensive Heterogeneous Grid Environments. In: Robert, Y., Parashar, M., Badrinath, R., Prasanna, V.K. (eds) High Performance Computing - HiPC 2006. HiPC 2006. Lecture Notes in Computer Science, vol 4297. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11945918_13

Download citation

  • DOI: https://doi.org/10.1007/11945918_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68039-0

  • Online ISBN: 978-3-540-68040-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics