Skip to main content
SpringerLink
Log in
Book cover

Handbook of Data Intensive Computing pp 157–168Cite as

A Survey of Load Balancing Techniques for Data Intensive Computing

  • Chapter
  • First Online:

Abstract

Data volumes have been increasing substantially over the past several years. Such data is often processed concurrently on a distributed collection of machines to ensure reasonable completion times. Load balancing is one of the most important issues in data intensive computing. Often, the choice of the load balancing strategy has implications not just for reduction of execution times, but also on energy usage, network overhead, and costs.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. J. Dean and S. Ghemawat. 2008. MapReduce: simplified data processing on large clusters. Commun. ACM 51, 1 (January 2008), 107–113.

    Google Scholar 

  2. http://hadoop.apache.org/

  3. M. Zaharia, A. Konwinski, A.D. Joseph, R.H. Katz, and I. Stoica. Improving MapReduce Performance in Heterogeneous Environments. In Proceedings of OSDI. 2008, 29–42.

    Google Scholar 

  4. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. “Dryad: distributed data-parallel programs from sequential building blocks,” presented at the Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, Lisbon, Portugal, 2007.

    Google Scholar 

  5. J.-H. Hwang, M. Balazinska, A. Rasin, U. Cetintemel, M. Stonebraker, and S. Zdonik. 2005. High-Availability Algorithms for Distributed Stream Processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE ’05). IEEE Computer Society, Washington, DC, USA, 779–790.

    Google Scholar 

  6. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. 2002. Models and issues in data stream systems. In Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems (PODS ’02). ACM, New York, NY, USA, 1–16.

    Google Scholar 

  7. D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zdonik. 2002. Monitoring streams: a new class of data management applications. In Proceedings of the 28th international conference on Very Large Data Bases (VLDB ’02). VLDB Endowment 215–226.

    Google Scholar 

  8. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, and S. Zdonik. Scalable distributed stream processing. In Proc. of the First Biennial Conference on Innovative Data Systems Research (CIDR’03), Jan. 2003.

    Google Scholar 

  9. S.B. Zdonik, M. Stonebraker, M. Cherniack, U. Çetintemel, M. Balazinska, and H. Balakrishnan. “The Aurora and Medusa Projects”, presented at IEEE Data Eng. Bull., 2003, pp.3–10.

    Google Scholar 

  10. M.S. Miller and K.E. Drexler. “Markets and Computation: Agoric Open Systems,” in The Ecology of Computation, B.A. Huberman, Ed.: North-Holland, 1988.

    Google Scholar 

  11. http://code.google.com/intl/en/appengine/docs/

  12. A. Bedra. “Getting Started with Google App Engine and Clojure,” Internet Computing, IEEE, vol.14, no.4, pp.85–88, July-Aug. 2010.

    Google Scholar 

  13. http://www.microsoft.com/windowsazure/

  14. S. Shivle, R. Castain, H.J. Siegel, A.A. Maciejewski, T. Banka, K. Chindam, S. Dussinger, P. Pichumani, P. Satyasekaran, W. Saylor, D. Sendek, J. Sousa, J. Sridharan, P. Sugavanam, and J. Velazco. “Static mapping of subtasks in a heterogeneous ad hoc grid environment,” in Proc. of 13th HCW Workshop, IEEE Computer Society, 2004.

    Google Scholar 

  15. G.T. Lakshmanan and R. Strom. Biologically-inspired distributed middleware management for stream processing systems. ACM Middleware conference, 2008.

    Google Scholar 

  16. http://www.ibm.com/developerworks/cloud/library/cl-mapreduce/index.html

  17. T. Sandholm and K. Lai. MapReduce optimization using regulated dynamic prioritization. In Proceedings of the 11th International Joint Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), pages 299–310, 2009.

    Google Scholar 

  18. S.Thulasidasan, S.P. Kasiviswanathan, S. Eidenbenz, P. Romero. “Explicit Spatial Scattering for Load Balancing in Conservatively Synchronized Parallel Discrete Event Simulations,” Principles of Advanced and Distributed Simulation (PADS), 2010 IEEE Workshop on, vol., no., pp.1–8, 17–19 May 2010.

    Google Scholar 

  19. Z. Sui, N. Harvey, and S. Pallickara. Orchestrating Distributed Event Simulations within the Granules Cloud Runtime, Technical Report CS-11 Colorado State University, June 2011.

    Google Scholar 

  20. E. Deelman. and B.K. Szymanski. “Dynamic load balancing in parallel discrete event simulation for spatially explicit problems,” Parallel and Distributed Simulation, 1998. PADS 98. Proceedings. Twelfth Workshop on, vol., no., pp.46–53, 26–29 May 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Colorado State University, Fort Collins, CO, USA

    Zhiquan Sui & Shrideep Pallickara

Authors
  1. Zhiquan Sui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shrideep Pallickara
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiquan Sui .

Editor information

Editors and Affiliations

  1. Dept. of Computer Science & Engineering, Florida Atlantic University, Boca Raton, 33431, Florida, USA

    Borko Furht

  2. LexisNexis, Boca Raton, 33487, Florida, USA

    Armando Escalante

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Sui, Z., Pallickara, S. (2011). A Survey of Load Balancing Techniques for Data Intensive Computing. In: Furht, B., Escalante, A. (eds) Handbook of Data Intensive Computing. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1415-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-1415-5_6

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-1414-8

  • Online ISBN: 978-1-4614-1415-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation