Skip to main content
SpringerLink
Log in
Book cover

Applications of Time Delay Systems pp 57–76Cite as

Modeling and Closed Loop Control for Resource-Constrained Load Balancing with Time Delays in Parallel Computations

  • Chapter

  • 1146 Accesses

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 352))

Summary

Load balancing for parallel computations is modeled as a deterministic dynamic nonlinear time-delay system. This model accounts for the trade-off between using processor time/network bandwidth and the advantage of distributing the load evenly between the nodes to reduce overall processing time. A distributed closed-loop controller is presented to balance load dynamically at each node by using not only the local estimate of the work load of other nodes, but also measurements of the amount of work load in transit. To handle the time varying delays arising in the closed-loop load balancing, a discrete event simulation based on OPNET Modeler is presented and compared with the experiments. Results indicate good agreement between the nonlinear time-delay model and the experiments on a parallel computer network. Moreover, both simulations and experiments show a dramatic increase in performance obtained using the proposed closed loop controller.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Rotithor H.G. (1994) Taxonomy of dynamic task scheduling schemes in distributed computing systems. IEE Proceedings of Computer Digital Technology 141(1):1–10

    Article  Google Scholar 

  2. Senar M.A., Corteś A., Ripoll A., Hluchý L., Astalos J. (2001) Dynamic load balancing. In Parallel Program Development for Cluster Computing, J. C. Cunha, P. Kacsuk, and S. C. Winter, eds., pp. 69–95, Nova Science Publishers, New York.

    Google Scholar 

  3. Xu C.Z., Lau F.C. (1992) Analysis of the generalized dimension exchange method for dynamic load balancing. Journal of Parallel and Distributed Computing 16(1):385–393

    Article  MATH  MathSciNet  Google Scholar 

  4. Corradi A., Leonardi L., Zambonelli F. (1999) Diffusive load-balancing policies for dynamic applications. IEEE Concurrency 7(1):22–31

    Article  Google Scholar 

  5. Lin H., Keller R. (1987) The gradient model load balancing method. IEEE Trans. Software Engineering 13(1):32–38

    Google Scholar 

  6. Willebeek-LeMair M.H., Reeves A.P. (1993) Strategies for dynamic load balancing on highly parallel computers. IEEE Transactions on Parallel and Distributed Systems 4(9):979–993

    Article  Google Scholar 

  7. Kameda H., El-Zoghdy Said Fathy I.R., Li J. (2000) A performance comparison of dynamic versus static load balancing policies in a mainframe. In Proceedings of the 39th IEEE Conference on Decision and Control, pp. 1415–1420, Sydney, Australia

    Google Scholar 

  8. Altman E. Kameda H. (2001) Equilibria for multiclass routing in multi-agent networks. In Proceedings of the 40th IEEE Conference on Decision and Control, pp. 604–609, Orlando, Florida

    Google Scholar 

  9. Kalé L.V. (1988) Comparing the performance of two dynamic load distribution methods. In Proc. International Conf. Parallel Processing, pp. 8–12

    Google Scholar 

  10. Cybenko G. (1989) Dynamic load balancing for distributed memory multiprocessors. Journal of Parallel and Distributed Computing 7(2):279–301

    Article  Google Scholar 

  11. Lin H., Raghavendra C.S. (1992) A dynamic load-balancing policy with a central job dispatcher (LBC). IEEE Trans. Software Engineering 18(2):148–158

    Article  Google Scholar 

  12. Ghosh B., Leighton F.T., Maggs B.M., Muthukrishnan S., Plaxton C.G., Rajaraman R., Richa A.W. (1999) Tight analysis of two local load balancing algorithms. SIAM Journal on Computing 29(1):29–764

    Article  MATH  MathSciNet  Google Scholar 

  13. Hellerstein J.L. (2004) Challenges in control engineering of computing systems. In Proceedings of the 2004 American Control Conference, pp. 1970–1979, Boston, Massachusetts

    Google Scholar 

  14. Diao Y., Hellerstein J.L., Storm A.J., Surendra M., Lightstone S., Pareky S., Garcia-Arellano C. (2004) Using mimo linear control for load balancing in computing systems. In Proceedings of the 2004 American Control Conference, pp. 2045–2050, Boston, Massachusetts

    Google Scholar 

  15. Robertsson A., Wittenmark B., Kihl M., Andersson M. (2004) Design and evaluation of load control in web server systems. In Proceedings of the 2004 American Control Conference, pp. 1980–1985, Boston, Massachusetts

    Google Scholar 

  16. Abdelzaher T., Lu Y., Zhang R., Henriksson D. (2004) Practical application of control theory to web services. In Proceedings of the 2004 American Control Conference, pp. 1992–1997 Boston, Massachusetts

    Google Scholar 

  17. Kleinrock L. (1975) Queuing Systems Vol I: Theory. John Wiley & Sons, New York

    Google Scholar 

  18. Nelson R.D., Philips T.K. (1993) An approximation for the mean response time for shortest queue routing with general interarrival and service times. Performance Evaluation 17:123–139

    Article  MATH  Google Scholar 

  19. Spies F. (1996) Modeling of optimal load balancing strategy using queuing theory. Microprocessors and Microprogramming 41:555–570

    Article  Google Scholar 

  20. Abdallah C.T., Alluri N., Birdwell J.D., Chiasson J., Chupryna V., Tang Z., Wang T. (2003) A linear time delay model for studying load balancing instabilities in parallel computations. The International Journal of System Science 34:563–573

    Article  MATH  Google Scholar 

  21. Birdwell J.D., Chiasson J., Tang Z., Abdallah C.T., Hayat M., Wang T. (2003). Dynamic Time Delay Models for Load Balancing Part I: Deterministic Models. CNRS-NSF Workshop: Advances in Control of Time-Delay Systems, pp. 355–370, Keqin Gu and Silviu-Iulian Niculescu eds., Springer-Verlag, Berlin

    Google Scholar 

  22. Hayat M., Abdallah C.T., Birdwell J.D., Chiasson J. (2003) Dynamic Time Delay Models for Load Balancing Part II: A Stochastic Analysis of the Effect of Delay Uncertainty. CNRS-NSF Workshop: Advances in Control of Time-Delay Systems, pp. 371–385, Keqin Gu and Silviu-Iulian Niculescu eds., Springer-Verlag, Berlin

    Google Scholar 

  23. Birdwell J.D., Chiasson J., Abdallah C.T., Tang Z., Alluri N., Wang T. (2003) The effect of time delays in the stability of load balancing algorithms for parallel computations. In Proceedings of the 42nd IEEE Conference on Decision and Control, pp. 582–587, Maui, Hawaii

    Google Scholar 

  24. Tang Z., Birdwell J.D., Chiasson J., Abdallah C.T., Hayat M.M. (2004) A time delay model for load balancing with processor resource constraints. In Proceedings of the 43rd IEEE Conference on Decision and Control, Paradise Island, Bahamas.

    Google Scholar 

  25. Tang Z., Birdwell J.D., Chiasson J., Abdallah C.T., Hayat M.M. (2004) Closed loop control of a load balancing network with time delays and processor resource constraints. Lecture Notes in Control an Information Sciences: Advances in Communication Control Networks, S. Tarbouriech, C.T. Abdallah and J. Chiasson, eds., pp. 245–268, Springer-Verlag, Berlin

    Google Scholar 

  26. OPNET (2004) http://www.opnet.com/products/modeler/home.html

    Google Scholar 

  27. J. Chiasson, Z. Tang, J. Ghanem, C. T. Abdallah, J. D. Birdwell, M. M. Hayat, H. Jerez, The Effect of Time Delays in the Stability of Load Balancing Algorithms for Parallel Computations, IEEE Transactions on Control Systems Technology, vol. 13, No. 6, November 2005, pp. 932–942.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ECE Dept, The University of Tennessee, Knoxville, TN, 37996-2100, USA

    Zhong Tang, John White & J. Douglas Birdwell

  2. EE Dept, Boise State University, Boise, ID, 83725

    John Chiasson

Authors
  1. Zhong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. John White
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John Chiasson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J. Douglas Birdwell
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. ECE Department, Boise State University, 1910 University Dr., Boise, ID, 83725-2100, USA

    John Chiasson

  2. UMR CNRS 6597, Ecole Centrale de Nantes, IRCCyN, 1 rue de la Noë, BP 92101, 44321, Nantes, France

    Jean Jacques Loiseau

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Tang, Z., White, J., Chiasson, J., Birdwell, J.D. (2007). Modeling and Closed Loop Control for Resource-Constrained Load Balancing with Time Delays in Parallel Computations. In: Chiasson, J., Loiseau, J.J. (eds) Applications of Time Delay Systems. Lecture Notes in Control and Information Sciences, vol 352. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-49556-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-49556-7_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-49555-0

  • Online ISBN: 978-3-540-49556-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation