Abstract
In large-scale distributed computing systems, in which the computational elements are physically or virtually distant from each other, there are communication-related delays that can significantly alter the expected performance of load-balancing policies that do not account for such delays. This is a particularly significant problem in systems for which the individual units are connected by means of a shared broadband communication medium (e.g., the Internet, ATM, wireless LAN or wireless Internet). In such cases, the delays, in addition to being large, fluctuate randomly, making their one-time accurate prediction impossible. In this work, the stochastic dynamics of a load-balancing algorithm in a cluster of computer nodes are modeled and used to predict the effects of the random time delays on the algorithm's performance. A discrete-time stochastic dynamical-equation model is presented describing the evolution of the random queue size of each node. Monte Carlo simulation is also used to demonstrate the extent of the role played by the magnitude and uncenainty of the various time-delay elements in altering the performance of load balancing. This study reveals that the presence of delay (deterministic or random) can lead to a significant degradation in the performance of a load-balancing policy. One way to remedy such a problem is to weaken the load-balancing mechanism so that the load-transfer between nodes is down-scaled (or discouraged) appropriately.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. D. Birdwell, T. W. Wang, R. D. Hom, P. Yadav, and D. J. Icove, “Method of indexed storage and retrieval of multidimensional information,” U. S. Patent Application 09/671,304 (2000)
C. T. Abdallah, N. Alluri, J. D. Birdwell, J. Chiasson, Y. Chupryna, Z. Tang, and T. Wang “A linear time delay model for studying load balancing instabilities in parallel computations,” The International Journal of System Science, to appear (2003)
T.L. Casavant and J.G. Kuhl, “A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems,” IEEE Trans. Software Eng., vol. 14, pp. 141–154 (Feb. 1988)
Zhiling Lan, Valerie E. Taylor, Greg Bryan. “Dynamic Load Balancing for Adaptive Mesh Refinement Application,” In Proc. Of ICPP' 2001, Valencia, Spain (2001)
G. Cybenko, “Dynamic load balancing for distributed memory multiprocessors,” IEEE Transactions on Parallel and Distributed computing, vol. 7, pp. 279–301 (1989)
J. D. Birdwell, J. Chiasson, Z. Tang, T. Wang, C. T. Abdallah, and M. M. Hayat, “Dynamic time delay models for load balancing Part I: Deterministic models,” CNRS-NSF Workshop: Advances in Control of Time-Delay Systems, Paris, France (Jan. 2003)
C. T. Abdallah, J.D. Birdwell, J. Chiasson, V. Churpryna, Z. Tang, and T.W. Wang “Load balancing instabilities due to Time delays in farallel computation,” Proceedings of the 3rd IFAC Conference an Time Delay Systems. Santa Fe, NM (Dec. 2001)
M. M. Hayat, C. T. Abdallah, J. D. Birdwell and J. Chiasson, “Dynamic time delay models for load balancing, Part II: A stochastic analysis of the effect of delay uncertainty,” CNRS-NSF Workshop: Advances in Control of Time-Delay Systems. Paris, France (Jan. 2003)
D. J. Daley and D. Vere-Jones, An Introduction to Ihe Theory of Point Processes (Springe-rVerlag New York, NY 1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hayat, M.M., Dhakal, S., Abdallah, C.T., Douglas Birdwell, J., Chiasson, J. (2004). Dynamic Time Delay Models for Load Balancing. Part II: A Stochastic Analysis of the Effect of Delay Uncertainty. In: Niculescu, SI., Gu, K. (eds) Advances in Time-Delay Systems. Lecture Notes in Computational Science and Engineering, vol 38. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18482-6_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-18482-6_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20890-7
Online ISBN: 978-3-642-18482-6
eBook Packages: Springer Book Archive