Abstract
Job scheduling is a complex problem, yet it is fundamental to sustaining and improving the performance of parallel processing systems. In this paper, we address an on-line parallel job scheduling problem in heterogeneous multi-cluster computing systems. We propose a new space-sharing scheduling policy and show that it performs substantially better than the conventional policies.
Chapter PDF
Similar content being viewed by others
Keywords
- Schedule Policy
- Parallel Processing System
- Relative Performance Evaluation
- Partition Size
- Mean Response Time
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Ming, Q.X.: Effective Metacomputing using LSF MultiCluster. In: Proceedings of CCGrid, pp. 100–106 (2001)
Thyagaraj, T.K., Dandamudi, S.P.: An Efficient Adaptive Scheduling Scheme for Distributed Memory Multicomputers. IEEE Transactions on Parallel and Distributed Systems 12, 758–768 (2001)
Abawajy, J.H., Dandamudi, S.P.: A Unified Resource Scheduling Approach on Cluster Computing Systems. In: Proceedings of the PDCS 2003, pp. 43–48 (2003)
Rosti, E., Smirni, E., Serazzi, G., Dowdy, L.W.: Analysis of Non-Work- Conserving Processor Partitioning Policies. In: Proceedings of JSSPP, pp. 165–181 (1995)
Abawajy, J.H., Dandamudi, S.P.: Scheduling Parallel Jobs with CPU and I/O Resource Requirements in Cluster Computing Systems. In: Proceedings of the 11th IEEE/ACM MASCOTS 2003, pp. 336–351 (2003)
Abawajy, J.H., Dandamudi, S.P.: Parallel Job Scheduling on Multi-Cluster Computing Systems. In: Proceedings of the IEEE Cluster, pp. 11–17 (2003)
Feitelson, D.G., Rudolph, L.: Toward Convergence in Job Schedulers for Parallel Supercomputers. In: Proceedings of JSSPP, pp. 1–26 (1996)
Feitelson, D.G., Jette, M.A.: Improved Utilization and Responsiveness with Gang Scheduling. In: Proceedings of JSSPP, pp. 238–261 (1997)
Ryu, K.D., Hollingsworth, J.K.: Exploiting Fine-Grained Idle Periods in Networks of Workstations. IEEE Transactions on Parallel and Distributed System 11, 683–698 (2000)
Stergios, A.V., Sevcik, K.C.: Parallel Application Scheduling on Networks of Workstations. Journal of Parallel and Distributed Computing 43, 1159–1166 (1997)
Zhengao, Z., Dandamudi, S.P.: An Adaptive Space-Sharing Policy for Heterogeneous Parallel Systems. In: HPCN 2001, pp. 353–362 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abawajy, J.H. (2004). Dynamic Parallel Job Scheduling in Multi-cluster Computing Systems. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science - ICCS 2004. ICCS 2004. Lecture Notes in Computer Science, vol 3036. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24685-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-24685-5_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22114-2
Online ISBN: 978-3-540-24685-5
eBook Packages: Springer Book Archive