Abstract
We describe a scheduling technique in which estimated job runtimes and estimated resource availability are used to efficiently distribute workloads across a homogeneous grid of resources with variable availability. The objective is to increase efficiency by minimizing job failure caused by resources becoming unavailable. Optimal scheduling will be accomplished by mapping jobs onto resources with sufficient availability. Both the scheduling technique and the implementation called PGS (Prediction based Grid Scheduling) are described in detail. Results are presented for a set of sleep jobs, and compared with a first come, first serve scheduling approach.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Condor, http://www.cs.wisc.edu/condor/
Globus, http://www.globus.org/
Hellinckx, P., Arickx, F., Broeckhove, J., Stuer, G.: The CoBRA grid: a highly configurable lightweight grid. International Journal of Web and Grid Services 3(20), 267–286 (2007)
Hellinckx, P., Stuer, G., Hendrickx, W., Arickx, F., Broeckhove, J.: Grid-user driven grid research, the CoBRA grid. In: CCGRID 2006: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID 2006), Washington, DC, USA, p. 49. IEEE Computer Society, Los Alamitos (2006)
Zhang, Y., Squillante, M.S., Sivasubramaniam, A., Sahoo, R.K.: Performance implications of failures in large-scale cluster scheduling. LNCS. Springer, Heidelberg (2005)
Litzkow, M., Tannenbaum, T., Basney, J., Livny, M.: Checkpoint and migration of UNIX processes in the Condor distributed processing system. Technical Report UW-CS-TR-1346, University of Wisconsin - Madison Computer Sciences Department (April 1997)
Ren, X., Lee, S., Eigenmann, R., Bagchi, S.: Resource availability prediction in fine-grained cycle sharing systems. In: Proceedings of the Conference on High Performance Distributed Computing (2006)
Brevik, J., Nurmi, D., Wolski, R.: Automatic methods for predicting machine availability in desktop grid and peer-to-peer systems. In: CCGRID 2004: Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid, Washington, DC, USA, pp. 190–199. IEEE Computer Society, Los Alamitos (2004)
Reistad, B., Gifford, D.K.: Static dependent costs for estimating execution time. SIGPLAN Lisp Pointers VII(3), 65–78 (1994)
Yang, J., Ahmad, I., Ghafoor, A.: Estimation of execution times on heterogeneous supercomputer architectures. In: ICPP 1993: Proceedings of the 1993 International Conference on Parallel Processing, Washington, DC, USA, pp. 219–226. IEEE Computer Society, Los Alamitos (1993)
Iverson, M.A., Özgüner, F., Potter, L.C.: Statistical prediction of task execution times through analytic benchmarking for scheduling in a heterogeneous environment. In: HCW 1999: Proceedings of the Eighth Heterogeneous Computing Workshop, Washington, DC, USA, p. 99. IEEE Computer Society, Los Alamitos (1999)
Cirne, W., Paranhos, D., Costa, L., Santos-Neto, E., Brasileiro, F., Sauve, J., Silva, F.A.B., Barros, C.O., Silveira, C.: Running bag-of-tasks applications on computational grids: The MyGrid approach. ICPP 00, 407 (2003)
Hellinckx, P., Stuer, G., Dewolfs, D., Arickx, F., Broeckhove, J., Dhaene, T.: Dynamic problem-independent metacomputing characterization applied to the condor system. In: Procedings ESM 2003, pp. 262–269 (2003)
Hellinckx, P., Verboven, S., Arickx, F., Broeckhove, J.: Scheduling parameter sweeps in desktop grids using runtime prediction. Poster, Grid@Mons (2008)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Verboven, S., Hellinckx, P., Broeckhove, J., Arickx, F. (2008). Dynamic Grid Scheduling Using Job Runtime Requirements and Variable Resource Availability. In: Luque, E., Margalef, T., Benítez, D. (eds) Euro-Par 2008 – Parallel Processing. Euro-Par 2008. Lecture Notes in Computer Science, vol 5168. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85451-7_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-85451-7_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85450-0
Online ISBN: 978-3-540-85451-7
eBook Packages: Computer ScienceComputer Science (R0)