Advertisement

Impact of Reservations on Production Job Scheduling

  • Martin W. Margo
  • Kenneth Yoshimoto
  • Patricia Kovatch
  • Phil Andrews
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4942)

Abstract

The TeraGrid is a closely linked community of diverse resources: computational, data, and experimental, e.g., the imminent very large computational system at the University of Texas, the extensive data facilities at SDSC, and the physics experiments at ORNL. As research efforts become more extensive in scope, the co-scheduling of multiple resources becomes an essential part of scientific progress. This can be at odds with the traditional management of the computational systems, where utilization, queue wait times, and expansion factors are considered paramount and anything that affects their performance is considered with suspicion. The only way to assuage concerns is with intensive investigation of the likely effects of allowing advance reservations on these performance metrics.

To understand the impact, we developed a simulator that reads our actual production job log and reservation request data to investigate different scheduling scenarios. We explored the effect of reservations and policies using job log data from two different months within consecutive years and present our initial results. Results from the simulations suggest that utilization, expansion factor and queue wait time indeed can be affected negatively by significant numbers and size of reservations, but this effect can be mitigated with appropriate policies.

Keywords

Expansion Factor Advance Reservation Local Scheduler Simulation Core Simulation Clock 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Feitelson, D., Rudolph, L., Schwiegelshohn, U.: Parallel Job Scheduling - A Status Report. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2004. LNCS, vol. 3277, Springer, Heidelberg (2005)Google Scholar
  2. 2.
    Singaga, J., Mohamed, H., Epema, D.: Dynamic Co-Allocation Service in Multicluster Systems. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2004. LNCS, vol. 3277, Springer, Heidelberg (2005)Google Scholar
  3. 3.
    Sodan, A., Lan, L.: LOMARC - Lookahead Matchmaking for Multi-Resource Coscheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2004. LNCS, vol. 3277, Springer, Heidelberg (2005)Google Scholar
  4. 4.
    Snell, Q., Clement, M., Jackson, D., Gregory, C.: The Performance Impact of Advance Reservation Meta-scheduling. In: Feitelson, D.G., Rudolph, L. (eds.) IPDPS-WS 2000 and JSSPP 2000. LNCS, vol. 1911, pp. 137–153. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  5. 5.
    San Diego Supercomputer Center at UCSD, http://www.sdsc.edu
  6. 6.
  7. 7.
    Catalina scheduler, http://www.sdsc.edu/catalina
  8. 8.
  9. 9.
  10. 10.
    Andrews, P., Jordan, C., Kovatch, P.: Massive High-Performance Global File Systems for Grid Computing. Research Paper, SuperComputing 2005, Seattle, WA (November 2005)Google Scholar
  11. 11.
    Yoshimoto, K., Kovatch, P., Andrews, P.: Co-scheduling with User-Settable Reservations. In: Feitelson, D.G., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2005. LNCS, vol. 3834, Springer, Heidelberg (2005)CrossRefGoogle Scholar
  12. 12.
    Metascheduling Requirement Analysis Team final report, http://www.teragridforum.org/mediawiki/images/b/b4/MetaschedRatReport.pdf
  13. 13.
    Frachtenberg, E., Feitelson, D.G.: Pitfalls in Parallel Job Scheduling Evaluation. In: Feitelson, D.G., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2005. LNCS, vol. 3834, Springer, Heidelberg (2005)CrossRefGoogle Scholar
  14. 14.

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Martin W. Margo
    • 1
  • Kenneth Yoshimoto
    • 1
  • Patricia Kovatch
    • 1
  • Phil Andrews
    • 1
  1. 1.San Diego Supercomputer CenterUniversity of CaliforniaSan Diego

Personalised recommendations