Skip to main content
SpringerLink
Log in

Influence of Dynamic Think Times on Parallel Job Scheduler Performances in Generative Simulations

  • Conference paper
  • First Online:
Job Scheduling Strategies for Parallel Processing (JSSPP 2015, JSSPP 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10353))

Abstract

The performance of parallel schedulers is a crucial factor in the efficiency of high performance computing environments. Scheduler designs for practical application focusing on improving certain metrics can only be achieved, if they are evaluated in realistic testing environments. Since real users submit jobs to their respective system, special attention needs to be spent on their job submission behavior and the causes of that behavior. In this work, we investigate the impact of dynamic user behavior on parallel computing performances and analyze the significance of feedback between system performance and future user behavior. Therefore, we present a user-based dynamic workload model for generative simulations, which we use to analyze the impact of dynamically changing think times on simulations. We run several such simulations with widely known scheduling techniques FCFS and EASY, providing first insights on the influence of our approach on scheduling performances. Additionally, we analyze the performances by means of different metrics allowing a discussion on user satisfying performance measures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. teikoku Grid Scheduling Framework (2012). http://forge.it.irf.tu-dortmund.de/projects/teikoku/. Accessed 12 Nov 2014

  2. Di, S., Kondo, D., Cirne, W.: Host load prediction in a Google compute cloud with a Bayesian model. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC 2012, pp. 1–11, Los Alamitos, CA, USA. IEEE Computer Society Press (2012)

    Google Scholar 

  3. Feitelson, D.G.: Metrics for parallel job scheduling and their convergence. In: Feitelson, D.G., Rudolph, L. (eds.) JSSPP 2001. LNCS, vol. 2221, pp. 188–205. Springer, Heidelberg (2001). doi:10.1007/3-540-45540-X_11

    Chapter  Google Scholar 

  4. Feitelson, D.G.: Looking at data. In: IPDPS 2008, pp. 1–9 (2008)

    Google Scholar 

  5. Feitelson, D.G.: Parallel Workloads Archive (2008). http://www.cs.huji.ac.il/labs/parallel/workload/. Accessed 12 Nov 2014

  6. Feitelson, D.G.: Workload Modeling for Computer Systems Performance Evaluation (2014). http://www.cs.huji.ac.il/~feit/wlmod/wlmod.pdf. Accessed 12 Nov 2014

  7. Lee, C.B., Snavely, A.: On the user-scheduler dialogue: studies of user-provided runtime estimates and utility functions. In: International Journal of High Performance Computing Applications, vol. 20, pp. 495–506 (2006)

    Google Scholar 

  8. Lifka, D.A.: The ANL/IBM SP scheduling system. In: Feitelson, D.G., Rudolph, L. (eds.) JSSPP 1995. LNCS, vol. 949, pp. 295–303. Springer, Heidelberg (1995). doi:10.1007/3-540-60153-8_35

    Chapter  Google Scholar 

  9. Mishra, A.K., Hellerstein, J.L., Cirne, W., Das, C.R.: Towards characterizing cloud backend workloads: insights from google compute clusters. SIGMETRICS Perform. Eval. Rev. 37(4), 34–41 (2010)

    Article  Google Scholar 

  10. Schwiegelshohn, U.: How to design a job scheduling algorithm. In: Cirne, W., Desai, N. (eds.) JSSPP 2014. LNCS, vol. 8828, pp. 147–167. Springer, Cham (2015). doi:10.1007/978-3-319-15789-4_9

    Google Scholar 

  11. Shmueli, E., Feitelson, D.: Using site-level modeling to evaluate the performance of parallel system schedulers. In: 14th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems. MASCOTS 2006, pp. 167–178, September 2006

    Google Scholar 

  12. Shmueli, E., Feitelson, D.G.: On simulation and design of parallel-systems schedulers: are we doing the right thing? IEEE Trans. Parallel Distrib. Syst. 20(7), 983–996 (2009)

    Article  Google Scholar 

  13. Talby, D.: User modeling of parallel workloads. Ph.D. thesis, Hebrew University of Jerusalem (2006)

    Google Scholar 

  14. Tang, W., Desai, N., Buettner, D., Lan, Z.: Analyzing and adjusting user runtime estimates to improve job scheduling on the blue gene/p. In: IEEE International Symposium on Parallel Distributed Processing (IPDPS), pp. 1–11, April 2010

    Google Scholar 

  15. Zakay, N., Feitelson, D.G.: On identifying user session boundaries in parallel workload logs. In: 16th Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), pp. 216–234 (2012)

    Google Scholar 

  16. Zakay, N., Feitelson, D.G.: Workload resampling for performance evaluation of parallel job schedulers. Concurrency Comput. Pract. Exp. 26(12), 2079–2105 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Robotics Research Institute, TU Dortmund University, Dortmund, Germany

    Stephan Schlagkamp

Authors
  1. Stephan Schlagkamp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephan Schlagkamp .

Editor information

Editors and Affiliations

  1. Google, Seattle, USA

    Narayan Desai

  2. Google, Mountain View, USA

    Walfredo Cirne

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Schlagkamp, S. (2017). Influence of Dynamic Think Times on Parallel Job Scheduler Performances in Generative Simulations. In: Desai, N., Cirne, W. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP JSSPP 2015 2016. Lecture Notes in Computer Science(), vol 10353. Springer, Cham. https://doi.org/10.1007/978-3-319-61756-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61756-5_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61755-8

  • Online ISBN: 978-3-319-61756-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation