Skip to main content

Project-Oriented Scheduler for Cluster Systems

  • Conference paper
Modeling, Simulation and Optimization of Complex Processes

Abstract

Parallel processing is the key to fulfill the high demands on computational resources in scientific computing. This has further pushed research in High Performance Computing into the mainstream. Numerous powerful computer systems have appeared. Especially, low-cost powerful clusters, which are set up by connecting many personal computers/workstations via a high speed network, have been developed rapidly during the last decade. Batch scheduling systems for clusters are very important on transparent access to cluster resources. Most batch scheduling systems have essentially focused on maximizing the use of computing resources like processors, but not on improving quality of services (QoS). This paper presents a batch scheduler called Project-Oriented Scheduler (POS), which schedules jobs from projects with different priorities. The higher priority level one project has, the longer service time it is assigned. Moreover, starvation is also considered. POS has been evaluated using SimGrid, a simulation tool that provides core functions for the simulation of distributed applications in distributed environments, and the results show that POS improves not only the utilization of the system but also the satisfaction of the projects as compared with other scheduling strategies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bayucan A., Lesiak C., Mann B., Henderson R. L., Proett T., and Tweten D., External Reference Specification, Release 1.1.12, August 1998, http://www-unix.mcs.anl.gov/openpbs/

  2. Bayucan A., Lesiak C., Mann B., Henderson R. L., Proett T., and Tweten D., Internal Design Specification, Release 1.1.12, August 1998, http://www-unix.mcs.anl.gov/openpbs/

  3. Bayucan A., Lesiak C., Mann B., Henderson R. L., Proett T., Tweten D., and Jasinskyj L. T., Portable Batch System Administrator Guide, Release 1.1.12, August 1998, http://www.compsci.wm.edu/SciClone/documentation/software/OpenPBS/

  4. Bode B., Halstead D. M., Kendall R., and Lei Z., The Portable Batch Scheduler and the Maui Scheduler on Linux Clusters, Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, October 2000.

    Google Scholar 

  5. Casanova H., SimGrid: A Toolkit for the Simulation of Application Scheduling. http://grail.sdsc.edu/papers/simgrid

  6. Chun B., and Culler D., Market-Based Proportional Resource Sharing for Clusters, Technical Report CSD-1092, University of California at Berkeley, Computer Science Division, January 2000.

    Google Scholar 

  7. Chun B., and Culler D., Rexec: A Decentralized, Secure Remote Execution Environment for Clusters, 4th Workshop on Communication, Architecture, and Applications for Network-Based Parallel Computing (CANPC), France, January 2000, pp. 1-14.

    Google Scholar 

  8. Gentzsch W., Sun Grid Engine (SGE): A Cluster Resource Manager, October 2002, http://gridengine.sunsource.net/

  9. Jackson D., Maui Scheduler: A Multifunction Cluster Scheduler, Beowulf Cluster Computing with Linux, November 2001, pp. 351-368.

    Google Scholar 

  10. Jackson D., Snell Q., and Clement M., Core Algorithms of the Maui Scheduler, Lecture Notes in Computer Science, Vol. 2221, June 2001, pp. 87-102.

    Article  Google Scholar 

  11. Libra, http://www.gridbus.org/libra/

  12. Maui, http://www.clusterresources.com/pages/resources/documentation.php

  13. Platform Load Sharing Facility (LSF), October 2002, http://www.platform.com/Products/Platform.LSF.Family/Platform.LSF/

  14. Portable Batch System (PBS), http://www.pbsgridworks.com/

  15. Sherwani J., Ali N., Lotia N., Hayat Z., and Buyya R., Libra: A Computational Economy-Based Job Scheduling System for Clusters, Software: Practice and Experience, Vol. 34, Issue 6, May 2004, pp. 573-590.

    Article  Google Scholar 

  16. Sherwani J., Ali N., Lotia N., Hayat Z., and Buyya R., Libra: An Economy-Driven Job Scheduling System for Clusters, Proceedings of the 6th International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2002), India, December 2002.

    Google Scholar 

  17. Yeo C. S., and Buyya R., Pricing for Utility-Driven Resource Management and Allocation in Clusters, Proceedings of the 12th International Conference on Advanced Computing and Communication (ADCOM 2004), India, December 2004.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Minh, T.N., Thoai, N., Son, N.T., Ky, D.X. (2008). Project-Oriented Scheduler for Cluster Systems. In: Bock, H.G., Kostina, E., Phu, H.X., Rannacher, R. (eds) Modeling, Simulation and Optimization of Complex Processes. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79409-7_27

Download citation

Publish with us

Policies and ethics