Skip to main content

A programming environment for dynamic resource allocation and data distribution

  • Run Time Control of Parallelism
  • Conference paper
  • First Online:
Book cover Languages and Compilers for Parallel Computing (LCPC 1996)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1239))

Abstract

Dynamic resource allocation, particularly in the form of processorpartitioning and scheduling, is an important factor in achieving good utilization and high performance in multiprocessor systems. We are developing a Distributed Resource Management System (DRMS) for dynamic allocation of resources during the execution of applications. DRMS provides means for applications to specify their resource requirements and for the system to manipulate resources allocated to competing jobs. DRMS also provides the programming support necessary to create reconfigurable applications, that can execute on time-variant processor partitions. Run-time program migration and data redistribution are performed automatically. We present performance results using application benchmarks on the first implementation of DRMS for the IBM SP2. Our performance results show that (i) the support for dynamic resource control has minimal side effects on the application performance, and (ii) the costs associated with the data redistributions and program restructuring to support changes in the processor partitions are relatively small.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agerwala, T., Martin, J. L., Mirza, J. H., Sadler, D. C., Dias, D. M., and Snir, M. SP2 system architecture. IBM Systems Journal, 34(2): 152–184, 1995.

    Google Scholar 

  2. Bailey, D. et al. The NAS parallel benchmarks. Technical Report RNR-94-007, NASA Ames Research Center, March 1994.

    Google Scholar 

  3. Edjlali, E., Agrawal, G., Sussman, A., and Saltz, J. Data parallel programming in an adaptive environment. In Proceedings of 9th International Parallel Processing Symposium, Santa Barbara, CA, April 1995.

    Google Scholar 

  4. Fox, G., Hiranandani, S., Kennedy, K., Koelbel, C., Kremer, U., Tseng, C., and Wu, M. Fortran D language specification. Technical Report COMP TR90-141, Department of Computer Science, Rice University, December 1990.

    Google Scholar 

  5. Gupta, A., Tucker, A., and Stevens, L. Making effective use of shared-memory multiprocessors: The process control approach. Technical Report CSL-TR-91-475A, Computer Systems Laboratory, Stanford University, 1991.

    Google Scholar 

  6. IBM Corporation. IBM Parallel Programming Environment for AIX, MPL Programming and Subroutine Reference, first edition, August 1995.

    Google Scholar 

  7. Indiana University. Sage++, A Class library for Building Fortran 90 and C++ Restructuring Tools, May 1995.

    Google Scholar 

  8. Koelbel, C. H., Loveman, D. B., Schreiber, R. S., Steele Jr., G. L., and Zosel, M. E. The High Performance Fortran Handbook. The MIT Press, 1994.

    Google Scholar 

  9. Konuru, R. B., Moreira, J. E., and Naik, V. K. Application-assisted dynamic scheduling on large-scale multi-computer systems. In Proceedings of Second International Euro-Par Conference (Euro-Par'96), Lyon, France, volume 1124 of Lecture Notes in Computer Science, pages II:621–630, August 1996.

    Google Scholar 

  10. Leutenneger, S. T and Vernon, M. K. The performance of multiprogrammed multiprocessor scheduling policies. In Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 226–236, May 1990.

    Google Scholar 

  11. McCann, C., Vaswami, R., and Zahorjan, J. A dynamic processor allocation policy for multiprogrammed shared-memory multiprocessors. ACM Transactions on Computer Systems, 11(2): 146–178, May 1993.

    Article  Google Scholar 

  12. McCann, C. and Zahorjan, J. Processor allocation policies for message-passing parallel computers. In Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 19–32, May 1994.

    Google Scholar 

  13. Moreira, J. E., Eswar, K., Konuru, R., and Naik, V. K. Supporting dynamic data and processor repartitioning for irregular applications. In Proceedings of Third International Workshop on Parallel Algorithms for Irregularly Structured Problems (Irregular'96), Santa Barbara, California, volume 1117 of Lecture Notes in Computer Science, pages 237–238, August 1996.

    Google Scholar 

  14. Naik, V. K., Setia, S. K., and Squillante, M. S. Processor allocation in multiprogrammed, distributed-memory parallel computer systems. Technical Report RC 20239, IBM Research Division, October 1995. Submitted to Journal of Parallel and Distributed Computing.

    Google Scholar 

  15. Polychronopoulos, C. Multiprocessing versus multiprogramming. In Proceedings of the 1989 International Conference on Parallel Processing, volume II, pages 223–230, August 8–12 1989.

    Google Scholar 

  16. Tucker, A. and Gupta, A. Process control and scheduling issues for multiprogrammed shared-memory multiprocessors. In Proceedings of the 12th ACM Symposium on Operating Systems Principles, pages 159–166, December 1989.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

David Sehr Utpal Banerjee David Gelernter Alex Nicolau David Padua

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Moreira, J.E., Naik, V.K., Konuru, R.B. (1997). A programming environment for dynamic resource allocation and data distribution. In: Sehr, D., Banerjee, U., Gelernter, D., Nicolau, A., Padua, D. (eds) Languages and Compilers for Parallel Computing. LCPC 1996. Lecture Notes in Computer Science, vol 1239. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0017275

Download citation

  • DOI: https://doi.org/10.1007/BFb0017275

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-63091-3

  • Online ISBN: 978-3-540-69128-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics