Skip to main content

Breaking the curse of dynamics by task migration: Pilot experiments in the polder metacomputer

  • 3 Implementation Issues
  • Conference paper
  • First Online:
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 1997)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1332))

Abstract

With the advent of high speed networks, distributed cluster computing and metacomputing have assumed an enormous interest. However, software methods and techniques to make the full potential of these distributed environments available, are not yet mature. In this paper, we focus on dynamic load balancing of resources and applications as one of the crucial techniques to optimize performance in distributed environments. Some design and implementation details are described, and early experimental results are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Barak and O. La'adan. Performance of the MOSIX parallel system for a cluster of PC's. In High Performance Computing and Networking (HPCN Europe '97), volume 1225 of LNCS, pages 624–635. Springer-Verlag, May 1997.

    Google Scholar 

  2. M. Brune, J. Gehring, and A. Reinefeld. A lightweight communication interface for parallel programming environments. In High-Performance Computing and Networking (HPCN Europe '97), volume 1225 of LNCS, pages 503–513. Springer-Verlag, May 1997.

    Google Scholar 

  3. J. Casas, D. L. Clark, P. S. Galbiati, R. Konuru, S. W. Otto, R. M. Prouty, and J. Walpole. MIST: PVM with transparent migration and checkpointing. In Third Annual PVM Users' Group Meeting, Pittsburgh, PA, May 1995.

    Google Scholar 

  4. The distributed ASCI supercomputer (DAS). http://www.asci.tudelft.nl/das/das.shtml.

    Google Scholar 

  5. J. F. de Ronde, A. Schoneveld, P. M. A. Sloot, N. Floros, and J. Reeve. Load balancing by redundant decomposition and mapping. In High Performance Computing and Networking (HPCN Europe '96), volume 1067 of LNCS, pages 555–561. Springer-Verlag, Apr. 1996.

    Google Scholar 

  6. T. A. DeFanti, I. Foster, M. E. Papka, R. Stevens, and T. Kuhfuss. Overview of the I-WAY: Wide area visual supercomputing. International Journal of Supercomputer Applications and High Performance Computing, 10(2/3):123–130, 1996.

    Google Scholar 

  7. I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications and High Performance Computing, 11(2):115–128, 1997.

    Google Scholar 

  8. A. S. Grimshaw and W. A. Wulf. Legion—A view from 50,000 feet. In Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, pages 89–99, Syracuse, NY, Aug. 1996.

    Google Scholar 

  9. M. Litzkow, M. Livny, and M. W. Mutka. Condor—A hunter of idle workstations. In 8th IEEE International Conference on Distributed Computing Systems, pages 104–111, 1988.

    Google Scholar 

  10. B. J. Overeinder, P. M. A. Sloot, R. N. Heederik, and L. O. Hertzberger. A dynamic load balancing system for parallel cluster computing. Future Generation Computer Systems, 12(1):101–115, May 1996.

    Article  Google Scholar 

  11. The Polder metacomputing initiative. http://www.wins.uva.nl/projects/polder/.

    Google Scholar 

  12. J. Pruyne and M. Livny. Interfacing Condor and PVM to harness the cycles of workstation clusters. Future Generation Computer Systems, 12(1):67–85, May 1996.

    Article  Google Scholar 

  13. M. S. Warren, M. P. Goda, D. J. Becker, J. K. Salmon, and T Sterling. Parallel supercomputing with commodity components. In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'97), Las Vegas, NV, June 1997.

    Google Scholar 

  14. J. B. Weissman and A. S. Grimshaw. A federated model for scheduling in wide-area systems. In Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, pages 542–550, Syracuse, NY, Aug. 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Marian Bubak Jack Dongarra Jerzy Waśniewski

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Overeinder, B.J., Sloot, P.M.A. (1997). Breaking the curse of dynamics by task migration: Pilot experiments in the polder metacomputer. In: Bubak, M., Dongarra, J., Waśniewski, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 1997. Lecture Notes in Computer Science, vol 1332. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63697-8_86

Download citation

  • DOI: https://doi.org/10.1007/3-540-63697-8_86

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-63697-7

  • Online ISBN: 978-3-540-69629-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics