Advertisement

Division of Labor: Tools for Growing and Scaling Grids

  • T. Freeman
  • K. Keahey
  • I. Foster
  • A. Rana
  • B. Sotomoayor
  • F. Wuerthwein
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4294)

Abstract

To enable Grid scalability and growth, a usage model has evolved whereby resource providers make resources available not to individual users directly, but rather to larger units, called virtual organizations. In this paper, we describe abstractions that allow resource providers to delegate the usage of remote resources dynamically to virtual organizations in application-independent ways, and present and evaluate an implementation of this abstraction using the Xen virtual machine and Linux networking tools. We also describe how our implementation is being used in a specific context, namely the enforcement of resource allocations in the Edge Services Framework, currently deployed in the Open Science Grid.

Keywords

virtualization grid computing resource management distributed computing 

References

  1. 1.
    Foster, I., et al.: The Grid 2003 Production Grid: Principles and Practice. In: HPDC 2004. IEEE Computer Science Press, Los Alamitos (2004)Google Scholar
  2. 2.
    Open Science Grid, OSG (2004): http://www.opensciencegrid.org
  3. 3.
    The TeraGrid Project 2005: http://www.taragrid.org
  4. 4.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications 15(3), 200–222 (2001)CrossRefGoogle Scholar
  5. 5.
    Smith, A.: The Wealth of Nations. 1776Google Scholar
  6. 6.
    Keahey, K., Foster, I., Freeman, T., Zhang, X.: Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Progamming Journal (2005)Google Scholar
  7. 7.
  8. 8.
    Foster, I.: Globus Toolkit version 4: Software for Service-Oriented Systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebar, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization. In: SOSP (2003)Google Scholar
  10. 10.
    Foster, I., Keahey, K., Kesselman, C., Laure, E., Livny, M., Martin, S., Rynge, M., Singh, G.: Embedding Community-Specific Resource Managers in General-Purpose Grid Infrastructure. White Paper (2005)Google Scholar
  11. 11.
    Bavier, A., Bowman, M., Chun, B., Culler, D., Karlin, S., Muir, S., Peterson, L., Roscoe, T., Spalink, T., Wawrzoniak, M.: Operating System Support for Planetary-Scale Services. In: 1st Symposium on Network Systems Design and Implementation (2004)Google Scholar
  12. 12.
    Figueiredo, R., Dinda, P., Fortes, J.: A Case for Grid Computing on Virtual Machines. In: 23rd International Conference on Distributed Computing Systems (2003)Google Scholar
  13. 13.
    Adabala, S., Chadha, V., Chawla, P., Figueiredo, R., Fortes, J., Krsul, I., Matsunaga, A., Tsugawa, M., Zhang, J., Zhao, M., Zhu, L., Zhu, X.: From Virtualized Resources to Virtual Computing Grids: The In-VIGO System. Future Generation Computer Systems (2004)Google Scholar
  14. 14.
    Xu, M., Hu, Z., Long, W., Liu, W.: Service Virtualization: Infrastructure and Applications, The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (2004)Google Scholar
  15. 15.
    Reed, D., Pratt, I., Menage, P., Early, S., Stratford, N.: Xenoservers: Accountable Execution of Untrusted Programs. In: 7th Workshop on Hot Topics in Operating Systems (1999)Google Scholar
  16. 16.
    Irwin, D., Chase, J., Grit, L., Yunerefendi, A., Decker, D., Yocum, K.: Sharing Networked Resources with Brokered Leases (2006) (in submission), Available at, http://issg.cs.duke.edu/publications/sisyphus.pdf
  17. 17.
    Ruth, P., Rhee, J., Xu, D., Kennell, S., Goasguen, S.: Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure. In: ICAC (2006)Google Scholar
  18. 18.
    Lin, B., Dinda, P.: VSched: Mixing Batch And Interactive Machines Using Periodic Real-time Scheduling. In: Supercomputing (2005)Google Scholar
  19. 19.
    Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification, WS-Agreement (2004), https://forge.gridforum.org/projects/graap-wg/
  20. 20.
    Andrieux, A., Czajkowski, K., Lam, J., Smith, C., Xu, M.: Standard Terms for Specifying Computational Jobs (2003), http://www.epcc.ed.ac.uk/%7Eali/WORK/GGF/JSDLWG/DOCS/WS-Agreement_job_terms_for_JSDL_print.pdf
  21. 21.
    Lu, W., Freeman, T., Keahey, K., Siebenlist, F.: Making your workspace secure: establishing trust with VMs in the Grid. In: SC 2005 Posters (2005)Google Scholar
  22. 22.
    Czajkowski, K., Ferguson, D., Foster, I., Frey, J., Graham, S., Sedukhin, I., Snelling, D., Tuecke, S., Vambenepe, W.: The WS-Resource Framework (2004): http://www.globus.org/wsrf
  23. 23.
  24. 24.
    Gupta, D., Cherkasova, L., Gardner, R., Vahadat, A.: Enforcing Performance Isolation Across Virtual Machines in Xen. HP-2006-77 (2006)Google Scholar
  25. 25.
  26. 26.
    Linux Advanced Routing and Traffic Control: http://lartc.org
  27. 27.
    Devera, M., Hierarchical Token Bucket Queuing (2005), http://luxik.cdi.cz/~devik/qos/htb/
  28. 28.
    Vaniachine, A.: DASH: Database Access for Secure Hyperinfrastructure: OSG document 307, http://osg-docdb.opensciencegrid.org/cgi-bin/ShowDocument?docid=307
  29. 29.
    Lueking, L.: FroNtier project: http://lynx.fnal.gov/ntier-wiki
  30. 30.
    Allcock, W., Bester, J., Bresnahan, J., Chervenak, A.L., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In: Mass Storage Conference (2001)Google Scholar
  31. 31.
    The dCache Project: http://www.dcache.org
  32. 32.
    The Virtual Organization Management System: http://infnforge.cnaf.infn.it/projects/voms
  33. 33.
    Data Intensive Sciences University Network: http://disun.org
  34. 34.
    Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live Migration of Virtual Machines. In: NSDI (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • T. Freeman
    • 2
  • K. Keahey
    • 2
    • 3
  • I. Foster
    • 1
    • 2
    • 3
  • A. Rana
    • 4
  • B. Sotomoayor
    • 1
  • F. Wuerthwein
    • 4
  1. 1.Department of Computer ScienceUniversity of ChicagoChicagoUSA
  2. 2.Computation InstituteUniversity of Chicago & Argonne National LabChicagoUSA
  3. 3.Math & Computer Science DivisionArgonne National LabArgonneUSA
  4. 4.Department of PhysicsUniversity of CaliforniaSan DiegoUSA

Personalised recommendations