Division of Labor: Tools for Growing and Scaling Grids

  • T. Freeman
  • K. Keahey
  • I. Foster
  • A. Rana
  • B. Sotomoayor
  • F. Wuerthwein
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4294)


To enable Grid scalability and growth, a usage model has evolved whereby resource providers make resources available not to individual users directly, but rather to larger units, called virtual organizations. In this paper, we describe abstractions that allow resource providers to delegate the usage of remote resources dynamically to virtual organizations in application-independent ways, and present and evaluate an implementation of this abstraction using the Xen virtual machine and Linux networking tools. We also describe how our implementation is being used in a specific context, namely the enforcement of resource allocations in the Edge Services Framework, currently deployed in the Open Science Grid.


virtualization grid computing resource management distributed computing 


  1. 1.
    Foster, I., et al.: The Grid 2003 Production Grid: Principles and Practice. In: HPDC 2004. IEEE Computer Science Press, Los Alamitos (2004)Google Scholar
  2. 2.
    Open Science Grid, OSG (2004):
  3. 3.
    The TeraGrid Project 2005:
  4. 4.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications 15(3), 200–222 (2001)CrossRefGoogle Scholar
  5. 5.
    Smith, A.: The Wealth of Nations. 1776Google Scholar
  6. 6.
    Keahey, K., Foster, I., Freeman, T., Zhang, X.: Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Progamming Journal (2005)Google Scholar
  7. 7.
  8. 8.
    Foster, I.: Globus Toolkit version 4: Software for Service-Oriented Systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebar, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization. In: SOSP (2003)Google Scholar
  10. 10.
    Foster, I., Keahey, K., Kesselman, C., Laure, E., Livny, M., Martin, S., Rynge, M., Singh, G.: Embedding Community-Specific Resource Managers in General-Purpose Grid Infrastructure. White Paper (2005)Google Scholar
  11. 11.
    Bavier, A., Bowman, M., Chun, B., Culler, D., Karlin, S., Muir, S., Peterson, L., Roscoe, T., Spalink, T., Wawrzoniak, M.: Operating System Support for Planetary-Scale Services. In: 1st Symposium on Network Systems Design and Implementation (2004)Google Scholar
  12. 12.
    Figueiredo, R., Dinda, P., Fortes, J.: A Case for Grid Computing on Virtual Machines. In: 23rd International Conference on Distributed Computing Systems (2003)Google Scholar
  13. 13.
    Adabala, S., Chadha, V., Chawla, P., Figueiredo, R., Fortes, J., Krsul, I., Matsunaga, A., Tsugawa, M., Zhang, J., Zhao, M., Zhu, L., Zhu, X.: From Virtualized Resources to Virtual Computing Grids: The In-VIGO System. Future Generation Computer Systems (2004)Google Scholar
  14. 14.
    Xu, M., Hu, Z., Long, W., Liu, W.: Service Virtualization: Infrastructure and Applications, The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (2004)Google Scholar
  15. 15.
    Reed, D., Pratt, I., Menage, P., Early, S., Stratford, N.: Xenoservers: Accountable Execution of Untrusted Programs. In: 7th Workshop on Hot Topics in Operating Systems (1999)Google Scholar
  16. 16.
    Irwin, D., Chase, J., Grit, L., Yunerefendi, A., Decker, D., Yocum, K.: Sharing Networked Resources with Brokered Leases (2006) (in submission), Available at,
  17. 17.
    Ruth, P., Rhee, J., Xu, D., Kennell, S., Goasguen, S.: Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure. In: ICAC (2006)Google Scholar
  18. 18.
    Lin, B., Dinda, P.: VSched: Mixing Batch And Interactive Machines Using Periodic Real-time Scheduling. In: Supercomputing (2005)Google Scholar
  19. 19.
    Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification, WS-Agreement (2004),
  20. 20.
    Andrieux, A., Czajkowski, K., Lam, J., Smith, C., Xu, M.: Standard Terms for Specifying Computational Jobs (2003),
  21. 21.
    Lu, W., Freeman, T., Keahey, K., Siebenlist, F.: Making your workspace secure: establishing trust with VMs in the Grid. In: SC 2005 Posters (2005)Google Scholar
  22. 22.
    Czajkowski, K., Ferguson, D., Foster, I., Frey, J., Graham, S., Sedukhin, I., Snelling, D., Tuecke, S., Vambenepe, W.: The WS-Resource Framework (2004):
  23. 23.
  24. 24.
    Gupta, D., Cherkasova, L., Gardner, R., Vahadat, A.: Enforcing Performance Isolation Across Virtual Machines in Xen. HP-2006-77 (2006)Google Scholar
  25. 25.
  26. 26.
    Linux Advanced Routing and Traffic Control:
  27. 27.
    Devera, M., Hierarchical Token Bucket Queuing (2005),
  28. 28.
    Vaniachine, A.: DASH: Database Access for Secure Hyperinfrastructure: OSG document 307,
  29. 29.
    Lueking, L.: FroNtier project:
  30. 30.
    Allcock, W., Bester, J., Bresnahan, J., Chervenak, A.L., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In: Mass Storage Conference (2001)Google Scholar
  31. 31.
    The dCache Project:
  32. 32.
    The Virtual Organization Management System:
  33. 33.
    Data Intensive Sciences University Network:
  34. 34.
    Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live Migration of Virtual Machines. In: NSDI (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • T. Freeman
    • 2
  • K. Keahey
    • 2
    • 3
  • I. Foster
    • 1
    • 2
    • 3
  • A. Rana
    • 4
  • B. Sotomoayor
    • 1
  • F. Wuerthwein
    • 4
  1. 1.Department of Computer ScienceUniversity of ChicagoChicagoUSA
  2. 2.Computation InstituteUniversity of Chicago & Argonne National LabChicagoUSA
  3. 3.Math & Computer Science DivisionArgonne National LabArgonneUSA
  4. 4.Department of PhysicsUniversity of CaliforniaSan DiegoUSA

Personalised recommendations