Abstract
To enable Grid scalability and growth, a usage model has evolved whereby resource providers make resources available not to individual users directly, but rather to larger units, called virtual organizations. In this paper, we describe abstractions that allow resource providers to delegate the usage of remote resources dynamically to virtual organizations in application-independent ways, and present and evaluate an implementation of this abstraction using the Xen virtual machine and Linux networking tools. We also describe how our implementation is being used in a specific context, namely the enforcement of resource allocations in the Edge Services Framework, currently deployed in the Open Science Grid.
Chapter PDF
Similar content being viewed by others
References
Foster, I., et al.: The Grid 2003 Production Grid: Principles and Practice. In: HPDC 2004. IEEE Computer Science Press, Los Alamitos (2004)
Open Science Grid, OSG (2004): http://www.opensciencegrid.org
The TeraGrid Project 2005: http://www.taragrid.org
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications 15(3), 200–222 (2001)
Smith, A.: The Wealth of Nations. 1776
Keahey, K., Foster, I., Freeman, T., Zhang, X.: Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Progamming Journal (2005)
ESF: http://osg.ivdgl.org/twiki/bin/view/EdgeServices/WebHome
Foster, I.: Globus Toolkit version 4: Software for Service-Oriented Systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebar, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization. In: SOSP (2003)
Foster, I., Keahey, K., Kesselman, C., Laure, E., Livny, M., Martin, S., Rynge, M., Singh, G.: Embedding Community-Specific Resource Managers in General-Purpose Grid Infrastructure. White Paper (2005)
Bavier, A., Bowman, M., Chun, B., Culler, D., Karlin, S., Muir, S., Peterson, L., Roscoe, T., Spalink, T., Wawrzoniak, M.: Operating System Support for Planetary-Scale Services. In: 1st Symposium on Network Systems Design and Implementation (2004)
Figueiredo, R., Dinda, P., Fortes, J.: A Case for Grid Computing on Virtual Machines. In: 23rd International Conference on Distributed Computing Systems (2003)
Adabala, S., Chadha, V., Chawla, P., Figueiredo, R., Fortes, J., Krsul, I., Matsunaga, A., Tsugawa, M., Zhang, J., Zhao, M., Zhu, L., Zhu, X.: From Virtualized Resources to Virtual Computing Grids: The In-VIGO System. Future Generation Computer Systems (2004)
Xu, M., Hu, Z., Long, W., Liu, W.: Service Virtualization: Infrastructure and Applications, The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (2004)
Reed, D., Pratt, I., Menage, P., Early, S., Stratford, N.: Xenoservers: Accountable Execution of Untrusted Programs. In: 7th Workshop on Hot Topics in Operating Systems (1999)
Irwin, D., Chase, J., Grit, L., Yunerefendi, A., Decker, D., Yocum, K.: Sharing Networked Resources with Brokered Leases (2006) (in submission), Available at, http://issg.cs.duke.edu/publications/sisyphus.pdf
Ruth, P., Rhee, J., Xu, D., Kennell, S., Goasguen, S.: Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure. In: ICAC (2006)
Lin, B., Dinda, P.: VSched: Mixing Batch And Interactive Machines Using Periodic Real-time Scheduling. In: Supercomputing (2005)
Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification, WS-Agreement (2004), https://forge.gridforum.org/projects/graap-wg/
Andrieux, A., Czajkowski, K., Lam, J., Smith, C., Xu, M.: Standard Terms for Specifying Computational Jobs (2003), http://www.epcc.ed.ac.uk/%7Eali/WORK/GGF/JSDLWG/DOCS/WS-Agreement_job_terms_for_JSDL_print.pdf
Lu, W., Freeman, T., Keahey, K., Siebenlist, F.: Making your workspace secure: establishing trust with VMs in the Grid. In: SC 2005 Posters (2005)
Czajkowski, K., Ferguson, D., Foster, I., Frey, J., Graham, S., Sedukhin, I., Snelling, D., Tuecke, S., Vambenepe, W.: The WS-Resource Framework (2004): http://www.globus.org/wsrf
Xen Scheduling: http://wiki.xensource.com/xenwiki/Scheduling
Gupta, D., Cherkasova, L., Gardner, R., Vahadat, A.: Enforcing Performance Isolation Across Virtual Machines in Xen. HP-2006-77 (2006)
Xen CPU Scheduler w/SMP Load Balancer: http://lists.xensource.com/archives/html/xendevel/2006-05/msg01315.html
Linux Advanced Routing and Traffic Control: http://lartc.org
Devera, M., Hierarchical Token Bucket Queuing (2005), http://luxik.cdi.cz/~devik/qos/htb/
Vaniachine, A.: DASH: Database Access for Secure Hyperinfrastructure: OSG document 307, http://osg-docdb.opensciencegrid.org/cgi-bin/ShowDocument?docid=307
Lueking, L.: FroNtier project: http://lynx.fnal.gov/ntier-wiki
Allcock, W., Bester, J., Bresnahan, J., Chervenak, A.L., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In: Mass Storage Conference (2001)
The dCache Project: http://www.dcache.org
The Virtual Organization Management System: http://infnforge.cnaf.infn.it/projects/voms
Data Intensive Sciences University Network: http://disun.org
Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live Migration of Virtual Machines. In: NSDI (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Freeman, T., Keahey, K., Foster, I., Rana, A., Sotomoayor, B., Wuerthwein, F. (2006). Division of Labor: Tools for Growing and Scaling Grids. In: Dan, A., Lamersdorf, W. (eds) Service-Oriented Computing – ICSOC 2006. ICSOC 2006. Lecture Notes in Computer Science, vol 4294. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11948148_4
Download citation
DOI: https://doi.org/10.1007/11948148_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68147-2
Online ISBN: 978-3-540-68148-9
eBook Packages: Computer ScienceComputer Science (R0)