Abstract
The objective of the European DataGrid (EDG) project is to assist the next generation of scientific exploration, which requires intensive computation and analysis of shared large-scale datasets, from hundreds of terabytes to petabytes, across widely distributed scientific communities. We see these requirements emerging in many scientific disciplines, including physics, biology, and earth sciences. Such sharing is made complicated by the distributed nature of the resources to be used, the distributed nature of the research communities, the size of the datasets and the limited network bandwidth available. To address these problems we are building on emerging computational Grid technologies to establish a research network that is developing the technology components essential for the implementation of a world-wide data and computational Grid on a scale not previously attempted. An essential part of this project is the phased development and deployment of a large-scale Grid testbed.
The primary goals of the first phase of the EDG testbed were: 1) to demonstrate that the EDG software components could be integrated into a productionquality computational Grid; 2) to allow the middleware developers to evaluate the design and performance of their software; 3) to expose the technology to end-users to give them hands-on experience; and 4) to facilitate interaction and feedback between end-users and developers. This first testbed deployment was achieved towards the end of 2001 and assessed during the successful European Union review of the project on March 1, 2002. In this article we give an overview of the current status and plans of the EDG project and describe the distributed testbed.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Reference Documents
DataGrid D12.4: “DataGrid Architecture”
DataGrid D8.1a: “DataGrid User Requirements and Specifications for the DataGrid Project”
DataGrid D9.1: “Requirements Specification: EO Application Requirements for Grid”
DataGrid D10.1: WP10 Requirements Document
DataGrid D8.2: “Testbed1 Assessment by HEP Applications”
“The Anatomy of the Grid”, I. Foster, C. Kesselman, et al. Technical Report, Global Grid Forum, 2001, http://www.globus.org/research/papers/anatomy.pdf
DataGrid D6.1: “Testbed Software Integration Process”
Condor Project (http://www.cs.wisc.edu/condor/). Jim Basney and Miron Livny, “Deploying a High Throughput. Computing Cluster”, High Performance Cluster computing, Rajkumar Buyya, Editor, Vol. 1, Chapter 5, Prentice Hall PTR, May 1999. Nicholas Coleman, “An Implementation of Matchmaking Analysis in Condor”, Masters’ Project report, University of Wisconsin, Madison, May 2001.
DataGrid Architecture Version 2, G. Cancio, S. Fisher, T. Folkes, F. Giacomini, W. Hoschek, D. Kelsey, B. Tierney, http://grid-atf.web.cern.ch/grid-atf/documents.html
DataGrid D12.3: “Software Release Policy”
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gagliardi, F., Jones, B., Reale, M., Burke, S. (2002). European DataGrid Project: Experiences of Deploying a Large Scale Testbed for E-science Applications. In: Calzarossa, M.C., Tucci, S. (eds) Performance Evaluation of Complex Systems: Techniques and Tools. Performance 2002. Lecture Notes in Computer Science, vol 2459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45798-4_20
Download citation
DOI: https://doi.org/10.1007/3-540-45798-4_20
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44252-3
Online ISBN: 978-3-540-45798-5
eBook Packages: Springer Book Archive