Abstract
Today large-scale applications require access to data stored in heterogeneous storage systems located at geographically distributed virtual organizations. In such applications, users are forced to deal with different administrative policies and structures at each site, and various data access mechanisms on each storage system. This implies a lot of human interventions in order to develop dedicated programs and scripts for data transfer between theses systems. This paper presents GRid-enAbled Virtual file sYstem (GRAVY) architecture which enables the automation of data transfers between distributed file systems irrespective of their heterogeneity. This feature enables high-level schedulers integrated with GRAVY to control data placements like computational jobs. GRAVY supports multiple data access protocols and provides an easy-to-use interface for novice Grid users.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cappello, F., et al.: Computing on large-scale distributed systems: Xtremweb architecture, programming models, security, tests and convergence with grid. Future Generation Computer System 21(3), 417–437 (2005)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. The International Journal of High Performance Computing Applications 15(3), 200–222 (2001)
Allcock, B., et al.: Data Management and Transfer in High Performance Computational Grid Environments. Parallel Computing Journal 28(5), 749–771 (2002)
Fielding, R., et al.: RFC-2068: Hypertext Transfer Protocol - HTTP/1.1 (1997), http://www.w3.org/Protocols/rfc2068/rfc2068
Postel, J., Reynolds, J.: RFC-959: File Transfer Protocol, http://www.w3.org/Protocols/rfc959/
Ylonen, T., Lonvick, C.: RFC-4251: The Secure Shell (SSH) Protocol, http://www.ietf.org/rfc/rfc4251.txt
Globus Project: http://www.globus.org
Chervenak, A., et al.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23, 187–200 (1999)
Foster, I.: Globus Toolkit Version 4: Software for Service-Oriented Systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)
Antonioletti, M., et al.: The Design and Implementation of Grid Database Services in OGSA-DAI. Concurrency and Computation: Practice and Experience 17(2-4), 357–376 (2005)
White, B.S., et al.: LegionFS: A Secure and Scalable File System Supporting Cross-Domain High-Performance Applications. In: Proceedings of the IEEE/ACM Supercomputing Conference (SC2001), Denver, Colorado, USA, November 2001, pp. 59–59. ACM Press, New York (2001)
Fielding, R., et al.: Enabling Grids for E-sciencE (EGEE) (2006), http://www.eu-egee.org
Kunszt, P., Badino, P.: EGEE gLite User’s Guide - Overview of gLite Data Management. Technical report egee-tech-570643-v1.0, CERN, Geneva, Switzerland (2005)
GGF Grid File System working group (gfs-wg): https://forge.gridforum.org/projects/gfs-wg
GGF Grid File System working group (gfs-wg): The GGF Grid File System architecture workbook (January 2006), http://www.ggf.org/documents/GFD.61.pdf
Wei, B., Fedak, G., Cappello, F.: Collaborative Data Distribution with BitTorrent for Computational Desktop Grids. In: ISPDC ’05: Proceedings of the The 4th International Symposium on Parallel and Distributed Computing (ISPDC’05), Washington, DC, USA, pp. 250–257. IEEE Computer Society Press, Los Alamitos (2005)
Wei, B., Fedak, G., Cappello, F.: Scheduling Independent Tasks Sharing Large Data Distributed with BitTorrent. In: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, ACM Press, New York (2005)
Bhattacharyya, R.: Java FTP server, http://www.myjavaserver.com/~ranab/ftp
JSCH - Java Secure Channel: http://www.jcraft.com/jsch
Foster, I., et al.: A Security Architecture for Computational Grids. In: Proceedings of the 5th ACM Conference on Computer and Communications Security, San Francisco, California, USA, November 2-5, 1998, pp. 83–92. ACM Press, New York (1998)
Pereira, M., et al.: Resource Namespace Service specification (May (2006), http://www.ggf.org/GGF17/materials/272/Resource_Namespace_Service_Refactored.pdf.
Howard, J., et al.: Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems 6(1), 51–81 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Nguyen, TMH., Magoulès, F., Révillon, C. (2007). GRAVY: Towards Virtual File System for the Grid. In: Cérin, C., Li, KC. (eds) Advances in Grid and Pervasive Computing. GPC 2007. Lecture Notes in Computer Science, vol 4459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72360-8_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-72360-8_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72359-2
Online ISBN: 978-3-540-72360-8
eBook Packages: Computer ScienceComputer Science (R0)