Advertisement

An Efficient Data Management System with High Scalability for ChinaGrid Support Platform

  • Hai Jin
  • Wenjun Gong
  • Song Wu
  • Muzhou Xiong
  • Li Qi
  • Chengwei Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3756)

Abstract

There are a great number of data intensive applications in ChinaGrid. They require an efficient and high performance data management. The data management in ChinaGrid Support Platform (CGSP) supplies a data access mechanism with location transparency, name transparency, and protocol transparency as while as ensuring the transfer efficiency. The data management system consists of five parts: the storage data server based on Global Distributed Storage System to guarantee the reliability and performance of data transfer; the storage resource agent to discover, publish and catalog the storage resources; the data logical domain management to enable applications to select specific storage resources; the metadata management to publish, query and access metadata; and the uniform data access entry to organize grid users’ data space. We present the design philosophy of the efficient data management system with high scalability for CGSP and also give preliminary performance results.

Keywords

Data Transfer Data Management System High Scalability Logical File Storage Resource 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Barish, B.C., Weiss, R.: LIGO and the Detection of Gravitational Waves. Physics Today 52, 44 (1999)CrossRefGoogle Scholar
  2. 2.
    Wulz, C.-E.: CMS – Concept and Physics Potential. In: Proceedings II-SILAFAE, San Juan, Puerto Rico (1998)Google Scholar
  3. 3.
  4. 4.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications 15 (2001)Google Scholar
  5. 5.
    Jin, H.: ChinaGrid: Making Grid Computing a Reality. In: Chen, Z., Chen, H., Miao, Q., Fu, Y., Fox, E., Lim, E.-p. (eds.) ICADL 2004. LNCS, vol. 3334, pp. 13–24. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Jin, H., Ran, L., Wang, Z., Huang, C., Chen, Y., Zhou, R., Jia, Y.: Architecture Design of Global Distributed Storage System for Data Grid. High Technology Letters 9(4), 1–4 (2003)Google Scholar
  7. 7.
  8. 8.
    ChinaGrid Support Platform, http://www.chinagrid.edu.cn/CGSP
  9. 9.
    CGSP Work Group, Design Specification of ChinaGrid Support Platform. Tsinghua University Press, Beijing, China (2004)Google Scholar
  10. 10.
    Singh, G., Bharathi, S., Chervenak, A., Deelman, E., Kesselman, C., Mahohar, M., Pail, S., Pearlman, L.: A Metadata Catalog Service for Data Intensive Applications. In: Proceedings of Supercomputing (SC 2003) (November 2003)Google Scholar
  11. 11.
    The Web Services Resource Framework, http://www.globus.org/wsrf/
  12. 12.
    Deelman, E., Singh, G., Atkinson, M.P., Chervenak, A., Hong, N.P.C., Kesselman, C., Patil, S., Pearlman, L., Su, M.: Grid-Based Metadata Services. In: Proceedings of 16th International Conference on Scientific and Statistical Database Management (SSDBM 2004), June 2004, p. 393 (2004)Google Scholar
  13. 13.
    Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Resource Broker. In: Proc. CASCON 1998 Conference (1998)Google Scholar
  14. 14.
    MCAT, MCAT – A Meta Information Catalog (Version 1.1), http://www.npaci.edu/DICE/SRB/mcat.html
  15. 15.
  16. 16.
  17. 17.
    Allcock, B., Bester, J., Bresnahan, J., Chervenak, A., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., Tuecke, S.: Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In: Proceedings of IEEE Mass Storage Conference (2001)Google Scholar
  18. 18.
    Allcock, W.E., Foster, I., Madduri, R.: Reliable Data Transport: A Critical Service for the Grid. In: Building Service Based Grids Workshop, Global Grid Forum 11 (June 2004)Google Scholar
  19. 19.
    Ripeanu, M., Foster, I.: A Decentralized, Adaptive, Replica Location Service. In: Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland, July 24-16 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Hai Jin
    • 1
  • Wenjun Gong
    • 1
  • Song Wu
    • 1
  • Muzhou Xiong
    • 1
  • Li Qi
    • 1
  • Chengwei Wang
    • 1
  1. 1.Cluster and Grid Computing Lab.Huazhong University of Science and TechnologyWuhanChina

Personalised recommendations