Advertisement

A JDO Storage Cluster Based on Object Devices

  • Youhui Zhang
  • Dongsheng Wang
  • Chongnan Gao
  • Weimin Zheng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3252)

Abstract

Today’s Internet services demand the storage platform to possess high performance and simple programming interfaces. This paper presents the design and implementation of a distributed objects storage cluster system, which employs Network-Attached Object Storage Device as the low-level storage device to support structured-data directly to eliminate the problem of conventional storage systems. This system provides a unified, transparent and object-oriented view of the storage devices of the whole cluster and greatly simplifies distributed service development. Based on this system, an open source mail server is enhanced to be a distributed one while only a few source files are modified. Testing shows that the performance of this enhanced mail system can achieve 2/3 of the ideal upper limit, which is evidently higher than the original one based on file systems.

Keywords

File System Distribute Hash Table Mail Server Access Interface Object Storage 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gibson, G.A., Nagle, D.F., Courtright II, W., et al.: NASD Scalable Storage Systems. In: The Proceedings of USENIX 1999, Linux Workshop, Monterey, CA (1999)Google Scholar
  2. 2.
    Weber, R.O.: Information technology – SCSI object-based storage device commands (OSD). Technical Council Proposal Document T10/1355-D, Technical Committee T10 (2002)Google Scholar
  3. 3.
    Gibson, G.A., Welch, B.B., Nagel, D.F., Moxon, B.C.: Object Storage: Scalable Bandwidth for HPC Clusters. In: Proceedings of Cluster World Conference and Expo (2003)Google Scholar
  4. 4.
    Russell, C.: Java Data Objects 1.0 Proposed Final Draft, JSR12, Sun Microsystems Inc (2001), available from http://access1.sun.com/jdo
  5. 5.
    Apache James website, http://james.apache.org/
  6. 6.
    Saito, Y., Bershad, B.N., Levy, H.M.: Manageability, Availability and Performance in Porcupine: A Highly Scalable, Cluster-based Mail Service. In: Symposium on Operating Systems Principles (1999)Google Scholar
  7. 7.
    Gribble, S.D., Brewer, E.A., Hellerstein, J.M., Culler, D.: Scalable, Distributed Data Structures for Internet Service Construction. In: 4th Symposium on Operating System Design & Implementation, San Diego (2000)Google Scholar
  8. 8.
    Kubiatowicz, J., Bindel, D., Chen, Y., et al.: OceanStore: Architecture for Global- Scale Persistent Storage. In: Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2000 (2000)Google Scholar
  9. 9.
    Gibson, G.A., et al.: A Case for Network Attached Secure Disks, Tech. Report CMU-CS-96-142, Carnegie Mellon University (1996)Google Scholar
  10. 10.
    Shriver, E.: A Formalization of the Attribute Mapping Problem. HP Labs Technical Reports, HPL-1999-127Google Scholar
  11. 11.
    Riedel, E., Faloutsos, C., Gibson, G.A., et al.: Active Disks for Large-Scale Data Processing. IEEE Computer 34(6), 68–74 (2001)Google Scholar
  12. 12.
    Braam, P.J.: The Lustre storage architecture (2002), http://www.lustre.org/docs/lustre.pdf
  13. 13.
    Wang, F., Brandt, S.A., Miller, E.L., Long, D.D.E.: OBFS: A File System for Object-based Storage Devices. In: The 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2004), College Park, MD (2004)Google Scholar
  14. 14.
    Zhang, Y., Zheng, W.: Research on a new type of network-attached object based storage device. Tien Tzu Hsueh Pao/Acta Electronica Sinica 31(5) (2003)Google Scholar
  15. 15.
    Sleepycat Software Inc., Berkeley DB Programmer’s Tutorial and Reference Guide (2001), available at http://www.sleepycat.com

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Youhui Zhang
    • 1
  • Dongsheng Wang
    • 1
  • Chongnan Gao
    • 1
  • Weimin Zheng
    • 1
  1. 1.Institute of High Performance Computing Technology, Dept. of Computer ScienceTsinghua UnivBeijingP.R. China

Personalised recommendations