Abstract
Today’s Internet services demand the storage platform to possess high performance and simple programming interfaces. This paper presents the design and implementation of a distributed objects storage cluster system, which employs Network-Attached Object Storage Device as the low-level storage device to support structured-data directly to eliminate the problem of conventional storage systems. This system provides a unified, transparent and object-oriented view of the storage devices of the whole cluster and greatly simplifies distributed service development. Based on this system, an open source mail server is enhanced to be a distributed one while only a few source files are modified. Testing shows that the performance of this enhanced mail system can achieve 2/3 of the ideal upper limit, which is evidently higher than the original one based on file systems.
Supported by High Technology and Development Program of China (No. 2002AA1Z2103).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gibson, G.A., Nagle, D.F., Courtright II, W., et al.: NASD Scalable Storage Systems. In: The Proceedings of USENIX 1999, Linux Workshop, Monterey, CA (1999)
Weber, R.O.: Information technology – SCSI object-based storage device commands (OSD). Technical Council Proposal Document T10/1355-D, Technical Committee T10 (2002)
Gibson, G.A., Welch, B.B., Nagel, D.F., Moxon, B.C.: Object Storage: Scalable Bandwidth for HPC Clusters. In: Proceedings of Cluster World Conference and Expo (2003)
Russell, C.: Java Data Objects 1.0 Proposed Final Draft, JSR12, Sun Microsystems Inc (2001), available from http://access1.sun.com/jdo
Apache James website, http://james.apache.org/
Saito, Y., Bershad, B.N., Levy, H.M.: Manageability, Availability and Performance in Porcupine: A Highly Scalable, Cluster-based Mail Service. In: Symposium on Operating Systems Principles (1999)
Gribble, S.D., Brewer, E.A., Hellerstein, J.M., Culler, D.: Scalable, Distributed Data Structures for Internet Service Construction. In: 4th Symposium on Operating System Design & Implementation, San Diego (2000)
Kubiatowicz, J., Bindel, D., Chen, Y., et al.: OceanStore: Architecture for Global- Scale Persistent Storage. In: Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2000 (2000)
Gibson, G.A., et al.: A Case for Network Attached Secure Disks, Tech. Report CMU-CS-96-142, Carnegie Mellon University (1996)
Shriver, E.: A Formalization of the Attribute Mapping Problem. HP Labs Technical Reports, HPL-1999-127
Riedel, E., Faloutsos, C., Gibson, G.A., et al.: Active Disks for Large-Scale Data Processing. IEEE Computer 34(6), 68–74 (2001)
Braam, P.J.: The Lustre storage architecture (2002), http://www.lustre.org/docs/lustre.pdf
Wang, F., Brandt, S.A., Miller, E.L., Long, D.D.E.: OBFS: A File System for Object-based Storage Devices. In: The 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2004), College Park, MD (2004)
Zhang, Y., Zheng, W.: Research on a new type of network-attached object based storage device. Tien Tzu Hsueh Pao/Acta Electronica Sinica 31(5) (2003)
Sleepycat Software Inc., Berkeley DB Programmer’s Tutorial and Reference Guide (2001), available at http://www.sleepycat.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Wang, D., Gao, C., Zheng, W. (2004). A JDO Storage Cluster Based on Object Devices. In: Jin, H., Pan, Y., Xiao, N., Sun, J. (eds) Grid and Cooperative Computing - GCC 2004 Workshops. GCC 2004. Lecture Notes in Computer Science, vol 3252. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30207-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-30207-0_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23578-1
Online ISBN: 978-3-540-30207-0
eBook Packages: Springer Book Archive