Skip to main content
SpringerLink
Log in

A Zones-Based Metadata Management Method for Distributed File System

  • Conference paper
  • First Online:
Trustworthy Computing and Services (ISCTCS 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 426))

Included in the following conference series:

Abstract

It is challengeable for the single server to manage the large metadata in MooseFS which is full of small files. This paper proposes a zones-based metadata management (ZMM) method for distributed file system. ZMM changes a single metadata server into a cluster, which includes a zone server and several sub-metadata servers. We tested ZMM in the platform named SandBox and the results shown that the throughput of writing and reading metadata was improved by using ZMM compared with using the single metadata server in MooseFS. With the increase of sub-metadata servers, the throughput of writing and reading metadata was improved as well.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wang, J., Feng, D., Wang, F., et al.: MHS: a distributed metadata management strategy. J. Syst. Softw. 82(3), 2004–2011 (2009)

    Article  Google Scholar 

  2. Ousterhout, J.K., Costa, H.D., Harrison, D., et al.: A trace-driven analysis of the Unix4.2 BSD file system. In: Proceedings of the 10th ACM Symposium on Operating Systems Principles (SOSP’85), vol. 12, pp. 15–24 (1985)

    Google Scholar 

  3. Pei, X.: Study on metadata management strategy in distributed file system, Wuhan, China (2010)

    Google Scholar 

  4. Patil, S.V., Gibson, G., Lang, S., et al.: Giga+: scalable directories for shared file system. In: PDSW’07: Proceedings of 2nd International Workshop on Petascale Data Storage, pp. 26–29 (2007)

    Google Scholar 

  5. Ghemawat, S., Gobioff, H., Leung, S.T.: The google file system. In: SOSP’03: Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, New York, NY, USA, pp. 29–43 (2003)

    Google Scholar 

  6. Shafer, J., Rixner, S., Cox, A.L.: The Hadoop distributed filesystem: balancing portability and performance. In: Proceedings: ISPASS 2010, Houstan, TX, pp. 122–133. IEEE (2010)

    Google Scholar 

  7. MooseFS, 20 Aug 2012. http://www.moosefs.org/

  8. Brandt, S.A., Xue, L., Miller. E.L., et al.: Efficient metadata management in large distributed file system. In: Miller, E., Meter, R.V., (eds.) Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 290–298. IEEE Computer Society, San Diego (2003)

    Google Scholar 

  9. Morris, J.H., Satyanarayanan, M., Conner, M.H., et al.: Andrew: a distributed personal computing environment. Commun. ACM 29(3), 184–201 (1986)

    Article  Google Scholar 

Download references

Acknowledgement

This research was supported by National 863 Program (No. 2011AA01A204).

Author information

Authors and Affiliations

  1. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China

    Xiaowei Xie, Yu Yang & Yueming Lu

  2. Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of Education, Beijing, China

    Xiaowei Xie, Yu Yang & Yueming Lu

Authors
  1. Xiaowei Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yu Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yueming Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaowei Xie .

Editor information

Editors and Affiliations

  1. Beijing University of Posts and Telecommunications, Beijing, China

    Yuyu Yuan

  2. Beijing University of Posts and Telecommunications, Beijing, China

    Xu Wu

  3. Beijing University of Posts and Telecommunications, Beijing, China

    Yueming Lu

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Xie, X., Yang, Y., Lu, Y. (2014). A Zones-Based Metadata Management Method for Distributed File System. In: Yuan, Y., Wu, X., Lu, Y. (eds) Trustworthy Computing and Services. ISCTCS 2013. Communications in Computer and Information Science, vol 426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43908-1_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-43908-1_22

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-43907-4

  • Online ISBN: 978-3-662-43908-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation