Skip to main content
SpringerLink
Log in

A Content-Based Load Balancing Algorithm for Metadata Servers in Cluster File Systems

  • Conference paper
Parallel and Distributed Processing and Applications (ISPA 2005)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3758))

  • 547 Accesses

Abstract

A metadata service is one of the important factors to affect the performance of cluster file systems. We propose a content-based load balancing algorithm that dynamically distributes client requests to appropriate metadata servers based on the types of metadata operations. By replicating metadata and logging update messages in each server rather than moving metadata across servers, we significantly reduce the response time and evenly distribute client requests among metadata servers.

This work was supported by grant No. R01-2003-000-10627-0 from the Basic Research Program of the Korea Science & Engineering Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. SPEC, SFS 3.0 Documentation Version 1.0, Standard Performance Evaluation Corporation (2001)

    Google Scholar 

  2. Corbett, P.F., et al.: The vesta parallel file system. ACM Transactions on Computer Systems (TOCS) 14(3), 225–264 (1996)

    Article  Google Scholar 

  3. Brandt, S.A., et al.: Efficient Metadata Management in Large Distributed Storage Systems. In: Proceedings of the 11th IEEE NASA Goddard Conference on Mass Storage Systems and Technologies (April 2003)

    Google Scholar 

  4. Braam, P.J., et al.: The Lustre Storage Architecture, Cluster File Architecture. Cluster File System. Inc (March 2003)

    Google Scholar 

  5. Xiong, J., et al.: Design and Performance of the Dawning Cluster File System. In: IEEE International Conference on Cluster Computing(Cluster 2003) (December 2003)

    Google Scholar 

  6. Bourke, T.: Server Load Balancing. O’Reilly and Associates, Sebastopol (2001)

    Google Scholar 

  7. Bovet, D.P., et al.: Understanding the Linux Kernel. O’Reilly and Associates, Sebastopol (2003)

    Google Scholar 

  8. http://www.mesquite.com

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and, Interdisciplinary Program of Integrated Biotechnology, Sogang University, Seoul, Korea

    Junho Jang, Saeyoung Han, Sungyong Park & Jihoon Yang

Authors
  1. Junho Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saeyoung Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sungyong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jihoon Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of CS, Georgia State University, 30302, Atlanta, GA, USA

    Yi Pan

  2. State Key Laboratory for Novel Software Technology, Nanjing University, 210093, Nanjing, Jiangsu, China

    Daoxu Chen

  3. Department of Computer Science and Engineering, Shanghai Jiao Tong University, 200030, Shanghai, China

    Minyi Guo

  4. Department of Computing, Hong Kong Polytechnic University, Kowloon, Hong Kong, China

    Jiannong Cao

  5. Computer Science Department, University of Tennessee, 37996-3450, Knoxville, TN, USA

    Jack Dongarra

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jang, J., Han, S., Park, S., Yang, J. (2005). A Content-Based Load Balancing Algorithm for Metadata Servers in Cluster File Systems. In: Pan, Y., Chen, D., Guo, M., Cao, J., Dongarra, J. (eds) Parallel and Distributed Processing and Applications. ISPA 2005. Lecture Notes in Computer Science, vol 3758. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11576235_9

Download citation

  • DOI: https://doi.org/10.1007/11576235_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29769-7

  • Online ISBN: 978-3-540-32100-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation