Abstract
Over the past few years, network coding has been employed in data reconstruction process of storage systems to minimize the recovery bandwidth. However, the time consumption of the decoding operations incurs a significant performance degradation. In this paper, we propose a data temperature-based reconstruction optimization algorithm and integrate it into the reconstruction process of a Network-Coding-Based File System (NCFS) which adopts regenerating code as its storage coding scheme. We conduct extensive experiments to evaluate the impacts on the data reconstruction process of regenerating codes. The experimental results demonstrate that our method outperforms the conventional approach both in reconstruction time, throughput and average response time with up to 33.17%, 60.61%, 37.77% improvement, respectively.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Ghemawat, S., Gobioff, H., Leung, S.: The Google File System. In: Proc. of ACM SOSP (December 2003)
DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., Vogels, W.: Dynamo: Amazon’s Highly Available Key-Value Store. In: Proc. of ACM SOSP (2007)
Calder, B., Wang, J., Ogus, A., Nilakantan, N., Skjolsvold, A., McKelvie, S., Xu, Y., Srivastav, S., Wu, J., Simitci, H., et al.: Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency. In: Proc. of ACM SOSP (October 2011)
Rodrigues, R., Liskov, B.: High availability in DHTs: Erasure coding vs.replication. In: IPTPS (2005)
Weatherspoon, H., Kubiatowicz, J.D.: Erasure coding vs. replication: A quantitative comparison. In: IPTPS (2002)
Dimakis, A.G., Godfrey, P.B., Wu, Y., Wainwright, M., Ramchandran, K.: Network Coding for Distributed Storage Systems. IEEE Trans. on Information Theory 56(9), 4539–4551 (2010)
Ahlswede, R., Cai, N., Li, S.-Y.R., Yeung, R.W.: Network Information Flow. IEEE Trans. on Information Theory 46(4), 1204–1216 (2000)
Rashmi, K., Shah, N., Kumar, P.: Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix Construction. IEEE Trans. on Information Theory 57(8), 5227–5239 (2011)
Rashmi, K.V., Shah, N.B., Kumar, P.V., Ramchandran, K.: Explicit Construction of Optimal Exact Regenerating Codes for Distributed Storage. In: Proc. of Allerton Conference (2009)
Suh, C., Ramchandran, K.: Exact-Repair MDS Code Construction using Interference Alignment. IEEE Trans. on Information Theory 57(3), 1425–1442 (2011)
Hu, Y., Yu, C.-M., Li, Y.-K., Lee, P.P.C., Lui, J.C.S.: NCFS: On the Practicality and Extensibility of a Network-Coding-Based Distributed File System. In: Proc. of NetCod (2011)
Duminuco, A., Biersack, E.: A Practical Study of Regenerating Codes for Peer-to-Peer Backup Systems. In: Proc. of IEEE ICDCS 2009 (2009)
Dimakis, A.G., Ramchandran, K., Wu, Y., Suh, C.: A survey on network codes for distributed storage. In: arXiv:1004.4438v1 [cs.IT] (2010)
Rashmi, K.V., Shah, N.B., Kumar, P.V.: Optimal exact-regenerating codes for distributed storage at the msr and mbr points via a productmatrix construction. In: arXiv:1005.4178v1 [cs.IT] (2010)
Rashmi, K.V., Shah, N.B., Kumar, P.V., Ramchandran, K.: Explicit construction of optimal exact regenerating codes for distributed storage. In: Proc. of Allerton Conference (2009)
Suh, C., Ramchandran, K.: Exact-repair mds codes for distributed storage using interference alignment. In: Proc. of IEEE ISIT (2010)
Tian, L., Feng, D., Jiang, H., Zhou, K., Zeng, L., Chen, J., Wang, Z., Song, Z.: PRO: A Popularity-based Multi-threaded Reconstruction Optimization for RAID-Structured Storage Systems. In: FAST 2007, San Jose, CA (February 2007)
Breslau, L.: Pei Cao, Li Fan, G. Phillips, S Shenker. Web Caching and Zipf-like Distributions: Evidence and Implications. In: Proc. of IEEE INFORCOM (March 1999)
Wu, Y., Dimakis, A.G., Ramchandran, K.: Deterministic Regenerating codes for distributed storage. In: Proc. Allerton Conference on Control, Computing and Communication, Urbana-Champaign, IL (September 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Li, K., Deng, Y. (2014). Accelerating the Reconstruction Process in Network Coding Storage System by Leveraging Data Temperature. In: Hsu, CH., Shi, X., Salapura, V. (eds) Network and Parallel Computing. NPC 2014. Lecture Notes in Computer Science, vol 8707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44917-2_42
Download citation
DOI: https://doi.org/10.1007/978-3-662-44917-2_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44916-5
Online ISBN: 978-3-662-44917-2
eBook Packages: Computer ScienceComputer Science (R0)