CRL: Efficient Concurrent Regeneration Codes with Local Reconstruction in Geo-Distributed Storage Systems
- 23 Downloads
As a typical erasure coding choice, Reed-Solomon (RS) codes have such high repair cost that there is a penalty for high reliability and storage efficiency, thereby they are not suitable in geo-distributed storage systems. We present a novel family of concurrent regeneration codes with local reconstruction (CRL) in this paper. The CRL codes enjoy three benefits. Firstly, they are able to minimize the network bandwidth for node repair. Secondly, they can reduce the number of accessed nodes by calculating parities from a subset of data chunks and using an implied parity chunk. Thirdly, they are faster than existing erasure codes for reconstruction in geo-distributed storage systems. In addition, we demonstrate how the CRL codes overcome the limitations of the Reed-Solomon codes. We also illustrate analytically that they are excellent in the trade-off between chunk locality and minimum distance. Furthermore, we present theoretical analysis including latency analysis and reliability analysis for the CRL codes. By using quantity comparisons, we prove that CRL(6, 2, 2) is only 0.657x of Azure LRC(6, 2, 2), where there are six data chunks, two global parities, and two local parities, and CRL(10, 4, 2) is only 0.656x of HDFS-Xorbas(10, 4, 2), where there are 10 data chunks, four local parities, and two global parities respectively, in terms of data reconstruction times. Our experimental results show the performance of CRL by conducting performance evaluations in both two kinds of environments: 1) it is at least 57.25% and 66.85% more than its competitors in terms of encoding and decoding throughputs in memory, and 2) it has at least 1.46x and 1.21x higher encoding and decoding throughputs than its competitors in JBOD (Just a Bunch Of Disks). We also illustrate that CRL is 28.79% and 30.19% more than LRC on encoding and decoding throughputs in a geo-distributed environment.
Keywordsconcurrent regeneration code local reconstruction geo-distributed storage system
Unable to display preview. Download preview PDF.
We thank the referees for their insightful reviews. Cloud computing resources were provided by a Microsoft Azure for Research award.
- Rashmi K V, Shah N B, Gu D, Kuang H, Borthakur D, Ramchandran K. A “hitchhiker’s” guide to fast and efficient data reconstruction in erasure-coded data centers. In Proc. the 2014 ACM Conference on SIGCOMM, Aug. 2014, pp.331-342.Google Scholar
- Huang C, Simitci H, Xu Y, Ogus A, Calder B, Gopalan P, Li J, Yekhanin S. Erasure coding in windows Azure storage. In Proc. the 2012 USENIX Annual Technical Conference, Jun. 2012, pp.15-26.Google Scholar
- Xu Q, Xi W, Yong K L, Jin C. Concurrent regeneration code with local reconstruction in distributed storage systems. In Advanced Multimedia and Ubiquitous Engineering, Park J J, Chao H C, Arabnia H, Yen N Y (eds.), Springer Berlin Heidelberg, 2016, pp.415-422.Google Scholar
- Wu Y, Dimakis A G. Reducing repair traffic for erasure coding-based storage via interference alignment. In Proc. the 2009 IEEE International Symposium on Information Theory (ISIT), Jun. 2009, pp.2276-2280.Google Scholar
- Cook J D, Primmer R, de Kwant A. Compare cost and performance of replication and erasure coding. Hitachi Review, 2014, 63: 304-310.Google Scholar
- Ford D, Labelle F, Popovici F I, Stokely M, Truong V, Barroso L, Grimes C, Quinlan S. Availability in globally distributed storage systems. In Proc. the 9th USENIX Symposium on Operating Systems Design and Implementation, Oct. 2010, pp.61-74.Google Scholar
- Weatherspoon H, Kubiatowicz J. Erasure coding vs. replication: A quantitative comparison. In Proc. the 1st International Workshop on Peer-to-Peer Systems, Mar. 2002, pp.328-338.Google Scholar
- Tian J, Yang Z, Dai Y. A data placement scheme with time-related model for P2P storages. In Proc. the 7th IEEE International Conference on Peer-to-Peer Computing, Sept. 2007, pp.151-158.Google Scholar
- Kermarrec A, Scouarnec N L, Straub G. Repairing multiple failures with coordinated and adaptive regenerating codes. In Proc. the 2011 International Symposium on Networking Coding, Jul. 2011.Google Scholar
- Shum K W, Hu Y. Exact minimum-repair-bandwidth cooperative regenerating codes for distributed storage systems. In Proc. the 2011 IEEE International Symposium on Information Theory Proceedings, Jul. 2011, pp.1442-1446.Google Scholar
- Xu Q, Ng H W, Xi W, Jin C. Effective local reconstruction codes based on regeneration for large-scale storage systems. In Proc. the 2018 Future of Information and Communication Conference, Apr. 2018, pp.501-507.Google Scholar