Advertisement

The Design and Implementation of Random Linear Network Coding Based Distributed Storage System in Dynamic Networks

  • Bin He
  • Jin Wang
  • Jingya Zhou
  • Kejie Lu
  • Lingzhi Li
  • Shukui Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11337)

Abstract

Nowadays, different end devices with different computation and bandwidth capabilities acquire data from Internet. To improve efficiency of data storage and retrieve, in this paper, we study how to use random linear network coding to construct an efficient distributed storage system to reduce the traffic cost in a dynamic network. In order to balance the success ratio of recovery traffic cost and traffic speed, we firstly introduce a random network coding scheme and implement a practically available distributed storage system in the actual environment. We then adjust different parameters, e.g., finite fields, link bandwidth, node computing capabilities, etc., to evaluate the proposed system. Finally, experiment results show the efficiency of the proposed designs.

Keywords

Random linear network coding Distributed storage system Dynamic networks 

References

  1. 1.
    Buyya, R., Cortes, T., Jin, H.: A Case for Redundant Arrays of Inexpensive Disks (RAID), vol. 17, no. 3, pp. 109–116. ACM (1988)Google Scholar
  2. 2.
    Ahlswede, R., Cai, N., Li, S.Y.R., Yeung, R.W.: Network information flow. Proc. IEEE Trans. Inf. Theory 46(4), 1204–1216 (2000)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Dimakis, A.G., Godfrey, P.B., Wainwright, M.J., Ramchandran, K.: Network coding for distributed storage systems. In: Proceedings of IEEE International Conference on Computer Communications (INFOCOM), vol. 56, pp. 2000–2008 (2007)Google Scholar
  4. 4.
    Dimakis, A.G., Ramchandran, K., Wu, Y., Suh, C.: A survey on network codes for distributed storage. Proc. IEEE 99(3), 476–489 (2011)CrossRefGoogle Scholar
  5. 5.
    Liu, F., Shen, S., Li, B., Li, B., Jin, H.: Cinematic-quality vod in a p2p storage cloud: design, implementation and measurements. IEEE J. Sel. Areas Commun. (JSAC) 31(9), 214–226 (2013)CrossRefGoogle Scholar
  6. 6.
    Zhang, Y., Dragga, C., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Viewbox: integrating local file systems with cloud storage services. In: Proceedings of File and Storage Technologies, vol. 49, pp. 119–132 (2014)Google Scholar
  7. 7.
    Weil, S.A., Brandt, S.A., Miller, E.L., Long, D.D., Maltzahn, C.: Ceph: a scalable, high-performance distributed file system. In: Proceedings of Operating Systems Design and Implementation, pp. 307–320 (2006)Google Scholar
  8. 8.
    Hu, W., Yang, T., Matthews, J.N.: The good, the bad and the ugly of consumer cloud storage. ACM SIGOPS Oper. Syst. Rev. 44(3), 110–115 (2010)CrossRefGoogle Scholar
  9. 9.
    Muthitacharoen, A., Chen, B.: A low-bandwidth network file system. In: Proceedings of Symposium on Operating Systems Principles, vol. 35, no. 5, pp. 174–187 (2001)Google Scholar
  10. 10.
    Bowers, K.D., Juels, A., Oprea, A.: A high-availability and integrity layer for cloud storage. In: Proceedings of Computer and Communications Security (CCS), pp. 187–198 (2009)Google Scholar
  11. 11.
    Shvachko, K., Kuang, H., Radia, S., Chansler, R., Shvachko, K.: The hadoop distributed file system mass storage systems and technologies. In: Proceedings of Mass Storage Systems and Technology (MSST) (2010)Google Scholar
  12. 12.
    Fitzek, F.H.P., Toth, T., Szabados, A., Pedersen, M.V.: Implementation and performance evaluation of distributed cloud storage solutions using random linear network coding. In: IEEE International Conference on Proceedings of Communications Workshops (ICC), pp. 249–254. IEEE (2014)Google Scholar
  13. 13.
    Sipos, M., Fitzek, F.H.P., Lucani, D.E., Pedersen, M.V.: Distributed cloud storage using network coding. In: Proceedings of Consumer Communications and Networking Conference (CCNC), pp. 127–132 (2014)Google Scholar
  14. 14.
    Dimakis, A.G., Godfrey, P.B., Wainwright, M.J., Ramchandran, K.: Network coding for distributed storage systems. IEEE Trans. Inf. Theory 56(9), 4539–4551 (2010)CrossRefGoogle Scholar
  15. 15.
    Chen, H.C.H., Hu, Y., Lee, P.P.C., Tang, Y.: NCCloud: a network-coding-based storage system in a cloud-of-clouds. IEEE Trans. Comput. 63(1), 31–44 (2014)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Shwe, H.Y., Chong, P.H.J.: Scalable distributed cloud data storage service for internet of things. In: Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress, pp. 869–873 (2016)Google Scholar
  17. 17.
    Wang, J., Wang, J., Lu, K., Xiao, B., Gu, N.: Optimal linear network coding design for secure unicast with multiple streams. In: Proceedings of Information Communications (INFOCOM), pp. 2240–2248 (2010)Google Scholar
  18. 18.
    Wang, J., Wang, J., Lu, K., Xiao, B., Gu, N.: Modeling and optimal design of linear network coding for secure unicast with multiple streams. IEEE Trans. Parallel Distrib. Syst. 24(10), 2025–2035 (2013)CrossRefGoogle Scholar
  19. 19.
    Wang, J., Wang, X., Zhang, S., Zhu, Y., Jia, J.: An efficient reliable communication scheme in wireless sensor networks using linear network coding. Int. J. Distrib. Sensor Netw. pp. 487–513 (2012)Google Scholar
  20. 20.
    Chuang, C., Yung, K.: Network dynamics, network resources and innovation. In: Proceedings of Academy of Management Annual Meeting (2008)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Bin He
    • 1
  • Jin Wang
    • 1
    • 2
  • Jingya Zhou
    • 1
    • 2
  • Kejie Lu
    • 3
  • Lingzhi Li
    • 1
    • 2
  • Shukui Zhang
    • 1
    • 2
  1. 1.Department of Computer Science and TechnologySoochow UniversitySuzhouPeople’s Republic of China
  2. 2.Provincial Key Laboratory for Computer Information Processing TechnologySoochow UniversitySuzhouPeople’s Republic of China
  3. 3.Department of Computer Science and EngineeringUniversity of Puerto Rico at MayagüezMayagüezUSA

Personalised recommendations