Analysis of Block-Level Data Deduplication on Cloud Storage

  • L. SureshEmail author
  • M. A. Bharathi
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 904)


Data storage in the cloud is of prime importance for organizations, individuals, business as the storage of data is increasing exponentially. In the modern era, multiple data blocks of files across the sectors of storage disk are duplicated. Deduplication is a common technique for reducing a large amount of duplicate data. Deduplication storage optimization technique is an efficient method of reducing the chunks with pointer address mapping single instance across the storage data disk. Network transfer protocol for deduplication is major impact factor for performance. Network bandwidth, disk storage optimizations are parameters for real time data transfer in the deduplication protocol. In this analysis, we are examining the secure deduplication on cloud storage data on fixed block level and file level deduplication with new Protocol for transferring the data to cloud storage. Client–Server data transfer model architecture for deduplication technique will be analyzed for the new protocol data transfer.


Deduplication Cloud storage Block level Dedupe 


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
    Kim. D., Song, S., Choi, B.: Data Deduplication for Data Optimization for Storage and Network Systems. Springer, New York (2017)Google Scholar
  6. 6.
    Venish, A., Sankar, K.S.: Study of Chunking Algorithm in Data Deduplication, vol. 743, p. 343. Springer (2016). ISBN 978-81-322-2672-7Google Scholar
  7. 7.
    Douglis, F., Fu, M., Zhang, Y., Zhou, Y.: A Comprehensive Study of the Past, Present, and Future of Data Deduplication. IEEE Proceedings (2016)Google Scholar
  8. 8.
  9. 9.
    Wang1, S., Zhang2, Y., Zhang3, Y.: A blockchain-based framework for data sharing with fine-grained access control in decentralized storage systems. In: IEEE Translations and Content Mining (2018)Google Scholar
  10. 10.
    Wang, S., Du, J., Wu, J., Wang, R., Lv, J., Ma, S.: A storage solution for multimedia files to support data deduplication. In: CCIOT (2016)Google Scholar
  11. 11.
    Su, H., Zheng, D., Zhang, Y.: An efficient and secure deduplication scheme based on Rabin fingerprinting in cloud storage. In: IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) (2017)Google Scholar
  12. 12.
    Haoran, W., Weiqin, T., Shengan, Z.: A data deduplication method in the cloud storage based on FP-tree. In: 4th International Conference on Computer Science and Network Technology (ICCSNT 2015) (2015)Google Scholar
  13. 13.
    Cho E.M., Sakura-ku, Koshiba, T.: Big data cloud deduplication based on verifiable hash convergent group signcryption. In: IEEE Third International Conference on Big Data Computing Service and Application (2017)Google Scholar
  14. 14.
    Wua, S., Lic, K.-C., Maob, B., Liaob, M.: DAC: improving storage availability with deduplication-assisted cloud-of-clouds. Future Gener. Comput. Syst. (2016)Google Scholar
  15. 15.
    Kai, H., Chuanhe, H., Hao, Z., Jiaoli, S., Xiaomao, W., Feng, D.: Public Auditing for Encrypted Data with Client-Side Deduplication in Cloud Storage, vol. 20 No. 4, pp. 291–298. Wuhan University and Springer, Berlin (2015)Google Scholar
  16. 16.
    Gai, K., Qiu, M.K., Sun, X.T.: Smart data deduplication for telehealth systems in heterogeneous cloud computing. J. Commun. Inf. Netw. 1(4), 93–104 (2016)CrossRefGoogle Scholar
  17. 17.
    Yan, Z., Zhang, L., Ding, W., Zheng, Q.: Heterogeneous data storage management with deduplication in cloud computing. IEEE Trans. Big Data (2017)Google Scholar
  18. 18.
    Xu, X., Hu, N., Tu, Q.: Two-side data deduplication mechanism for non- center cloud storage systems. IEEE (2016)Google Scholar
  19. 19.
    Ma, J., Wang, G., Liu, X.: DedupeSwift: object-oriented storage system based on data deduplication. In: IEEE TrustCom-BigDataSE-ISPA (2016)Google Scholar
  20. 20.
    Zhou, B., We, J.-T.: Metadata feedback and utilization for data deduplication across WAN. J. Comput. Sci. Technol. 31(3), 604–623 (2016)CrossRefGoogle Scholar
  21. 21.
    Venish, A., Siva Sankar, K., Study of Chunking Algorithm in Data Deduplication. Spinger, India (2016)Google Scholar
  22. 22.
    Zhou, B., Wen, J.-T.: Improving metadata caching efficiency for data deduplication via in-RAM metadata utilization. J. Comput. Sci. Technol. 31(3), 604–623 (2016). Appendix: Springer-Author DiscountGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of Computer ScienceBMSIT & MBangaloreIndia

Personalised recommendations