Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computer Science, Engineering and Education Applications

ICCSEEA 2019: Advances in Computer Science for Engineering and Education II pp 301–315Cite as

Method of Distributed Two-Level Storage System Management in a Data Center

  • Conference paper
  • First Online:

  • 721 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 938))

Abstract

Modern applications in cloud computing, internet of things and machine learning are I/O intensive. They use data storage systems as the main resource of a data center. The advent of new storage technologies makes it possible to increase the performance of I/O operations by integrating devices with different performance within the data storage system by utilizing the storage-tiering approach. To prevent data loss and service downtime, the data storage systems must ensure fault tolerance using data replication management. As modern hybrid IT infrastructures are based on hyperconverged systems, the development of new methods and models for storage management in order to ensure high performance of I/O operations, high availability and fault tolerance becomes an urgent need. The authors propose the management method based on the model of a distributed two-level data storage system. The proposed method uses the algorithms for data migration between fast and slow levels of the data storage system and the algorithms for replication of data between the nodes of distributed data storage. The simulation results indicate that the proposed management method allows increasing performance of I/O operations with files and evenly placing replicas of data blocks on the data center nodes.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Newman, D.: Top 10 Digital Transformation Trends For 2019 Framework (2018). https://www.forbes.com/sites/danielnewman/2018/09/11/top-10-digital-transformation-trends-for-2019/#17d55d1e3c30. Accessed 22 Dec 2018

  2. DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., Vogels, W.: Dynamo: amazon’s highly available key-value store. In: ACM SIGOPS Operating Systems Review, vol. 41, no. 6, pp. 205–220 (2007)

    Google Scholar 

  3. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: SOSP’03 Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, vol. 37, no. 5, pp. 29–43 (2003)

    Google Scholar 

  4. Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The hadoop distributed file system. In: 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), vol. 11, pp. 1–21 (2010)

    Google Scholar 

  5. Calder, B., Wang, J., Ogus, A., Nilakantan, N., Skjolsvold, A., McKelvie, S., Haridas, J.: Windows Azure Storage: a highly available cloud storage service with strong consistency. In: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pp. 143–157 (2011)

    Google Scholar 

  6. Weil, S.A., Brandt, S.A., Miller, E.L., Long, D.D., Maltzahn, C.: Ceph: a scalable, high-performance distributed file system. In: Proceedings of the 7th Symposium on Operating Systems Design and Implementation, pp. 307–320. USENIX Association (2006)

    Google Scholar 

  7. Tanenbaum, A.S., Van Steen, M.: Distributed Systems: Principles and Paradigms. Prentice-Hall, Upper Saddle River (2007)

    MATH  Google Scholar 

  8. Shieh, F., Arani, M.G., Shamsi, M.: An extended approach for efficient data storage in cloud computing environment. Int. J. Comput. Netw. Inf. Secur. (IJCNIS) 7(8), 30–38 (2015). https://doi.org/10.5815/ijcnis.2015.08.04

    Article  Google Scholar 

  9. Kaur, P., Mahajan, M.: Integration of heterogeneous cloud storages through an intermediate WCF service. Int. J. Inf. Eng. Electron. Bus. (IJIEEB) 7(3), 45–51 (2015). https://doi.org/10.5815/ijieeb.2015.03.07

    Article  Google Scholar 

  10. Seera, N.K., Jain, V.: Perspective of database services for managing large-scale data on the cloud: a comparative study. Int. J. Mod. Educ. Comput. Sci. (IJMECS) 7(6), 50–58 (2015). https://doi.org/10.5815/ijmecs.2015.06.08

    Article  Google Scholar 

  11. Gregg, B.: ZFS L2ARC (2008). http://www.brendangregg.com/blog/2008-07-22/zfs-l2arc.html. Accessed 22 Dec 2018

  12. Chen, F., Koufaty, D.A., Zhang, X.: Hystor: making the best use of solid state drives in high performance storage systems. In: Proceedings of the International Conference on Supercomputing, pp. 22–32 (2011)

    Google Scholar 

  13. Guerra, J., Pucha, H., Glider, J.S., Belluomini, W., Rangaswami, R.: Cost effective storage using extent based dynamic tiering. In: FAST, vol. 11, pp. 1–14 (2011)

    Google Scholar 

  14. Arteaga, D., Zhao, M.: Client-side flash caching for cloud systems. In: Proceedings of International Conference on Systems and Storage, pp. 1–11 (2014)

    Google Scholar 

  15. Rolik, O., Telenyk, S., Zharikov, E.: Management of services of a hyperconverged infrastructure using the coordinator. In: Proceedings of International Conference on Theory and Applications of Fuzzy Systems and Soft Computing, pp. 456–467. Springer, Cham (2018)

    Google Scholar 

  16. Yang, Z., Hoseinzadeh, M., Andrews, A., Mayers, C., Evans, D.T., Bolt, R.T., Swanson, S.: AutoTiering: automatic data placement manager in multi-tier all-flash datacenter. In: 2017 IEEE 36th International Proceedings of Performance Computing and Communications Conference (IPCCC), pp. 1–8 (2017)

    Google Scholar 

  17. Bodanyuk, M.E., Karnaukhov, O.K., Rolik, O.I., Telenyk, S.F.: Management of data storage systems. Electron. Commun. 5(76), 81–90 (2013). (in Ukrainian)

    Article  Google Scholar 

  18. Ryu, J., Lee, D., Han, C., Shin, H., Kang, K.: File-system-level storage tiering for faster application launches on logical hybrid disks. IEEE Access 4, 3688–3696 (2016)

    Google Scholar 

  19. Kakoulli, E., Herodotou, H.: OctopusFS: a distributed file system with tiered storage management. In: Proceedings of the 2017 ACM International Conference on Management of Data, pp. 65–78 (2017)

    Google Scholar 

  20. Milani, B.A., Navimipour, N.J.: A comprehensive review of the data replication techniques in the cloud environments: major trends and future directions. J. Netw. Comput. Appl. 64, 229–238 (2016)

    Article  Google Scholar 

  21. Ibrahim, I.A., Dai, W., Bassiouni, M.: Intelligent data placement mechanism for replicas distribution in cloud storage systems. In: Proceedings of IEEE International Conference on Smart Cloud (SmartCloud), pp. 134–139 (2016)

    Google Scholar 

  22. Zhao, Y., Li, C., Li, L., Zhang, P.: Dynamic replica creation strategy based on file heat and node load in hybrid cloud. In: Proceedings of 19th International Conference on Advanced Communication Technology (ICACT), pp. 213–220 (2017)

    Google Scholar 

  23. Mansouri, N.: Adaptive data replication strategy in cloud computing for performance improvement. Front. Comput. Sci. 10(5), 925–935 (2016)

    Article  Google Scholar 

  24. Welford, B.P.: Note on a method for calculating corrected sums of squares and products. Technometrics 4(3), 419–420 (1962)

    Article  MathSciNet  Google Scholar 

  25. Russinovich, M.: Process Monitor (2018). https://docs.microsoft.com/en-us/sysinternals/downloads/procmon. Accessed 22 Dec 2018

Download references

Author information

Authors and Affiliations

  1. National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”, Kyiv, Ukraine

    Eduard Zharikov, Sergii Telenyk & Oleksandr Rolik

  2. Cracow University of Technology, Cracow, Poland

    Sergii Telenyk

Authors
  1. Eduard Zharikov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergii Telenyk
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oleksandr Rolik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eduard Zharikov .

Editor information

Editors and Affiliations

  1. School of Educational Information Technology, Central China Normal University, Wuhan, Hubei, China

    Zhengbing Hu

  2. Mechanical Engineering Research Institute of the Russian Academy of Sciences, Moscow, Russia

    Sergey Petoukhov

  3. “Igor Sikorsky Kiev Polytechnic Institute”, National Technical University of Ukraine, Kiev, Ukraine

    Ivan Dychka

  4. Halmos College of Natural Sciences and Oceanography, Nova Southeastern University, Ft. Lauderdale, FL, USA

    Matthew He

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zharikov, E., Telenyk, S., Rolik, O. (2020). Method of Distributed Two-Level Storage System Management in a Data Center. In: Hu, Z., Petoukhov, S., Dychka, I., He, M. (eds) Advances in Computer Science for Engineering and Education II. ICCSEEA 2019. Advances in Intelligent Systems and Computing, vol 938. Springer, Cham. https://doi.org/10.1007/978-3-030-16621-2_28

Download citation

Publish with us

Policies and ethics

Search

Navigation