Abstract
With the advent of the 5G, more and more applications use cloud storage to store data. Data becomes the cornerstone of the development of smart society. At the same time, these data have the characteristics of uneven generation rate, large write demand and low read requirement. The dynamic change of load during data storage has new requirements for storage architecture. This paper proposes a storage system that allocates strips in real time based on current load changes. Based on the traditional RAID layout, a dual-engine based high-performance storage system (DSH) is proposed. This system uses software and hardware co-processing architecture to implement strip allocation and address calculation. The strip allocation functions using software and the verification algorithm is implemented by hardware transfer to the FPGA through PCIE. Through experimental analysis shows that the DSH algorithm has a great advantage in saving CPU computing resources and saving disk energy consumption in the dynamic load storage environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Meng, X., Ci, X.: Big data management: concepts, techniques and challenges. J. Comput. Res. Dev. 50(01), 146–169 (2013). (in Chinese)
Chen, P.M., Lee, E.K., Gibson, G.A., et al.: RAID: high-performance, reliable secondary storage. ACM Comput. Surv. 26(2), 145–185 (1994)
Luo, S., Zhang, G., Wu, C., et al.: Boafft: distributed deduplication for big data storage in the cloud. IEEE Trans. Cloud Comput. (2015)
Barroso, L.A., Hlzle, U.: The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Synthesis Lectures on Computer Architecture. Morgan & Claypool Publishers, San Rafael (2009)
Macko, P., Ge, X., Kelley, J., et al.: SMORE: a cold data object store for SMR drives. In: Proceedings of 34th Symposium on Mass Storage Systems and Technologies (MSST), vol. 35, no. 7, pp. 343–352 (2017)
Jie, W., Yu, H., Zuo, P., et al.: Improving restore performance in deduplication systems via a cost-efficient rewriting scheme. IEEE Trans. Parallel Distrib. Syst. 19(7), 121–132 (2019)
Xiao, W., Ren, J., Yang, Q.: A case for continuous data protection at block level in disk array storages. IEEE Trans. Parallel Distrib. Syst. 20(6), 898–911 (2009)
Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., et al.: DRPM: dynamic speed control for power management in server class disks. In: Proceedings of the 30th Annual International Symposium on Computer Architecture, pp. 169–179. IEEE, San Diego (2003)
Papathanasiou, A.E., Scott, M.L.: Energy efficient prefetching and caching. In: Proceedings of the Annual Conference on USENIX Annual Technical Conference, pp. 24–37. ACM, Boston (2004)
Carrera, E.V., Pinheiro, E., Bianchini, R.: Conserving disk energy in network servers. In: Proceedings of International Conference on Supercomputing, pp. 86–97. CiteSeer (2003)
Zhu, Q., Chen, Z., Tan, L., et al.: Hibernator: helping disk arrays sleep through the winter. ACM SIGOPS Oper. Syst. Rev. 39(5), 177–190 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, J., Zhang, J., Li, J., Liu, L. (2019). A High-Performance Storage System Based with Dual RAID Engine. In: Qiu, M. (eds) Smart Computing and Communication. SmartCom 2019. Lecture Notes in Computer Science(), vol 11910. Springer, Cham. https://doi.org/10.1007/978-3-030-34139-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-34139-8_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34138-1
Online ISBN: 978-3-030-34139-8
eBook Packages: Computer ScienceComputer Science (R0)