Abstract
SCSI RDMA Protocol (SRP) is used to build high performance Storage Area Networks (SANs) over InfiniBand, or SRP-based IB-SANs for short. The I/O read performance is critical for many read dominant applications, such as multimedia, remote sensing, data backup, etc. However, if I/O accesses focus on a specific storage device of an IB-SAN, the local I/O performance of single device could become the bottleneck, leaving the network performance under utilized. In this paper, we propose an SRP target mode called Target Disk Cache Assisted (tDCA) mode, which explores the file read-ahead feature and page cache of Linux to tackle the performance gap between storage devices and network. Experimental results show that this strategy improves the read performance in terms of throughput which is increased significantly for both random read with good locality and sequential read.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
InfiniBand Trade Association: InfiniBand Architecture Specification vol. 1, 2 (Release 1.2) (2004), http://www.infinibandta.org/specs
Liu, J., Wu, J., Panda, D.K.: High Performance RDMA-Based MPI Implementation over InfiniBand. International Journal of Parallel Programming. 32, 167–198 (2004)
Oracle: Achieving Mainframe-Class Performance on Intel Servers Using InfiniBand Building Blocks (2003), http://www.oracle.com/technology/deploy/availability/pdf/oracle_IB.pdf
Cris Simpson: SCSI RDMA Protocol - 2 (SRP-2) (2003), http://www.t10.org/ftp/t10/drafts/srp2/srp2r00a.pdf
Mike Ko: iSCSI Extensions for RDMA Specification (2006), http://www.ietf.org/internet-drafts/draft-ietf-ips-iser-06.txt
Qiang, C., Changsheng, X.: The Study of the I/O Request Response Time in Network Storage System. Journal of Computer Research & Development. 40, 1271–1276 (2003)
Mellanox: InfiniBand Gold Collection for Linux (Gen1) version 1.8.x (2006), https://docs.mellanox.com/dm/ibgold/ReadMe.html
The IOMeter Project (2006), http://www.iometer.org
Bovet, D.P., Cesati, M.: Understanding the Linux Kernel, 1st edn. O’Reilly (2000) ISBN: 0-596-00002-2
The UNH-iSCSI Project (2006), http://sourceforge.net/projects/unh-iscsi
He, X., Zhang, M., Yang, Q.: STICS: SCSI-to-IP cache for storage area networks. Journal of Parallel and Distributed Computing 64, 1069–1085 (2004)
He, X., Yang, Q., Zhang, M.: A caching strategy to improve iSCSI performance. In: The IEEE Annual Conference on Local Computer Networks, pp. 6–8 (2002)
Liu, J., Panda, D.K., Banikazemi, M.: Evaluating the Impact of RDMA on Storage I/O over InfiniBand. In: SAN-3 Workshop (2004)
Liu, X., Wang, N., Sun, G., Han, J., Han, C.: Remote iSCSI Cache on InfiniBand: An Approach to Optimize iSCSI System. In: ICPPW 2006, pp. 527–534 (2006)
OpenFabrics Alliance: SRP Target Development Git Tree (2007), http://www.openfabrics.org/git/?p=Â vu/srpt.git;a=summary
Bolkhovitin, V.: Generic SCSI Target Mid-level for Linux (2007), http://scst.sourceforge.net
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, Z., He, J., Han, J., Wang, X., Zhou, Y., He, X. (2007). An SRP Target Mode to Improve Read Performance of SRP-Based IB-SANs. In: Stojmenovic, I., Thulasiram, R.K., Yang, L.T., Jia, W., Guo, M., de Mello, R.F. (eds) Parallel and Distributed Processing and Applications. ISPA 2007. Lecture Notes in Computer Science, vol 4742. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74742-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-74742-0_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74741-3
Online ISBN: 978-3-540-74742-0
eBook Packages: Computer ScienceComputer Science (R0)