Abstract
In many application and research areas there is a trend towards petascale processing and archiving of scientific measurement results and derived data structures. As a consequence, there is an urgent need for disruptive technologies that revolutionize the manner in which we integrate, coordinate, and distribute computing and storage of vast amounts of data. This paper discusses the INCA architecture, a system that aims at providing a sustainable solution to the management problem of data storage in very large-scale distributed systems. INCA provides a solution where ’intelligence’ in a globally scalable system is put in the middleware, where the lower level deals with local problems only, while all other properties are taken care of at the upper layers. In particular, we focus on a new, efficient transport protocol (referred to as HITP) that is specifically designed for bulk data transfer over high-speed (optical) network connections. We present performance results for basic transmission functionality, and show that HITP is capable of achieving higher throughput and lower latency than existing transport protocols.
Chapter PDF
Similar content being viewed by others
Keywords
- Packet Loss
- Transmission Control Protocol
- Transport Protocol
- User Datagram Protocol
- Transmission Control Protocol Connection
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Anglano, C., Canonico, M.: Performance Analysis of High-Performance File Transfer Systems for Grid Applications. Concur. Comput.: Pract. Exp. 18(8), 807–816 (2006)
Bassi, A., Denazis, S., Giacomin, P.: Towards a Noah’s Ark for the Upcoming Data Deluge. In: 3rd VLDB Workshop on Data Management in Grids (September 2007)
Bell, G., Gray, J., Szalay, A.: Petascale Computational Systems. IEEE Computer 39(1), 110–112 (2006)
Brakmo, L.S., O’Malley, S.W., Peterson, L.L.: TCP Vegas: New Techniques for Congestion Detection and Avoidance. In: SIGCOMM, pp. 24–35 (1994)
Caini, C., Firrincieli, R.: TCP Hybla: A TCP Enhancement for Heterogeneous Networks (2004)
Dell’Aera, A., et al.: Linux 2.4 Implementation of Westwood+ TCP with Rate-Halving: A Performance Evaluation over the Internet. In: Proc. ICC 2004 (June 2004)
Egnor, D.: Airhook: Reliable, Efficient Transmission Control for Networks that Suck, http://airhook.ofb.net/
Gu, Y., Grossman, R.: UDT: UDP-based Data Transfer for High-Speed Wide Area Networks. Computer Networks 51(7), 1777–1799 (2007)
He, E., et al.: Reliable Blast UDP: Predictable High Performance Bulk Data Transfer. In: Proc. IEEE International Conference on Cluster Computing (September 2002)
Kelly, T.: Scalable TCP: Improving Performance in HighSpeed Wide Area Networks (February 2003)
Padhye, J., et al.: Modeling TCP Throughput: A Simple Model and its Empirical Validation. In: ACM SIGCOMM 1998, Vancouver, CA, pp. 303–314 (1998)
Plank, J., Bassi, A., Beck, M., Moore, T., Swany, M., Wolski, R.: Managing Data Storage in the Network. IEEE Internet Computing 6(5), 50–58 (2001)
Postel, J.: User Datagram Protocol, Internet standard RFC 768 (August 1980)
Postel, J.: Transmission Control Protocol, Internet standard RFC 793 (September 1981)
Rhee, I., et al.: CUBIC: A New TCP-Friendly High-Speed TCP Variant (February 2005)
Seinstra, F., et al.: High-Performance Distributed Video Content Analysis with Parallel-Horus. IEEE Multimedia 15(4), 64–75 (2007)
Sivakumar, H., et al.: PSockets: The Case for Application-level Network Striping for Data Intensive Applications. In: Supercomputing (SC 2000) (November 2000)
Tierney, B.L., et al.: TCP Tuning Guide (January 2008)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giacomin, P., Bassi, A., Seinstra, F.J., Kielmann, T., Bal, H.E. (2008). HITP: A Transmission Protocol for Scalable High-Performance Distributed Storage. In: Luque, E., Margalef, T., Benítez, D. (eds) Euro-Par 2008 – Parallel Processing. Euro-Par 2008. Lecture Notes in Computer Science, vol 5168. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85451-7_102
Download citation
DOI: https://doi.org/10.1007/978-3-540-85451-7_102
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85450-0
Online ISBN: 978-3-540-85451-7
eBook Packages: Computer ScienceComputer Science (R0)