Abstract
Parallel systems built from commodity CPUs and networking devices (Networks of Workstations or NoW) are easily and economically constructed. Rapid technological change means that as elements are added to or replaced in such a system, it will inevitably become heterogeneous.
This paper examines issues in effectively using all the processing power of a heterogeneous NoW system. In particular, it examines the use of two different parallel programming models: MPI, a popular message passing system and Cilk, an extension to C with dataflow semantics. We consider both the performance of the two systems for a set of simple benchmarks representative of real problems and the ease of programming these systems. We show that, in many cases, Cilk both performs better than MPI and, additionally, that it requires less programming effort to write programs that exploit the full power of a heterogeneous system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Snir, M.: MPI: The complete reference. MIT Press, Cambridge (1996)
Amza, C., Cox, A.L., Dwarkadas, S., Keleher, P., Lu, H., Rajamony, R., Yu, W., Zwaenepoel, W.: TreadMarks: Shared Memory Computing on Networks of Workstations. IEEE Computer 29, 18–28 (1996)
Blumofe, R.D., Joerg, C.F., Kuszmaul, B.C., Leiserson, C.E., Randall, K.H., Zhou, Y.: Cilk: an efficient multithreaded runtime system. In: PPoPP 1995, Santa Barbara (1995)
Lee, G., Morris, J.: Dataflow Java: Implicitly parallel Java. In: Proceedings of the Australasian Computer Systems Architecture Conference, pp. 42–50 (1998)
Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22, 789–828 (1996)
Beaumont, O., Boudet, V., Rastello, F., Robert, Y.: Matrix multiplication on heterogeneous platforms. IEEE Transactions on Parallel and Distributed Systems 12, 1033–1051 (2001)
Tham, C.K.: Achilles: A high bandwidth, low latency, low overhead network interconnect for high performance parallel processing using a network of workstations. PhD thesis, The University of Western Australia (2003)
von Eicken, T., Culler, D.E., Goldstein, S.C., Schauser, K.E.: Active Messages: a Mechanism for Integrated Communication and Computation. In: Proceedings of the 19th Annual International Symposium on Computer Architecture, Gold Coast, Australia, pp. 256–266 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baek, S., Lee, K., Kim, J., Morris, J. (2004). Heterogeneous Networks of Workstations. In: Yew, PC., Xue, J. (eds) Advances in Computer Systems Architecture. ACSAC 2004. Lecture Notes in Computer Science, vol 3189. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30102-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-540-30102-8_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23003-8
Online ISBN: 978-3-540-30102-8
eBook Packages: Springer Book Archive