Abstract
In this paper the possibilities are discussed of organizing heterogeneous computing in the so-called Combined Architecture systems consisting of a basic host subsystem (a massively parallel computer), and a set of high-performance specialized parallel coprocessors (hardware modules) executing the main workload. To optimize the choice of hardware modules, a classification of massive computations is suggested, based on the notion of processing types, which correspond to the character of data processing. A technique of parallel programming for the suggested concentrated heterogeneous systems is introduced, ensuring close matching of the tasks to the hardware modules.
This research was partially supported by a Russian Foundation for Basic Research grant No.94-01-00574.
Preview
Unable to display preview. Download preview PDF.
References
Khokhar A.A., et al. Heterogeneous computing: challenges and opportunities, Computer, Vol.26, No.6, pp.18–27, 1993.
Freund R.F. and Siegel H.J. Heterogeneous processing, Computer, Vol.26, No.6, pp.13–17, 1993.
Vazhenin A.P., Sedukhin S.G., Fet Ya.I. High-performance computing systems of combined architecture, In: ”Parallel Computing Technologies (PaCT-91)”, Novosibirsk, Russia, 1991), Singapore, World Scientific, pp. 246–257, 1991.
Fet Ya.I. and Vazhenin A.P. Heterogeneous processing: a combined approach, In: ”Workshop on Parallel Scientific Computing (PARA'94-L)”, 1994, Lingby, Denmark, (LNCS, Vol.879), Berlin, Springer-Verlag, pp. 194–206, 1994.
Kantorovich L.V. On a system of mathematical symbols, convinient for electronic computer operations, In: Dokl. Akad. Nauk SSSR, Vol.113, pp.738–741, 1957. (In Russian).
Iverson K.E. A Programming Language, New York-London, Wiley, 1962.
Fet Ya.I. Hardware support of massive computations, Optimization, Novosibirsk, Inst. of Mathematics, Siberian Div. of the USSR Acad. Sci., No.22(39), pp.115–126, 1978. (In Russian).
Blelloch G.E. Vector Models for Data-Parallel Computing, Cambridge, Mass., MIT Press, 1990.
Kung H.T. Why systolic architectures?, Computer, Vol.15, No.1, pp.37–46, 1982.
Sedukhin S.G. and Sedukhin I.S. An interactive graphic CAD tool for the synthesis and analysis of VLSI systolic structures, In: Parallel Computing Technologies (PaCT-93), Obninsk, Russia, 1993, Moscow, ReSCo J.-S. Co., pp. 163–175, 1993.
Broomel G. and Heath J.R. Classification categories and historical development of circuit switching topologies, ACM Computing Surveys, Vol.15, No.2, pp.95–133, 1983.
Hillis W.D. and Tucker L.W. The CM-5 Connection Machine: a scalable supercomputer, Comm. ACM, Vol.36, No.11, pp.31–40, 1993.
Knuth D. The Art of Computer Programming, Vol.3, Sorting and Searching. New York, Addison-Wesley, 1973.
Batcher K.E. Sorting networks and their applications, In: AFIPS Confer. Proc., 1968 SJCC, Vol.32, pp.307–314, 1968.
Foster C.C. Content Addressable Parallel Processors, New York, Van Nostrand Reinhold, 1976.
Fet Ya.I. Parallel Processing in Cellular Arrays, Tounton, UK, Research Studies Press, 1995.
Vazhenin A.P. Hardware and algorithmic support of high-accuracy computations in vertical processing systems, In: Parallel Computing Technologies (PaCT-93), Obninsk, Russia, 1993, Moscow, ReSCo J.-S. Co., pp. 149–162, 1993.
Fet Ya.I. Vertical processing systems: a survey, IEEE Micro, Vol.15, No.1, pp.65–75, 1995.
Vazhenin A.P. Efficient high-accuracy computations in massively parallel systems, In: “Workshop on Parallel Scientific Computing (PARA'94-L)”, 1994, Lingby, Denmark, (LNCS, Vol.879), Berlin, Springer-Verlag, pp. 505–519, 1994.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fet, Y.I., Vazhenin, A.P. (1996). Highly parallel concentrated heterogeneous computing. In: Dongarra, J., Madsen, K., Waśniewski, J. (eds) Applied Parallel Computing Computations in Physics, Chemistry and Engineering Science. PARA 1995. Lecture Notes in Computer Science, vol 1041. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-60902-4_21
Download citation
DOI: https://doi.org/10.1007/3-540-60902-4_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-60902-5
Online ISBN: 978-3-540-49670-0
eBook Packages: Springer Book Archive