Skip to main content

Highly parallel concentrated heterogeneous computing

  • Conference paper
  • First Online:
Applied Parallel Computing Computations in Physics, Chemistry and Engineering Science (PARA 1995)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1041))

Included in the following conference series:

  • 193 Accesses

Abstract

In this paper the possibilities are discussed of organizing heterogeneous computing in the so-called Combined Architecture systems consisting of a basic host subsystem (a massively parallel computer), and a set of high-performance specialized parallel coprocessors (hardware modules) executing the main workload. To optimize the choice of hardware modules, a classification of massive computations is suggested, based on the notion of processing types, which correspond to the character of data processing. A technique of parallel programming for the suggested concentrated heterogeneous systems is introduced, ensuring close matching of the tasks to the hardware modules.

This research was partially supported by a Russian Foundation for Basic Research grant No.94-01-00574.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Khokhar A.A., et al. Heterogeneous computing: challenges and opportunities, Computer, Vol.26, No.6, pp.18–27, 1993.

    Google Scholar 

  2. Freund R.F. and Siegel H.J. Heterogeneous processing, Computer, Vol.26, No.6, pp.13–17, 1993.

    Google Scholar 

  3. Vazhenin A.P., Sedukhin S.G., Fet Ya.I. High-performance computing systems of combined architecture, In: ”Parallel Computing Technologies (PaCT-91)”, Novosibirsk, Russia, 1991), Singapore, World Scientific, pp. 246–257, 1991.

    Google Scholar 

  4. Fet Ya.I. and Vazhenin A.P. Heterogeneous processing: a combined approach, In: ”Workshop on Parallel Scientific Computing (PARA'94-L)”, 1994, Lingby, Denmark, (LNCS, Vol.879), Berlin, Springer-Verlag, pp. 194–206, 1994.

    Google Scholar 

  5. Kantorovich L.V. On a system of mathematical symbols, convinient for electronic computer operations, In: Dokl. Akad. Nauk SSSR, Vol.113, pp.738–741, 1957. (In Russian).

    Google Scholar 

  6. Iverson K.E. A Programming Language, New York-London, Wiley, 1962.

    Google Scholar 

  7. Fet Ya.I. Hardware support of massive computations, Optimization, Novosibirsk, Inst. of Mathematics, Siberian Div. of the USSR Acad. Sci., No.22(39), pp.115–126, 1978. (In Russian).

    Google Scholar 

  8. Blelloch G.E. Vector Models for Data-Parallel Computing, Cambridge, Mass., MIT Press, 1990.

    Google Scholar 

  9. Kung H.T. Why systolic architectures?, Computer, Vol.15, No.1, pp.37–46, 1982.

    Google Scholar 

  10. Sedukhin S.G. and Sedukhin I.S. An interactive graphic CAD tool for the synthesis and analysis of VLSI systolic structures, In: Parallel Computing Technologies (PaCT-93), Obninsk, Russia, 1993, Moscow, ReSCo J.-S. Co., pp. 163–175, 1993.

    Google Scholar 

  11. Broomel G. and Heath J.R. Classification categories and historical development of circuit switching topologies, ACM Computing Surveys, Vol.15, No.2, pp.95–133, 1983.

    Google Scholar 

  12. Hillis W.D. and Tucker L.W. The CM-5 Connection Machine: a scalable supercomputer, Comm. ACM, Vol.36, No.11, pp.31–40, 1993.

    Google Scholar 

  13. Knuth D. The Art of Computer Programming, Vol.3, Sorting and Searching. New York, Addison-Wesley, 1973.

    Google Scholar 

  14. Batcher K.E. Sorting networks and their applications, In: AFIPS Confer. Proc., 1968 SJCC, Vol.32, pp.307–314, 1968.

    Google Scholar 

  15. Foster C.C. Content Addressable Parallel Processors, New York, Van Nostrand Reinhold, 1976.

    Google Scholar 

  16. Fet Ya.I. Parallel Processing in Cellular Arrays, Tounton, UK, Research Studies Press, 1995.

    Google Scholar 

  17. Vazhenin A.P. Hardware and algorithmic support of high-accuracy computations in vertical processing systems, In: Parallel Computing Technologies (PaCT-93), Obninsk, Russia, 1993, Moscow, ReSCo J.-S. Co., pp. 149–162, 1993.

    Google Scholar 

  18. Fet Ya.I. Vertical processing systems: a survey, IEEE Micro, Vol.15, No.1, pp.65–75, 1995.

    Google Scholar 

  19. Vazhenin A.P. Efficient high-accuracy computations in massively parallel systems, In: “Workshop on Parallel Scientific Computing (PARA'94-L)”, 1994, Lingby, Denmark, (LNCS, Vol.879), Berlin, Springer-Verlag, pp. 505–519, 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Jack Dongarra Kaj Madsen Jerzy Waśniewski

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fet, Y.I., Vazhenin, A.P. (1996). Highly parallel concentrated heterogeneous computing. In: Dongarra, J., Madsen, K., Waśniewski, J. (eds) Applied Parallel Computing Computations in Physics, Chemistry and Engineering Science. PARA 1995. Lecture Notes in Computer Science, vol 1041. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-60902-4_21

Download citation

  • DOI: https://doi.org/10.1007/3-540-60902-4_21

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-60902-5

  • Online ISBN: 978-3-540-49670-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics