Scalable parallel computers and scalable parallel codes: From theory to practice

  • Marc Snir
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 678)


The evolution in parallel programming languages is toward implicit parallelism, and toward virtual parallelism: Explicitly coding for parallelism is to be avoided; coding for the physical machine size is a low-level programming practice to be overcome as soon as possible. Our examples indicate this may not be possible in general — although it might well be a realistic alternative for many numerical codes with simple structure. Much emphasis is now put on data-parallel languages, where parallelism is implied from the use of aggregate operations on data aggregate (mostly array operations on data arrays); parallelism is derived from parallel execution of these aggregate operations or derived from a data partition. Our examples imply that control parallelism, where parallelism is derived from explicit user allocation of operations to (virtual or physical) processors is necessary to express certain algorithms.


Problem Size Sorting Algorithm Virtual Processor Physical Processor Pram Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Aggarwal A., Chandra A. K. and Snir M., Communication Complexity of PRAMs. Theoretical Computer Science 71 (1990), 3–28.Google Scholar
  2. [2]
    Baudet, G. and Stevenson, D.. Optimal sorting algorithms for parallel computers. IEEE Trans. Comput. C-27 (1978), 84–87.Google Scholar
  3. [3]
    Cole, R.. Parallel merge sort. SIAM J. Comput. 17 (1988), 770–785.Google Scholar
  4. [4]
    Fox G. et. al.. Fortran D language specification. Tech. Rep. COMP TR90079, Computer Science, Rice Univ., March 1991.Google Scholar
  5. [5]
    Peterson, V. L. et. al.. Supercomputing requirements for selected disciplines important to aerospace. Proc. IEEE 77(1989) 1038–1055.Google Scholar
  6. [6]
    Ullman J. D. Computational aspects of VLSI. Computer Science Press, 1984.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Marc Snir
    • 1
  1. 1.IBM T. J. Watson Research CenterYorktown HeightsUSA

Personalised recommendations