The Fundamental Laws of Parallelism
This chapter introduces the basic laws of parallelism that have influenced the research and practice of parallel computing during the past decades. We discuss Amdahl’s and Gustafson’s law as well as the equivalence of the two laws; we also analyze how Amdahl’s law can be applied to multi-core chips and what implications it can have on architecture and programming model research. Finally we present some of the more controversial rules and conjectures, such as the KILL rule and Gunther’s conjecture .
- 1.Amdahl G (1967) Validity of the Single Processor Approach to Achieving Large-Scale Computing Capabilities. American Federation of Information Processing Societies (AFIPS) Conference Proceedings 30:483-485Google Scholar
- 2.Hill M D, Marty M R (2008) Amdahl’s Law in the Multi-core Era. IEEE ComputerGoogle Scholar
- 3.Gustafson J L (1988) Reevaluating Amdahl’s Law. Communications of the ACM 31(5): 532-533. Online at http://www.scl.ameslab.gov/Publications/Gus/AmdahlsLaw/Amdahls.html. Accessed 11 January 2011CrossRefGoogle Scholar
- 4.Gunther N J (2002) A New Interpretation of Amdahl’s Law and Geometric Scaling. http://arxiv.org/PS_cache/cs/pdf/0210/0210017v1.pdf. Accessed 11 January 2011
- 5.Karp A H, Flatt H P (1990) Measuring Parallel Processor Performance. Communications of the ACM 33(5): 539 - 543Google Scholar
- 6.Shi Y (1996) Reevaluating Amdahl’s Law and Gustafson’s Law. http://www.cis.temple.edu/~shi/docs/amdahl/amdahl.html. Accessed 11 January 2011