- 875 Downloads
After a definition (list of properties) of a benchmark, the major benchmarks currently used are classified according to several criteria: Ownership, definition of the benchmark, pricing, area covered by the benchmark. The SPEC Open Systems Group, TPC and SAP benchmarks are discussed in more detail. The use of benchmarks in academic research is discussed. Finally, some current issues in benchmarking are listed that users of benchmark results should be aware of.
KeywordsBenchmark Suite Benchmark Result Software Vendor Secure Socket Layer Mail Server
- 2.Jeffrey D. Gee, Mark D. Hill, Dionisios N. Pnevmatikos, and Alan Jay Smith: Cache Performance of the SPEC92 Benchmark Suite. IEEE Micro, August 1993, 17–27Google Scholar
- 6.Dennis C. Lee, et al: Execution Characteristics of Desktop Applications on Windows NT. 25th Annual Symposium on Computer Architecture, = ACM Computer Architecture News 26,3 June 1998), 27–38Google Scholar
- 7.John McCalpin: http://www.cs.virginia.edu/stream/ref.html: FAQ list (Frequently Asked Questions) about Stream
- 9.Shubhendu S. Mukherjee: New Challenges in Benchmarking Future Processors. Fifth Workshop on Computer Architecture Evaluation using Commercial Workloads, 2002Google Scholar
- 13.Reinhold Weicker: Point: Why SPEC Should Burn (Almost) All Flags, and Walter Bays. Counterpoint: Defending the Flag. SPEC Newsletter 7,4, Dec. 1995, 5–6Google Scholar