Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu

Application Benchmark

  • Denilson Barbosa
  • Ioana Manolescu
  • Jeffrey Xu Yu
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_5055

Synonyms

Benchmark; Performance benchmark

Definition

An application benchmark is a suite of tasks that are representative of typical workloads in an application domain.

Key Points

Unlike a MICROBENCHMARK, an application benchmark specifies broader tasks that are aimed at exercising most components of a system or tool. Each individual task in the benchmark is assigned a relative weight, usually reflecting its frequency or importance in the application being modeled. A meaningful interpretation of the benchmark results has to take these weights into account.

The Transaction Processing Performance Council (TPC) is a body with a long history of defining and published benchmarks for database systems. For instance, it has defined benchmarks for Online Transaction Processing applications (TPC-C and TPC-E), Decision Support applications (TPC-H), and for an Application Server setting (TPC-App).

Other examples of application benchmarks are: the OO1 and OO7 benchmarks, developed for...

This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Carey MJ, DeWitt DJ, Naughton JF. The OO7 benchmark. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 1993. p. 12–21.Google Scholar
  2. 2.
    Gray J, editor. The benchmark handbook for database and transaction systems. 2nd ed. San Mateo: Morgan Kaufmann; 1993.zbMATHGoogle Scholar
  3. 3.
    Nicola M, Kogan I, Schiefer B. An XML transaction processing benchmark. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 2007. p. 937–48.Google Scholar
  4. 4.
    Schmidt A, Waas F, Kersten ML, Carey MJ, Manolescu I, Busse R. XMark: a benchmark for XML data management. In: Proceedings of the 28th International Conference on Very Large Data Bases; 2002. p. 974–85.CrossRefGoogle Scholar
  5. 5.
    Transaction Processing Performance Council. Available at: http://www.tpc.org/default.asp
  6. 6.
    Yao BB, Özsu MT, Khandelwal N. XBench benchmark and performance testing of XML DBMSs. In: Proceedings of the 20th International Conference on Data Engineering; 2004. p. 621–33.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Denilson Barbosa
    • 1
  • Ioana Manolescu
    • 2
  • Jeffrey Xu Yu
    • 3
  1. 1.University of AlbertaEdmontonCanada
  2. 2.INRIA Saclay–Îlle de FranceOrsayFrance
  3. 3.Department of Systems Engineering and Engineering ManagementThe Chinese University of Hong KongHong KongChina