Synonyms
Benchmark; Performance benchmark
Definition
An application benchmark is a suite of tasks that are representative of typical workloads in an application domain.
Key Points
Unlike a MICROBENCHMARK, an application benchmark specifies broader tasks that are aimed at exercising most components of a system or tool. Each individual task in the benchmark is assigned a relative weight, usually reflecting its frequency or importance in the application being modeled. A meaningful interpretation of the benchmark results has to take these weights into account.
The Transaction Processing Performance Council (TPC) is a body with a long history of defining and published benchmarks for database systems. For instance, it has defined benchmarks for Online Transaction Processing applications (TPC-C and TPC-E), Decision Support applications (TPC-H), and for an Application Server setting (TPC-App).
Other examples of application benchmarks are: the OO1 and OO7 benchmarks, developed for...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Recommended Reading
Carey MJ, DeWitt DJ, Naughton JF. The OO7 benchmark. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 1993. p. 12–21.
Gray J, editor. The benchmark handbook for database and transaction systems. 2nd ed. San Mateo: Morgan Kaufmann; 1993.
Nicola M, Kogan I, Schiefer B. An XML transaction processing benchmark. In: Proceedings of the ACM SIGMOD International Conference on Management of Data; 2007. p. 937–48.
Schmidt A, Waas F, Kersten ML, Carey MJ, Manolescu I, Busse R. XMark: a benchmark for XML data management. In: Proceedings of the 28th International Conference on Very Large Data Bases; 2002. p. 974–85.
Transaction Processing Performance Council. Available at: http://www.tpc.org/default.asp
Yao BB, Özsu MT, Khandelwal N. XBench benchmark and performance testing of XML DBMSs. In: Proceedings of the 20th International Conference on Data Engineering; 2004. p. 621–33.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Barbosa, D., Manolescu, I., Yu, J.X. (2018). Application Benchmark. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_5055
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_5055
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering