Definition
A benchmark framework is a collection of tools for generating and executing benchmarks. Examples include HammerDB and YCSB;
HammerDB is a tool for executing benchmarks on relational database systems. It supports a range of existing relational database systems. It is configured to run TPC-C and TPC-H benchmarks (including schema creation, data generation, measurements, and workload execution). It can also capture and replay traces on Oracle databases. HammerDB provides a visual interface and a command line interface for additional scripting and automation.
YCSB is a tool for characterizing the performance of cloud-based data serving systems. It supports a range of existing data platforms including document databases, key-value stores, full-text search engines, BigTable databaes, block stores, and relational databases. It is configured to run latency benchmarks (with variable load on the data serving system) as well as throughput benchmarks (with a variable number of servers...
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsRecommended Reading
Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R. Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing; 2010. p. 143–154.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Bonnet, P., Shasha, D. (2018). Benchmark Frameworks. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_80798
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_80798
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering