Skip to main content

Benchmark Frameworks

  • Reference work entry
  • First Online:
  • 48 Accesses

Definition

A benchmark framework is a collection of tools for generating and executing benchmarks. Examples include HammerDB and YCSB;

HammerDB is a tool for executing benchmarks on relational database systems. It supports a range of existing relational database systems. It is configured to run TPC-C and TPC-H benchmarks (including schema creation, data generation, measurements, and workload execution). It can also capture and replay traces on Oracle databases. HammerDB provides a visual interface and a command line interface for additional scripting and automation.

YCSB is a tool for characterizing the performance of cloud-based data serving systems. It supports a range of existing data platforms including document databases, key-value stores, full-text search engines, BigTable databaes, block stores, and relational databases. It is configured to run latency benchmarks (with variable load on the data serving system) as well as throughput benchmarks (with a variable number of servers...

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   4,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   6,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Recommended Reading

  1. Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R. Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing; 2010. p. 143–154.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philippe Bonnet .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media, LLC, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Bonnet, P., Shasha, D. (2018). Benchmark Frameworks. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_80798

Download citation

Publish with us

Policies and ethics