Synonyms
Definitions
A CRUD benchmark is a generic experimental framework for characterizing and comparing the performance of database systems by executing workloads using only a simple CRUD (create, read, update, and delete) interface.
Since each database system provides at least this minimal subset of operations, CRUD benchmarks allow a general performance comparison of a variety of non-relational NoSQL database systems.
Overview
For many decades, relational database management systems (RDBMSs) have been the first choice for business applications. A high degree of standardization, especially the standard query language SQL, made it possible to develop domain-specific benchmarks for RDBMSs.
The DebitCredit benchmark by Jim Gray laid down the foundation for standardized database benchmarks (Anon et al. 1985). It introduced most of the key ideas that were later taken up by the Transaction Processing Performance Council (TPC) for the specification of the TPC-A benchmark...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anon, Bitton D, Brown M, Catell R, Ceri S, Chou T, DeWitt D, Gawlick D, Garcia-Molina H, Good B, Gray J, Homan P, Jolls B, Lukes T, Lazowska E, Nauman J, Pong M, Spector A, Trieber K, Sammer H, Serlin O, Stonebraker M, Reuter A, Weinberger P (1985) A measure of transaction processing power. Datamation 31(7):112–118
Bermbach D, Wittern E, Tai S (2017) Cloud service benchmarking: measuring quality of cloud services from a client perspective. Springer, Cham
Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM symposium on cloud computing, SoCC’10. ACM, New York, pp 143–154
DeWitt DJ (1993) The wisconsin benchmark: past, present, and future. In: Gray J (ed) The benchmark handbook. Morgan Kaufmann, San Mateo
Folkerts E, Alexandrov A, Sachs K, Iosup A, Markl V, Tosun C (2013) Benchmarking in the cloud: what it should, can, and cannot be. Springer, Berlin/Heidelberg, pp 173–188
Friedrich S, Wingerath W, Gessert F, Ritter N (2014) NoSQL OLTP benchmarking: a survey. In: 44. Jahrestagung der Gesellschaft für Informatik, Informatik 2014, Big Data – Komplexität meistern, 22–26 Sept 2014 in Stuttgart, pp 693–704
Gray J (ed) (1993) The benchmark handbook for database and transaction systems, 2nd edn. Morgan Kaufmann, San Mateo
Hu H, Wen Y, Chua TS, Li X (2014) Toward scalable systems for big data analytics: a technology tutorial. IEEE Access 2:652–687
Huppler K (2009) The art of building a good benchmark. Springer, Berlin/Heidelberg, pp 18–30
Reniers V, Van Landuyt D, Rafique A, Joosen W (2017) On the state of NoSQL benchmarks. In: Proceedings of the 8th ACM/SPEC on international conference on performance engineering companion, ICPE’17 companion. ACM, New York, pp 107–112
TPC-C (2010) Benchmark specification. http://www.tpc.org/tpcc
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this entry
Cite this entry
Friedrich, S., Ritter, N. (2019). CRUD Benchmarks. In: Sakr, S., Zomaya, A.Y. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-77525-8_116
Download citation
DOI: https://doi.org/10.1007/978-3-319-77525-8_116
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77524-1
Online ISBN: 978-3-319-77525-8
eBook Packages: Computer ScienceReference Module Computer Science and Engineering