Abstract
The proliferation of virtualized servers in data centers has conquered the last frontier of bare-iron servers: back-end databases. The multi-tenancy issues of elasticity, capacity planning, and load variation in cloud data centers now coincide with the heavy demands of database workloads; which in turn creates a call for a benchmark specifically intended for this environment.
The TPC–V benchmark will fill this need with a publicly-available, end-to-end benchmark kit. Using a prototype of the kit, we profiled the performance of a server running 60 virtual machines with 48 databases of different sizes, load levels, and workloads. We will show that virtualized servers can indeed handle the elasticity and multi-tenancy requirements of the cloud, but only after careful tuning of the system configuration to avoid bottlenecks.
In this paper, we will provide a brief description of the benchmark, discuss the results and the conclusions drawn from the experiments, and propose future directions for analyzing the performance of cloud data centers by augmenting the capabilities of the TPCx-V benchmark kit.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
A Load Unit represents 1,000 rows in the Customers table. The cardinalities of the other 32 tables are either fixed, or are proportional to the number of Customers.
References
Bond, A., Kopczynski, G., Taheri, H.: Two firsts for the TPC: a benchmark to characterize databases virtualized in the cloud, and a publicly-available, complete end-to-end reference kit. In: Nambiar, R., Poess, M. (eds.) TPCTC 2012. LNCS, vol. 7755, pp. 34–50. Springer, Heidelberg (2013)
Bond, A., Johnson, D., Kopczynski, G., Taheri, H.: architecture and performance characteristics of a postgreSQL implementation of the TPC-E and TPC-V workloads. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 77–92. Springer, Heidelberg (2014)
Deehr, E., Fang, W.-Q., Reza Taheri, H., Yun, H.-F.: Performance analysis of database virtualization with the TPC-VMS benchmark. In: Nambiar, R., Poess, M. (eds.) TPCTC 2014. LNCS, vol. 8904, pp. 156–172. Springer, Heidelberg (2015)
Distributed Management Task Force: Open Virtualization Format Specification, Version 1.1.0, 01 December 2010
Figueiredo, R., Dinda, P.A., Fortes, J.A.B.: Guest editors’ introduction: resource virtualization renaissance. Computer 38(5), 28–31 (2005). http://www2.computer.org/portal/web/csdl/doi/10.1109/MC.2005.159
Nanda, S., Chiueh, T.-C.: A survey on virtualization technologies. Technical report ECSL-TR-179, SUNY at Stony Brook, February 2005. http://www.ecsl.cs.sunysb.edu/tr/TR179.pdf
Rosenblum, M., Garfinkel, T.: Virtual machine monitors: current technology and future trends. Computer 38(5), 39–47 (2005)
Sethuraman, P., Reza Taheri, H.: TPC-V: a benchmark for evaluating the performance of database applications in virtual environments. In: Nambiar, R., Poess, M. (eds.) TPCTC 2010. LNCS, vol. 6417, pp. 121–135. Springer, Heidelberg (2011)
Smith, G.: PostgreSQL 9.0 High Performance. Packt Publishing, UK (2010)
SPECvirt_sc2010 benchmark info, SPEC Virtualization Committee. http://www.spec.org/virt_sc2010/
SPECvirt_sc2013 benchmark info, SPEC Virtualization Committee. http://www.spec.org/virt_sc2013/
VMware, Inc. http://www.vmware.com/products/vmmark/overview.html
IDC: Worldwide Virtual Machine 2013–2017 Forecast: Virtualization Buildout Continues Strong. http://www.idc.com/getdoc.jsp?containerId=242762
TPC: Detailed TPC-E Description. http://www.tpc.org/tpce/spec/TPCEDetailed.doc
TPC: TPC-VMS benchmark. http://www.tpc.org/tpcvms/default.asp
TPC: TPCx-HS benchmark. http://www.tpc.org/tpcx-hs/default.asp
VMware, Inc., PowerCLI documentation. https://www.vmware.com/support/developer/PowerCLI
VMware, Inc., VMmark 2.x. http://www.vmware.com/products/vmmark/overview.html
Acknowledgements
We thank Matt Emmerton, John Fowler, Karl Huppler, Matthew Lanken, Jamie Reding, Cecil Reames, Jignesh Shah, Wayne Smith, and Priya Sethuraman for contributing time and effort in the development of the TPCx-V benchmark. We are also grateful to the reviewers for their comments and corrections.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Bond, A., Johnson, D., Kopczynski, G., Taheri, H.R. (2016). Profiling the Performance of Virtualized Databases with the TPCx-V Benchmark. In: Nambiar, R., Poess, M. (eds) Performance Evaluation and Benchmarking: Traditional to Big Data to Internet of Things. TPCTC 2015. Lecture Notes in Computer Science(), vol 9508. Springer, Cham. https://doi.org/10.1007/978-3-319-31409-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-31409-9_10
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31408-2
Online ISBN: 978-3-319-31409-9
eBook Packages: Computer ScienceComputer Science (R0)