Abstract
Message-oriented middleware (MOM) is at the core of a vast number of financial services and telco applications, and is gaining increasing traction in other industries, such as manufacturing, transportation, health-care and supply chain management. There is a strong interest in the end user and analyst communities for a standardized benchmark suite for evaluating the performance and scalability of MOM. In this paper, we present a workload characterization of the SPECjms2007 benchmark which is the world’s first industry-standard benchmark specialized for MOM. In addition to providing standard workload and metrics for MOM performance, the benchmark provides a flexible performance analysis framework that allows users to customize the workload according to their requirements. The workload characterization presented in this paper serves two purposes i) to help users understand the internal components of the SPECjms2007 workload and the way they are scaled, ii) to show how the workload can be customized to exercise and evaluate selected aspects of MOM performance. We discuss how the various features supported by the benchmark can be exploited for in-depth performance analysis of MOM infrastructures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ActiveMQ. JMeter performance test (2006), http://incubator.apache.org/activemq/jmeter-performance-tests.html
Alexander, K., Gillian, T., Gramling, K., Kindy, M., Moogimane, D., Schultz, M., Woods, M.: IBM Business Consulting Services - Focus on the Supply Chain: Applying Auto-ID within the Distribution Center. White paper IBM-AUTOID-BC-002 (2003)
Bornhövd, C., Lin, T., Haller, S., Schaper, J.: Integrating Automatic Data Acquisition with Business Processes - Experiences with SAP’s Auto-ID Infrastructure. In: Proceedings of VLDB 2004 (2004)
Carter, M.: JMS Performance with WebSphere MQ for Windows V6.0 (2005), http://www-1.ibm.com/support/docview.wss?rs=171&uid=swg24010028
Crimson Consulting Group. High-Performance JMS Messaging - A Benchmark Comparison of Sun Java System Message Queue and IBM WebSphere MQ (2003)
Finkenzeller, K.: RFID Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification, 2nd edn. John Wiley & Sons, Chichester (May 2003)
IBM Hursley. Performance Harness for Java Message Service (2005), http://www.alphaworks.ibm.com/tech/perfharness
JBoss. JBoss JMS New Performance Benchmark (2006), http://wiki.jboss.org/wiki/Wiki.jsp?page=JBossJMSNewPerformanceBenchmark
Kounev, S.: Performance Engineering of Distributed Component-Based Systems - Benchmarking, Modeling and Performance Prediction. Shaker Verlag (Dec 2005), ISBN: 3832247130
Kounev, S., Buchmann, A.: Improving Data Access of J2EE Applications by Exploiting Asynchronous Processing and Caching Services. In: Proceedings of VLDB 2002 (2002)
Krissoft Solutions. JMS Performance Comparison (2006), http://www.fiorano.com/comp-analysis/jms_perf_report.htm
Sachs, K.: Evaluation of Performance Aspects of the SAP Auto-ID Infrastructure. Master’s thesis, Department of Computer Science, Darmstadt University of Technology (2004)
Sachs, K., Kounev, S., Carter, M., Buchmann, A.: Designing a Workload Scenario for Benchmarking Message-Oriented Middleware. In: Proceedings of the 2007 SPEC Benchmark Workshop. SPEC (January 2007)
Sonic Software Corporation. SonicMQ Test Harness (2005)
Sun Microsystems Inc. Java Message Service (JMS) Specification Version 1.1(2002), http://java.sun.com/products/jms/docs.html
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sachs, K., Kounev, S., Bacon, J., Buchmann, A. (2007). Workload Characterization of the SPECjms2007 Benchmark. In: Wolter, K. (eds) Formal Methods and Stochastic Models for Performance Evaluation. EPEW 2007. Lecture Notes in Computer Science, vol 4748. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75211-0_17
Download citation
DOI: https://doi.org/10.1007/978-3-540-75211-0_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75210-3
Online ISBN: 978-3-540-75211-0
eBook Packages: Computer ScienceComputer Science (R0)