A Step towards a Suite of E-commerce Benchmarks

  • Dawn Jutla
  • Peter Bodorik
  • Yie Wang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1875)


A benchmark is used to measure and compare the performance of like systems. It is also used to estimate the scalability of a system in terms of the number of users and/or transactions that a system can support and system response times under different loads and hardware/software deployment platforms. Because of the multidimensional aspects of e-commerce and the various emerging and distinct e-commerce business models, one single benchmark is not suitable for the purposes of examining scalability and determining throughput and response time of e-commerce applications. This paper advocates development of suites of benchmarks based on distinguished business models that represent existing and emerging e-commerce applications in terms of their distinct features. In particular, the paper develops a benchmark for one such business model, a model that is based on a cybermediary or electronic broker, e-broker. Two implementations of the benchmark specification are described: one based on Microsoft’s COM technology while the other one is based on CORBA technology. Sample benchmark results are presented and discussed. The paper also proposes a framework for development of a suite of e-commerce benchmarks.


Business Model User Registration System Response Time Transaction Type Component Object Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Trent, G. and Sake, M., “WebSTONE: The First Generation in HTTP Server Benchmarking,” White paper, MTS Silicon Graphics, (1995)Google Scholar
  3. 3.
  4. 4.
    Benchmark Factory, (1997)
  5. 5.
    Transacion Processing Council,
  6. 6.
    D. Jutla, P. Bodorik, C. Hajnal, C. Davis, Making Business Sense of Electronic Commerce, IEEE Computer, March 1999, pp. 65–76.Google Scholar
  7. 7.
    M. Rappa, Business Models on the Web, in http://ecommerce,
  8. 8.
    Cao Lihong., “CORBA Implementation Of the WebEC”, Masters of Computer Science, Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada, 1999.Google Scholar
  9. 9.
    R. Jennings, Database Workshop-Microsoft Transaction Server 2.0, SAMS Publishing, Indianapolis, Indiana (1997)Google Scholar
  10. 10.
    Wang Y., “WebEC: An Electronic Commerce Benchmark”, Masters thesis, Faculty of Computer Science, Daltech, Dalhousie University, Halifax, Nova Scotia, Canada, December 1998.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Dawn Jutla
    • 1
  • Peter Bodorik
    • 2
  • Yie Wang
    • 2
  1. 1.Faculty of CommerceSaint Mary’s UniversityUSA
  2. 2.Faculty of Computer ScienceDalhousie UniversityDaltechUSA

Personalised recommendations