Advertisement

Cloud Service Benchmarking

Measuring Quality of Cloud Services from a Client Perspective

  • David Bermbach
  • Erik Wittern
  • Stefan Tai

Table of contents

  1. Front Matter
    Pages i-xiv
  2. Fundamentals

    1. Front Matter
      Pages 1-2
    2. David Bermbach, Erik Wittern, Stefan Tai
      Pages 5-9
    3. David Bermbach, Erik Wittern, Stefan Tai
      Pages 11-16
    4. David Bermbach, Erik Wittern, Stefan Tai
      Pages 17-25
    5. David Bermbach, Erik Wittern, Stefan Tai
      Pages 27-31
  3. Benchmark Design

    1. Front Matter
      Pages 33-34
    2. David Bermbach, Erik Wittern, Stefan Tai
      Pages 37-45
    3. David Bermbach, Erik Wittern, Stefan Tai
      Pages 47-60
    4. David Bermbach, Erik Wittern, Stefan Tai
      Pages 61-68
  4. Benchmark Execution

    1. Front Matter
      Pages 69-70
    2. David Bermbach, Erik Wittern, Stefan Tai
      Pages 73-83
    3. David Bermbach, Erik Wittern, Stefan Tai
      Pages 85-95
  5. Benchmark Results

    1. Front Matter
      Pages 97-98
    2. David Bermbach, Erik Wittern, Stefan Tai
      Pages 101-111
    3. David Bermbach, Erik Wittern, Stefan Tai
      Pages 113-121
    4. David Bermbach, Erik Wittern, Stefan Tai
      Pages 123-135
    5. David Bermbach, Erik Wittern, Stefan Tai
      Pages 137-145
  6. Conclusions

    1. Front Matter
      Pages 147-148
    2. David Bermbach, Erik Wittern, Stefan Tai
      Pages 151-153
    3. David Bermbach, Erik Wittern, Stefan Tai
      Pages 155-158
  7. Back Matter
    Pages 159-167

About this book

Introduction

Cloud service benchmarking can provide important, sometimes surprising insights into the quality of services and leads to a more quality-driven design and engineering of complex software architectures that use such services. Starting with a broad introduction to the field, this book guides readers step-by-step through the process of designing, implementing and executing a cloud service benchmark, as well as understanding and dealing with its results. It covers all aspects of cloud service benchmarking, i.e., both benchmarking the cloud and benchmarking in the cloud, at a basic level.
The book is divided into five parts: Part I discusses what cloud benchmarking is, provides an overview of cloud services and their key properties, and describes the notion of a cloud system and cloud-service quality. It also addresses the benchmarking lifecycle and the motivations behind running benchmarks in particular phases of an application lifecycle. Part II then focuses on benchmark design by discussing key objectives (e.g., repeatability, fairness, or understandability) and defining metrics and measurement methods, and by giving advice on developing own measurement methods and metrics. Next, Part III explores benchmark execution and implementation challenges and objectives as well as aspects like runtime monitoring and result collection. Subsequently, Part IV addresses benchmark results, covering topics such as an abstract process for turning data into insights, data preprocessing, and basic data analysis methods. Lastly, Part V concludes the book with a summary, suggestions for further reading and pointers to benchmarking tools available on the Web.
The book is intended for researchers and graduate students of computer science and related subjects looking for an introduction to benchmarking cloud services, but also for industry practitioners who are interested in evaluating the quality of cloud services or who want to assess key qualities of their own implementations through cloud-based experiments.

Keywords

Cloud Computing Software performance Benchmarks Software quality Experimentation Data analysis

Authors and affiliations

  • David Bermbach
    • 1
  • Erik Wittern
    • 2
  • Stefan Tai
    • 3
  1. 1.IInformation Systems Engineering Research GroupTechnische Universität BerlinBerlinGermany
  2. 2.IBM T.J. Watson Research Center New YorkUSA
  3. 3.Information Systems Engineering Research GroupTechnische Universität BerlinBerlinGermany

Bibliographic information

  • DOI https://doi.org/10.1007/978-3-319-55483-9
  • Copyright Information Springer International Publishing AG 2017
  • Publisher Name Springer, Cham
  • eBook Packages Computer Science
  • Print ISBN 978-3-319-55482-2
  • Online ISBN 978-3-319-55483-9
  • Buy this book on publisher's site
Industry Sectors
Automotive
Electronics
IT & Software
Telecommunications
Energy, Utilities & Environment
Aerospace
Engineering