System Under Test
A System Under Test (SUT) is a complete system that comprises hardware, software, and connectivity components; that is the object or target of a performance measurement test or benchmark.
While the term System Under Test is somewhat generic in nature, it was formalized in the early 1990s by industry consortiums with the mission of defining industry standard performance benchmarks, such as the Transaction Processing Performance Council (TPC – www.tpc.org), the Standard Performance Evaluation Corporation (SPEC – www.spec.org), and the Storage Performance Council (SPC – www.storageperformance.org).
The purpose of a test or benchmark is to determine how a target environment behaves under a controlled load or in response to specific requests. As such, the definition of the System Under Test plays a key role in a benchmark specification. The SUT’s definition...
- Anon et al (1985) A measure of transaction processing power. Datamation 31:112–118Google Scholar
- Huppler K (2009) The art of building a good benchmark. In: Nambiar R, Poess M (eds) Performance evaluation and benchmarking, vol 5895. Springer, Berlin/Heidelberg, pp 18–30. https://link.springer.com/chapter/10.1007/978-3-642-10424-4_3Google Scholar