Abstract
The TestUS framework offers a range of techniques to obtain a TTCN-3 test suite starting from UML 2.0 requirement definitions. Use case diagrams that contain functional and non-functional requirements are first transformed to a Markov Chain usage model (MCUM). Probability annotations of MCUM state transitions enable the generation of TTCN-3 test cases that reflect the expected usage patterns of system users. Because compiling the associated TTCN-3 test suite can take quite a long time for a realistic SUT (System under Test) we decided to map the MCUM directly into the executable test suite without generating test cases in advance. Test cases and the evaluation of test verdicts are interpreted on-the-fly during executing the test suite. We proved the concept by testing an existing DECT communication system. The compilation time for deriving an executable TTCN-3 test suite was reduced to only 15 minutes and one can interpret as many test cases as one likes on-the-fly.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beyer, M., Dulz, W.: Scenario-Based Statistical Testing of Quality of Service Requirements. In: Leue, S., Systä, T.J. (eds.) Scenarios: Models, Transformations and Tools. LNCS, vol. 3466, pp. 152–173. Springer, Heidelberg (2005)
Beyer, M., Dulz, W., Hielscher, K.-S.J.: Performance Issues in Statistical Testing. In: Proceedings MMB 2006, Nuremberg, Germany (2006)
Biegel, M.: StatisticalTesting of DECT Modules. In: Proceedings ITG Workshop on Model-Based Testing, Nuremberg, Germany (2006)
Broy, M., Jonsson, B., Katoen, J.-P. (eds.): Model-Based Testing of Reactive Systems. LNCS, vol. 3472, pp. 607–609. Springer, Heidelberg (2005)
ETSI: TTCN-3 Core Language. ES 201 873-1 V3.1.1 (2005)
Gutjahr, W.J.: Importance Sampling of Test Cases in Markovian Software Usage Models, Department of Statistics, Operations Research and Computer Science, University of Vienna (1997)
Haberditzl, T.: On-the-fly Interpretation von UML 2.0 Anwendungsszenarien in einer automatisch generierten TTCN-3 Testsuite. Masterthesis, Department of Computer Science, University of Erlangen-Nuremberg, Germany (2007)
Holpp, S.: Proving the Practicality of the Scenario-based Statistical Testing Approach within the Scope of the System Validation of a RIS/PACS System. Masterthesis, Department of Computer Science, University of Erlangen-Nuremberg, Germany (2008)
Musa, J.D.: Operational Profiles in Software-Reliability Engineering. IEEE Software (1993)
OMG: Unified Modeling Language - Superstructure. Version 2.1.1 (2007)
Rosaria, S., Robinson, H.: Applying models in your testing process. Information and Software Technology 42, 815–824 (2000)
Sayre, K.: Improved Techniques for Software Testing Based on Markov Chain Usage Models. PhD thesis, University of Tennessee, Knoxville (1999)
Tretmans, J., Brinksma, E.: Automated Model Based Testing. University of Twente (2002)
Walton, G.H., Poore, J.H., Trammell, C.J.: Statistical Ttesting of Software Based on a Usage Model. Software - Practice and Experience 25(1), 97–108 (1995)
Walton, G.H., Poore, J.H.: Generating transition probabilities to support model-based software testing. Software - Practice and Experience 30, 1095–1106 (2000)
Whittaker, J.A., Thomason, M.G.: A Markov Chain Model for Statistical Software Testing. IEEE Transactions on Software Engineering 20(10), 812–824 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dulz, W. (2010). On-the-Fly Testing by Using an Executable TTCN-3 Markov Chain Usage Model. In: Maciaszek, L.A., González-Pérez, C., Jablonski, S. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE ENASE 2009 2008. Communications in Computer and Information Science, vol 69. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14819-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-14819-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14818-7
Online ISBN: 978-3-642-14819-4
eBook Packages: Computer ScienceComputer Science (R0)