Abstract
Web applications have become crucial components of current service-oriented business applications. Therefore, it is very important for the company’s reputation that the performance of a web application has been tested thoroughly before deployment. We present a tool-supported performance exploration approach to investigate how potential user behavioral patterns affect the performance of the system under test. This work builds on our previous work in which we generate load from workload models describing the expected behavior of the users. We mutate a given workload model (specified using Probabilistic Timed Automata) in order to generate different mutants. Each mutant is used for load generation using the MBPeT tool and the resource utilization of the system under test is monitored. At the end of an experiment, we analyze the mutants in two ways: cluster the mutants based on the resource utilization of the system under test and identify those mutants that satisfy the criteria of given objective functions.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Abbors, F., Ahmad, T., Truscan, D., Porres, I.: MBPeT: a model-based performance testing tool. In: 2012 Fourth International Conference on Advances in System Testing and Validation Lifecycle (2012)
Abbors, F., Ahmad, T., Truscan, D., Porres, I.: Model-based performance testing of web services using probabilistic timed automata. In: Proceedings of the 2013 10th International Conference on Web Information Systems and Technologies (2013)
Abbors, F., Truscan, D., Tanwir, A.: An automated approach for creating workload models from server log data. In: Andreas, H., Therese, L., Leszek, M., Stephen, M. (eds.) Proceedings of the 9th International Conference on Software Engineering and Applications. pp. 14–25. Scitepress (2014)
Barna, C., Litoiu, M., Ghanbari, H.: Model-based performance testing: NIER track. In: 2011 33rd International Conference on Software Engineering (ICSE), pp. 872–875. IEEE (2011)
Brillout, A., He, N., Mazzucchi, M., Kroening, D., Purandare, M., Rümmer, P., Weissenbacher, G.: Mutation-based test case generation for simulink models. In: de Boer, F.S., Bonsangue, M.M., Hallerstede, S., Leuschel, M. (eds.) FMCO 2009. LNCS, vol. 6286, pp. 208–227. Springer, Heidelberg (2010)
Budd, T.A., Gopal, A.S.: Program testing by specification mutation. Comput. Lang. 10(1), 63–73 (1985)
DeMillo, R.A., Lipton, R.J., Sayward, F.G.: Hints on test data selection: help for the practicing programmer. Computer 11(4), 34–41 (1978)
Django, September 2012. https://www.djangoproject.com/
Draheim, D., Grundy, J., Hosking, J., Lutteroth, C., Weber, G.: Realistic load testing of web applications. In: Proceedings of the 10th European Conference on Software Maintenance and Reengineering, CSMR 2006, p. 11. IEEE (2006)
Elbaum, S., Karre, S., Rothermel, G.: Improving web application testing with user session data. In: Proceedings of the 25th International Conference on Software Engineering, pp. 49–59. IEEE Computer Society (2003)
Hamlet, R.G.: Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. 4, 279–290 (1977)
Jia, Y., Harman, M.: Higher order mutation testing. Inf. Softw. Technol. 51(10), 1379–1393 (2009)
Kao, C.H., Lin, C.C., Chen, J.N.: Performance testing framework for rest-based web applications. In: 2013 13th International Conference on Quality Software (QSIC), pp. 349–354. IEEE (2013)
Kwiatkowska, M., Norman, G., Parker, D., Sproston, J.: Performance analysis of probabilistic timed automata using digital clocks. Formal Methods Syst. Des. 29, 33–78 (2006)
Lee, S.C., Offutt, J.: Generating test cases for xml-based web component interactions using mutation analysis. In: 12th International Symposium on Software Reliability Engineering, ISSRE 2001, Proceedings, pp. 200–209. IEEE (2001)
MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5-th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. University of California Press, Berkeley (1967)
Martin, E., Xie, T.: A fault model and mutation testing of access control policies. In: Proceedings of the 16th International Conference on World Wide Web, pp. 667–676. ACM (2007)
Menascé, D.A.: Load testing of web sites. IEEE Internet Comput. 6(4), 70–74 (2002)
Offutt, J.: Quality attributes of web software applications. IEEE Softw. 19(2), 25–32 (2002). doi:10.1109/52.991329
Python: Python programming language, October 2012. http://www.python.org/
Richardson, L., Ruby, S.: Restful Web Services, 1st edn. O’Reilly, Sebastopol (2007)
Schieferdecker, I., Grossmann, J., Schneider, M.: Model-based security testing. In: Proceedings 7th Workshop on Model-Based Testing, MBT 2012, Tallinn, Estonia, 25 March 2012, pp. 1–12 (2012). doi:10.4204/EPTCS.80.1
Subraya, B., Subrahmanya, S.: Object driven performance testing of web applications. In: First Asia-Pacific Conference on Quality Software, Proceedings, pp. 17–26. IEEE (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Ahmad, T., Abbors, F., Truscan, D. (2016). Automatic Performance Space Exploration of Web Applications. In: Altmann, J., Silaghi, G., Rana, O. (eds) Economics of Grids, Clouds, Systems, and Services. GECON 2015. Lecture Notes in Computer Science(), vol 9512. Springer, Cham. https://doi.org/10.1007/978-3-319-43177-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-43177-2_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43176-5
Online ISBN: 978-3-319-43177-2
eBook Packages: Computer ScienceComputer Science (R0)