Abstract
In order to remain useful test scripts must evolve parallel to the test objects they are intended to test. In the approach described here the test objects are web services whose test script is derived from the web service interface definition. The test script structure is automatically generated from the WSDL structure with tags and attributes, however, the content, i.e. the test data has to be inserted by hand. From this script service requests are automatically generated and service responses automatically validated. As with other generated software artifacts, once the structure of the interface or the logic of the targeted service is changed, the content of the test script is no longer valid. It has to be altered and/or enhanced to fit the new interface structure and/or the altered service logic. In this paper the author proposes a semi-automated approach to solving this test maintenance problem and explains how it has been implemented in a web service testing tool by employing data reverse engineering techniques. The author also report on his experience with the approach when maintaining a test in the field.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Everett, G., McLeod, R.: Software Testing – Testing Across the Entire Software Development Life Cycle, p. 29. IEEE Press, Wiley, Hoboken (2007)
Polo, M., Reales, P., Piattini, M., Ebert, C.: Test automation. IEEE Soft. 30(1), 84 (2013)
Sneed, H.: Bridging the concept to implementation gap in software testing. In: 8th International Conference on Software Quality (QSIC 2008), Oxford (2008)
Eriksson, H.-E., Penker, M.: Business Modelling with UML. Wiley, New York (2000)
Rich, C., Waters, R.: The programmer’s apprentice. IEEE Comput. 21(11), 10–25 (1988)
Swartout, V., Balzer, R.: On the inevitable intertwining of specification and implementation. Commun. ACM 25(7), 112 (1982)
Fetzer, J.: Program verification – the very idea. Commun. ACM 31(9), 479 (1988)
Sneed, H.: The myth of top-down software development. In: Proceedings of ICSM-1989, Miami, p. 22, October 1989
Jacobson, I.: UML – all the way down. In: Keynote Speech, ICSM-2001, Florence, November 2001
Reiss, S.: Incremental maintenance of software artifacts. IEEE Trans. SE 32(9), 682 (2006)
Sneed, H.: Testing against natural language requirements. In: 7th IEEE International Conference on Software Quality (QSIC2007), Portland, p. 380, October 2007
Sneed, H.M.: Testing web services in the cloud. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2013. LNBIP, vol. 133, pp. 70–88. Springer, Heidelberg (2013)
Sneed, H., Verhoef, C.: Natural language requirement specification for web service testing. In: IEEE Proceedings of MESOCA-2013, Eindhoven, p. 19, September 2013
Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. SE 37(2), 649 (2011)
DeMillo, R., Offutt, J.: Constraint-based automatic test data generation. IEEE Trans. SE 17(9), 900 (1991)
Andrikopoulos, V., Benbernou, S., Papazoglou, M.: On the evolution of services. IEEE Trans. SE 38(3), 609 (2012)
Martin, R., Melnik, G.: Tests and requirements, and tests – a mobius strip. IEEE Softw. 25, 54 (2008)
Meservy, T., Zhang, C., Lee, E.T.: The business rules approach and its effect on software testing. IEEE Softw. Mag. 29(4), 60 (2012)
Mesbah, A., Deursen, A., Roest, D.: Invariant-based automatic testing of modern web applications. IEEE Trans. SE 38(1), 35 (2012)
Mens, T.: State of the art survey on software merging. Trans. SE 28(5), 449 (2002)
Linz, T.: Testing in Scrum Projects, p. 11. dpunkt, Heidelberg (2013)
Canfora, G., DiPenta, M.: Testing services and service-centric systems – challenges and opportunities. IT Prof. 8, 10 (2006)
Sneed, H., Huang, S.: The design and use of WSDLTest – a tool for testing web services. J. Softw. Maintenance Evol. 19(5), 297 (2007)
Sneed, H., Verhoef, C.: Cloud service testing. Prof. Tester Mag. 5, 36 (2014)
Bozkurt, M., Harman, M., Hassoun, Y.: Testing Web Services – A Survey, Software Test Verification and Reliability, vol. 18, no. 2. Wiley Interscience (2007). doi: 10.1002/000
Soap-UI – the home of functional testing. http://www.soapui.org
Storm. http://storm.codeplex.com
Apache apache JMeter. http://jmeter.apache.org/
Li, H., Thompson, S., Lamela Seijas, P., Francisco, M.A.: Automating property-based testing of evolving web services. In: Proceedings of the ACM SIGPLAN 2014 Workshop on Partial Evaluation and Program Manipulation, pp. 169–180, January 2014
International standard organization (2006). ISO/IEC-19757-3 Document Schema Definition Languages (DSDL) - Rule-based validation — Schematron, Geneve (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Sneed, H.M. (2016). Web Service Test Evolution. In: Winkler, D., Biffl, S., Bergsmann, J. (eds) Software Quality. The Future of Systems- and Software Development. SWQD 2016. Lecture Notes in Business Information Processing, vol 238. Springer, Cham. https://doi.org/10.1007/978-3-319-27033-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-27033-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27032-6
Online ISBN: 978-3-319-27033-3
eBook Packages: Computer ScienceComputer Science (R0)