Skip to main content
SpringerLink
Log in
Book cover

Advanced Web Services pp 171–197Cite as

A Test Automation Framework for Collaborative Testing of Web Service Dynamic Compositions

  • Chapter
  • First Online:

Abstract

The dynamic composition of services owned by different vendors demands a high degree of test automation, which must be able to cope with the diversity of service implementation techniques and to meet a wide range of test requirements on-the-fly. These goals are hard to achieve because of the lack of software artefacts of the composed services and the lack of the means of control over test executions and the means of observations on the internal behaviours of composed services. Yet, such integration testing on-the-fly must be non-intrusive and non-disruptive while the composed services are in operation. This chapter presents a test automation framework for such on-the-fly testing of service compositions to facilitate the collaboration between test services through utilisation of Semantic Web Services techniques. In this framework, an ontology of software testing called STOWS are used for the registration, discovery and invocation of test services. The composition of test services is realized by using test brokers, which are also test services but specialized in the coordination of other test services. The ontology can be extended and updated through an ontology management service so that it can support a wide open range of test activities, methods, techniques and types of software artefacts. We also demonstrate the uses of the framework by two running examples.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.w3.org/Submission/OWL-S/

  2. 2.

    http://www.mindswap.org/2004/owl-s/api/

  3. 3.

    http://protege.stanford.edu/plugins/owl/api/guide.html

  4. 4.

    http://www.pingan.com/campaign/channels/pingan/car-quote/index.jsp

  5. 5.

    Java NCSS can be found at URL: http://javancss.codehaus.org/, and PMD can be found at URL: http://pmd.sourceforge.net/

References

  1. de Almeida, L.F., Vergilio, S.R.: Exploring perturbation based testing for web services. In: Proc. of ICWS’06, pp. 717–726. IEEE CS (2006)

    Google Scholar 

  2. Bai, X., Dong, W., Tsai, W., Chen, Y.: Wsdl-based automatic test case generation for web services testing. In: Proc. of SOSE’05, pp. 215–220. IEEE CS (2005)

    Google Scholar 

  3. Bai, X., Lee, S., Tsai, W.T., Chen, Y.: Ontology-based test modeling and partition testing of web services. In: Proc. of ICWS’08, pp. 465–472. IEEE CS (2008)

    Google Scholar 

  4. Bartolini, C., Bertolino, A., Marchetti, E.: Introducing service-oriented coverage testing. In: Proc. of ASE’08, pp. 57–64. IEEE CS (2008)

    Google Scholar 

  5. Bartolini, C., Bertolino, A., Marchetti, E., Parissis, I.: Data flow-based validation of web services compositions: Perspectives and examples. In: R.e.a. Lemos V (ed.) Architecting Dependable Systems, LNCS, vol. 5135, pp. 298–325. Springer-Verlag (2008)

    Google Scholar 

  6. Belli, F., Linschulte, M.: Event-driven modeling and testing of web services. In: Proc. of COMPSAC’08, pp. 1168–1173. IEEE CS (2008)

    Google Scholar 

  7. Berners-Lee, T., Hendler, J., Lassila, O.: The semantic web. Scientific American 284(5), 34–43 (2001).

    Google Scholar 

  8. Bertolino, A., Angelis, G.D., Frantzen, L., Polini, A.: Model-based generation of testbeds for web services. In: Proc. of TestCom/FATES’08, pp. 266–282 (2008)

    Google Scholar 

  9. Bertolino, A., Angelis, G.D., Frantzen, L., Polini, A.: The plastic framework and tools for testing service-oriented applications. In: Software Engineering: Int’l Summer Schools, (ISSSE’08), pp. 106–139 (2008)

    Google Scholar 

  10. Bertolino, A., Gao, J., Marchetti, E.: Xml every-flavor testing. In: Proc. of WEBIST’06, pp. 268–273. INSTICC Press (2006)

    Google Scholar 

  11. Bertolino, A., Gao, J., Marchetti, E., A.Polini: Taxi-a tool for xml-based testing. In: Proc. of ICSE’07 (Companion), pp. 53–54. IEEE CS (2007)

    Google Scholar 

  12. Bertolino, A., Gao, J., Marchetti, E., Polini, A.: Automatic test data generation for xml schema-based partition testing. In: Proc. of AST’07, p. 4. IEEE CS (2007)

    Google Scholar 

  13. Bertolino, A., Gao, J., Marchetti, E., Polini, A.: Systematic generation of xml instances to test complex software applications. In: N.e.a. Guelfi (ed.) Rapid Integration of Software Engineering Techniques, LNCS, vol. 4401, pp. 114–129. Springer (2007)

    Google Scholar 

  14. Bertolino, A., Polini, A.: The audition framework for testing web services interoperability. In: Proc. of EUROMICRO’05, pp. 134–142 (2005)

    Google Scholar 

  15. Bozkurt, M., Harman, M., Hassoun, Y.: Testing & verification in service-oriented architecture: A survey. Software Testing, Verification and Reliability (STVR) (To Appear).

    Google Scholar 

  16. Cadar, C., Dunbar, D., Engler, D.: Klee: Unassisted and Automatic Generation of High-Coverage Tests for Complex Systems Programs. OSDI (2008)

    Google Scholar 

  17. Canfora, G., Penta, M.: Testing services and service-centric systems: Challenges and opportunities. IT Professional 8(2), 10–17 (2006)

    Google Scholar 

  18. Canfora, G., Penta, M.: Service-oriented architectures testing: A survey. In: A. Lucia, F. Ferrucci (eds.) Software Engineering: Int’l Summer Schools (ISSSE 2006–2008), Revised Tutorial Lectures, LNCS, vol. 5413, pp. 78–105. Springer-Verlag (2009)

    Google Scholar 

  19. Chan, W.K., Cheung, S.C., Leung, K.R.P.H.: A metamorphic testing approach for online testing of service-oriented software applications. Int’l Journal of Web Services Research 4(2), 61–81 (2007)

    Google Scholar 

  20. Edmund, S.C., Clarke, E., Groce, A., Jha, S., Vienna, T.: Modular verification of software components in c. IEEE Trans. Softw. Eng. 30, 388–402 (2004)

    Google Scholar 

  21. Emer, M.P., Vergilio, S.R., Jino, M.: A testing approach for xml schemas. In: Proc. of COMPSAC’05, pp. 57–62. IEEE CS (2005)

    Google Scholar 

  22. Garcia-Fanjul, J., Tuya, J., de la Riva, C.: Generating test cases specifications for bpel compositions of web services using spin. In: Proc. of WS-MaTe (2006)

    Google Scholar 

  23. Hanna, S., Munro, M.: An approach for wsdl-based automated robustness testing of web services. In: C.e.a. Barry (ed.) Information Systems Development: Challenges in Practice, Theory, and Education, vol. 2, pp. 493–504. Springer (2009)

    Google Scholar 

  24. Heckel, R., Lohmann, M.: Towards contract-based testing of web services. Electronic Notes in Theoretical Computer Science 82(6) (2004)

    Google Scholar 

  25. Heckel, R., Mariani, L.: Automatic conformance testing of web services. In: Proc. of FASE’05, pp. 34–48. Springer (2005)

    Google Scholar 

  26. Hovemeyer, D., Pugh, W.: Finding more null pointer bugs, but not too many. In: Proc. of PASTE’07, pp. 9–14 (2007)

    Google Scholar 

  27. Huang, H., Liu, H., Li, Z., Zhu, J.: Surrogate: A simulation apparatus for continuous integration testing in service oriented architecture. In: Proc. of SCC’08, vol. 2, pp. 223–230. IEEE CS (2008)

    Google Scholar 

  28. Huang, H., Tsai, W., Paul, R., Chen, Y.: Automated model checking and testing for composite web services. In: Proc. of ISORC’05, pp. 300–307. IEEE CS (2005)

    Google Scholar 

  29. IICMVA: Model user guide for implementing online insurance verification, version 4, Insurance Industry Committee on Motor Vehicle Administration, USA. http://www.iicmva.com/IICMVAPublications.html (2010). (Accessed on 20 Oct. 2010).

  30. K. Sycara M. Paolucci, A., Srinivasan, N.: Automated discovery, interaction and composition of semantic web services. J. Web Semantics 1(1), 27–46 (2003)

    Google Scholar 

  31. Kaschner, K., Lohmann, N.: Automatic test case generation for services. In: Proc. of Fourth Int’l Workshop on Engineering Service-Oriented Applications: Analysis and Design (WESOA 2008), LNCS. Springer-Verlag (2008)

    Google Scholar 

  32. Kawamura, T., Blasio, J.A.D., Hasegawa, T., Paolucci, M., Sycara, K.: A preliminary report of a public experiment of a semantic service matchmaker combined with a uddi business registry. In: Proc. of ICSOC’03, pp. 208–224. IEEE CS (2003)

    Google Scholar 

  33. Lallali, M., Zaidi, F., Cavalli, A., Hwang, I.: Automatic timed test case generation for web services composition. In: Proc. of ECOWS’08, pp. 53–62 (2008)

    Google Scholar 

  34. Lee, S.C., Offutt, J.: Generating test cases for xml-based web component interactions using mutation analysis. In: Proc. of ISSRE’01, pp. 200–209. IEEE CS (2001)

    Google Scholar 

  35. Li, J.B., Miller, J.: Testing the semantics of w3c xml schema. In: Proc. of COMPSAC’05, pp. 443–448. IEEE CS (2005)

    Google Scholar 

  36. Li, Z., Sun, W., Jiang, Z.B., Zhang, X.: Bpel4ws unit testing: Framework and implementation. In: Proc. of ICWS’05, pp. 103–110. IEEE CS (2005)

    Google Scholar 

  37. Looker, N., Munro, M., Xu, J.: Ws-fit: A tool for dependability analysis of web services. In: Proc. of COMPSAC’04, pp. 120–123. IEEE CS (2004)

    Google Scholar 

  38. Magee, J., Kramer, J., Uchitel, S., Foster, H.: Ltsa-ws: a tool for model-based verification of web service compositions and choreography. In: Proc. of ICSE’06, pp. 771–774. IEEE CS (2006)

    Google Scholar 

  39. Mayer, P.: Design and implementation of a framework for testing bpel compositions. Master’s thesis, Leibnitz Univ., Germany (2006)

    Google Scholar 

  40. Mei, L., Chan, W.K., Tse, T.H.: Data flow testing of service-oriented workflow applications. In: Proc. of ICSE’08, pp. 371–380. IEEE CS (2008)

    Google Scholar 

  41. Offutt, J., Xu, W.: Generating test cases for web services using data perturbation. SIGSOFT Softw. Eng. Notes 29(5), 1–10 (2004)

    Google Scholar 

  42. Shan, L., Zhu, H.: Generating structurally complex test cases by data mutation. The Computer Journal 52, 571–588 (2009)

    Google Scholar 

  43. Srinivasan, N., Paolucci, M., Sycara, K.: Adding owl-s to uddi, implementation and throughput. In: Proc. of The 1st Int’l Workshop on Semantic Web Services and Web Process Composition, pp. 169–182 (2004)

    Google Scholar 

  44. Tsai, W., Chen, Y., Paul, R., Liao, N., Huang, H.: Cooperative and group testing in verification of dynamic composite web services. In: Proc. of COMPSAC’04, vol. 2: Workshops and Fast Abstracts, pp. 170–173. IEEE CS (2004)

    Google Scholar 

  45. Tsai, W., Paul, R., Song, W., Cao, Z.: Coyote: An xml-based framework for web services testing. In: Proc. of HASE’02, pp. 173–174. IEEE CS (2002)

    Google Scholar 

  46. Tsai, W., Wei, X., Chen, Y., Paul, R., Bai, X.: Swiss cheese test case generation for web services testing. IEICE - Trans. Inf. Syst. 88(12), 2691–2698 (2005)

    Google Scholar 

  47. Tsai, W., Zhou, X., Chen, Y., Bai, X.: On testing and evaluating service-oriented software. Computer 41(8), 40–46 (2008)

    Google Scholar 

  48. Wang, Y., Bai, X., Li, J., Huang, R.: Ontology-based test case generation for testing web services. In: Proc. of ISADS’07, pp. 43–50. IEEE CS (2007)

    Google Scholar 

  49. Xu, W., Offutt, J., Luo, J.: Testing web services by xml perturbation. In: Proc. of ISSRE’05, pp. 257–266. IEEE CS (2005)

    Google Scholar 

  50. Yu, B., Kong, L., Zhang, Y., Zhu, H.: Testing java components based on algebraic specifications. In: Proc. of ICST’08, pp. 190–199. IEEE CS (2008)

    Google Scholar 

  51. Zhang, Y., Zhu, H.: Ontology for service oriented testing of web services. In: Proc. of SOSE’08. IEEE CS (2008)

    Google Scholar 

  52. Zhang, Y., Zhu, H.: An intelligent broker approach to semantics-based service composition. In: Proc. of COMPSAC 2011, pp. 20–25. IEEE CS, Munich, Germany (2011)

    Google Scholar 

  53. Zheng, Y., Zhou, J., Krause, P.: An automatic test case generation framework for web services. Journal of Software 2(3), 64–77 (2007)

    Google Scholar 

  54. Zhu, H.: A framework for service-oriented testing of web services. In: Proc. of COMPSAC’06, pp. 679–691. IEEE CS (2006)

    Google Scholar 

  55. Zhu, H., Huo, Q.: Developing a software testing ontology in uml for a software growth environment of web-based applications. In: e. H. Yang (ed.) Software Evolution with UML and XML, pp. 263–295. IDEA Group Inc. (2005)

    Google Scholar 

  56. Zhu, H., Huo, Q., Greenwood, S.: A multi-agent software environment for testing web-based applications. In: Proc. of COMPSAC’03, pp. 210–215. IEEE CS (2003)

    Google Scholar 

  57. Zhu, H., Zhang, Y.: Collaborative testing of web services. IEEE Transactions on Services Computing 5(1), 116–130 (2012)

    Google Scholar 

Download references

Acknowledgments

The work reported in this chapter is partly funded by the National Basic Research Program of China (973) under Grant No. 2011CB302603 and the National Natural Science Foundation of China under Grant No. 60725206.

Author information

Authors and Affiliations

  1. Department of Computing and Communication Technologies, Oxford Brookes University, Oxford, OX33 1HX, UK

    Hong Zhu

  2. National Laboratory for Parallel and distributed Processing School of Computer Science, The National University of Defense Technology, Changsha, China

    Yufeng Zhang

Authors
  1. Hong Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yufeng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hong Zhu .

Editor information

Editors and Affiliations

  1. School of Computer Science and Information Technology, RMIT University, Melbourne, Victoria, Australia

    Athman Bouguettaya

  2. Engineering Auto-ID Lab, University of Adelaide School of Computer Science, Adelaide, South Australia, Australia

    Quan Z. Sheng

  3. dell'Informazione, Università di Trento Dipto. Ingegneria e Scienza, Povo, Trento, Italy

    Florian Daniel

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Zhu, H., Zhang, Y. (2014). A Test Automation Framework for Collaborative Testing of Web Service Dynamic Compositions. In: Bouguettaya, A., Sheng, Q., Daniel, F. (eds) Advanced Web Services. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7535-4_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7535-4_8

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-7534-7

  • Online ISBN: 978-1-4614-7535-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation