Application of Metamorphic Testing to a Case Study in Web Services Compositions

  • Carmen Castro-Cabrera
  • Inmaculada Medina-Bulo
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 314)


Web services compositions are being widely adopted by developers, therefore the economic impact of WS-BPEL service compositions has increased, and deeper insight on how to test them effectively is required. In fact, new software testing techniques are being developed nowadays, specially those related with applications to Web Services, because of transations through Internet. Languages for composing web services, such as the OASIS WS-BPEL 2.0 standard, open a new field for large-scale programming and they present a challenge for traditional quality assurance. Metamorphic Testing has proved useful to test and improve the quality of traditional imperative programs. This paper presents a proposal to use Metamorphic Testing to WS-BPEL compositions and provides a component diagram and an implementation approach as well as a case study with promising results.


Business Process Test Suite Service Composition Test Case Generation Component Diagram 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    ActiveVOS: ActiveBPEL WS-BPEL Engine (October 2009),
  2. 2.
    Andrews, J.H., Briand, L.C., Labiche, Y.: Is mutation an appropriate tool for testing experiments? In: Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), pp. 402–411. ACM Press (2005)Google Scholar
  3. 3.
    Beizer, B.: Software Testing Techniques, 2nd edn. International Thomson Computer Press, 2 sub edn. (June 1990)Google Scholar
  4. 4.
    Bozkurt, M., Harman, M., Hassoun, Y.: TR-10-01: testing web services: A survey. Tech. Rep. TR-10-01, King’s College, London (2010)Google Scholar
  5. 5.
    Chan, W.K., Cheung, S.C., Leung, K.R.: A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research 4(2), 61–81 (2007)CrossRefGoogle Scholar
  6. 6.
    Chan, W.K., Cheung, S., Leung, K.: Towards a metamorphic testing methodology for service-oriented software applications. In: Fifth International Conference on Quality Software (QSIC 2005), pp. 470–476 (2006)Google Scholar
  7. 7.
    Chen, T.Y.: Metamorphic testing: A new approach for generating next test cases. Technical Report HKUST-CS98-01, Department of. Computer Science, Hong Kong University of Science and Technology (1998)Google Scholar
  8. 8.
    Chen, T.Y.: Metamorphic testing: A simple approach to alleviate the oracle problem. In: Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering. IEEE Computer Society (2010)Google Scholar
  9. 9.
    Chen, T.Y., Feng, J., Tse, T.H.: Metamorphic testing of programs on partial differential equations: A case study. In: Proceedings of the 26th International Computer Software and Applications Conference on Prolonging Software Life: Development and Redevelopment, COMPSAC 2002, pp. 327–333. IEEE Computer Society, Washington, DC (2002), Google Scholar
  10. 10.
    Chen, T.Y., Huang, D.H., Tse, T.H., Zhou, Z.Q.: Case studies on the selection of useful relations in metamorphic testing. In: Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC 2004), pp. 569–583 (2004)Google Scholar
  11. 11.
    Domínguez-Jiménez, J.J., Estero-Botaro, A., García-Domínguez, A., Medina-Bulo, I.: GAmera: An automatic mutant generation system for WS-BPEL compositions. In: ECOWS 2009: Seventh IEEE European Conference on Web Services, pp. 97–106. IEEE Computer Society, Eindhoven (2009)CrossRefGoogle Scholar
  12. 12.
    García-Fanjul, J., Tuya, J., de la Riva, C.: Generación sistemática de pruebas para composiciones de servicios utilizando criterios de suficiencia basados en transiciones. In: JISBD 2007: Actas de las XII Jornadas de Ingeniería del Software y Bases de Datos (2007)Google Scholar
  13. 13.
    Gotlieb, A., Botella, B.: Automated metamorphic testing. In: Annual International on Computer Software and Applications Conference, pp. 34–40 (2003)Google Scholar
  14. 14.
    IDC: Research reports (2008),
  15. 15.
    Mayer, P., Lübke, D.: Towards a BPEL unit testing framework. In: TAV-WEB 2006: Proceedings of the 2006 workshop on Testing, Analysis, and Verification of Web Services and Applications, pp. 33–42. ACM, New York (2006)CrossRefGoogle Scholar
  16. 16.
    Murphy, C., Kaiser, G., Hu, L., Wu, L.: Properties of machine learning applications for use in metamorphic testing. In: Proc. of the 20th International Conference on Software Engineering and Knowledge Engineering (SEKE), pp. 867–872 (2008)Google Scholar
  17. 17.
    Murphy, C., Shen, K., Kaiser, G.: Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles. In: International Conference on Software Testing Verification and Validation, ICST 2009, pp. 436–445 (2009)Google Scholar
  18. 18.
    Myers, G.J., Sandler, C., Badgett, T., Thomas, T.M.: The Art of Software Testing, 2nd edn. Wiley - Interscience (2004)Google Scholar
  19. 19.
    OASIS: Web Services Business Process Execution Language 2.0 (2007),, Organization for the Advancement of Structured Information Standards
  20. 20.
    Segura, S., Hierons, R.M., Benavides, D., Ruiz-Cortes, A.: Automated test data generation on the analyses of feature models: A metamorphic testing approach. In: 2008 International Conference on Software Testing, Verification, and Validation, pp. 35–44 (2010)Google Scholar
  21. 21.
    UCASE Research Group: GAmera home site (2010),
  22. 22.
    UCASE Research Group: Takuan home site (May 2010),
  23. 23.
    Weyuker, E.: On testing Non-Testable programs. The Computer Journal 25(4), 465–470 (1982), CrossRefGoogle Scholar
  24. 24.
    Yan, J., Li, Z., Yuan, Y., Sun, W., Zhang, J.: BPEL4WS unit testing: Test case generation using a concurrent path analysis approach. In: ISSRE 2006: 17th International Symposium on Software Reliability Engineering, pp. 75–84. IEEE Computer Society, Raleigh (2006)CrossRefGoogle Scholar
  25. 25.
    Zhang, Z.Y., Chan, W.K., Tse, T.H., Hu, P.F.: An experimental study to compare the use of metamorphic testing and assertion checking. Journal of Software 20(10), 2637–2654 (2009)CrossRefGoogle Scholar
  26. 26.
    Zheng, Y., Zhou, J., Krause, P.: An automatic test case generation framework for web services. Journal of Software 2(3), 64–77 (2007)CrossRefGoogle Scholar
  27. 27.
    Zhou, Z.Q., Huang, D.H., Tse, T.H., Yang, Z., Huang, H., Chen, T.Y.: Metamorphic testing and its applications. In: Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004), Software Engineers Association (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Carmen Castro-Cabrera
    • 1
  • Inmaculada Medina-Bulo
    • 1
  1. 1.Department of Computer Languages and SystemsUniversity of CádizCádizSpain

Personalised recommendations