Challenges in Evaluating SOA Test Processes

  • Ayaz Farooq
  • Konstantina Georgieva
  • Reiner R. Dumke
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5338)


Service-oriented architecture enables creation of enterprise-wide and cross-enterprise flexible, dynamic business processes and agile applications. The performance, reliability and other quality aspects of such systems, thus, become very important for the success of businesses. Testing is a way to evaluate these quality attributes. However, the new unique architecture style of SOA-based systems calls for reorienting testing procedures, methods, techniques, and tools etc. In this paper we discuss how we can evaluate efficiency and effectiveness of SOA test process. Considering an existing generic test process evaluation framework, we attempt to highlight areas where necessary adjustments to this framework are needed to care for the specialized testing perspectives of SOA-based systems.


Service-oriented architecture software test process test process evaluation test process improvement software measurement 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Erl, T.: SOA Principles of Service Design. Prentice Hall PTR, Upper Saddle River (2007)Google Scholar
  2. 2.
    Stojanovic, Z., Dahanayake, A.: Service-oriented Software System Engineering Challenges and Practices. Idea Group Inc., Hershey (2005)CrossRefGoogle Scholar
  3. 3.
    Papazoglou, M.P., Traverso, P., Dustdar, S., Leymann, F.: Service-oriented computing: State of the art and research challenges. Computer 40(11), 38–45 (2007)CrossRefGoogle Scholar
  4. 4.
    Kontogiannis, K., Lewis, G.A., Smith, D.B.: A research agenda for service-oriented architecture. In: SDSOA 2008: Proceedings of the 2nd international workshop on Systems development in SOA environments, pp. 1–6. ACM, New York (2008)Google Scholar
  5. 5.
    Dustdar, S., Haslinger, S.: Testing of service-oriented architectures - a practical approach. In: Weske, M., Liggesmeyer, P. (eds.) NODe 2004. LNCS, vol. 3263, pp. 97–109. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Ribarov, L., Manova, I., Ilieva, S.: Testing in a service-oriented world. In: InfoTech 2007: Proceedings of the International Conference on Information Technologies (2007)Google Scholar
  7. 7.
    Farooq, A., Schmietendorf, A., Dumke, R.R.: A quantitative evaluation framework for software test process. In: CONQUEST 2008: Proceedings of the International Conference on Quality Engineering in Software Technology, Aachen, Germany. Shaker Verlag GmbH (2008)Google Scholar
  8. 8.
    Canfora, G., Penta, M.D.: Testing services and service-centric systems: Challenges and opportunities. IT Professional 8(2), 10–17 (2006)CrossRefGoogle Scholar
  9. 9.
    Parveen, T., Tilley, S.: A research agenda for testing SOA-based systems. In: Proceeding of 2008 2nd Annual IEEE Systems Conference, pp. 1–6. IEEE Computer Society, Los Alamitos (2008)CrossRefGoogle Scholar
  10. 10.
    Lewis, G.A., Morris, E., Simanta, S., Wrage, L.: Effects of service-oriented architecture on software development lifecycle activities. Software Process: Improvement and Practice 13(2), 135–144 (2008)CrossRefGoogle Scholar
  11. 11.
    Linthicum, D.S., Murphy, J.: Key Strategies for SOA Testing. Mindreef Inc., Hollis (2007)Google Scholar
  12. 12.
    O’Brien, L., Merson, P., Bass, L.: Quality attributes for service-oriented architectures. In: SDSOA 2007: Proceedings of the International Workshop on Systems Development in SOA Environments, Washington, DC, USA, p. 3. IEEE Computer Society, Los Alamitos (2007)Google Scholar
  13. 13.
    Rud, D., Schmietendorf, A., Dumke, R.R.: Product metrics for service-oriented infrastructures. In: IWSM/MetriKon 2006: Proceedings of the International Workshop on Software Measurement and DASMA Software Metrik Kongress, Aachen, Germany, pp. 161–174. Shaker Verlag GmbH (2006)Google Scholar
  14. 14.
    Rud, D., Dumke, A.S.R.R.: Resource metrics for service-oriented infrastructures. In: SEMSOA 2007: Workshop on Software Engineering Methods for Service Oriented Architecture, pp. 90–98 (2007)Google Scholar
  15. 15.
    Rud, D., Mencke, S., Schmietendorf, A., Dumke, R.R.: Granularitätsmetriken für serviceorientierte architekturen. In: MetriKon 2007: Proceedings of the DASMA Software Metrik Kongress, Kaiserslautern, Germany, pp. 297–308. Shaker Verlag GmbH (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Ayaz Farooq
    • 1
  • Konstantina Georgieva
    • 1
  • Reiner R. Dumke
    • 1
  1. 1.Institute for Distributed SystemsUniversity of MagdeburgMagdeburgGermany

Personalised recommendations