Skip to main content
SpringerLink
Log in

Robustness Validation in Service-Oriented Architectures

  • Chapter
Architecting Dependable Systems VI

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5835))

Abstract

The use of Service Oriented Architecture (SOA) in enterprise applications development is increasing very quickly. In a SOA environment providers supply a set of services that must be robust. Although SOA is being used in business-critical environments, there is no practical means to measure or compare the robustness of services. Robustness failures in such environments are dangerous, as they can be maliciously exploited with severe consequences for the attacked systems. This chapter addresses the problem of robustness validation in SOA environments. The approach proposed is based on a set of robustness tests that is used to discover both programming and design errors. Two concrete examples are presented: one focusing on web services and the other targeting Java Message Service (JMS) middleware. The proposed approach is useful for both providers (to validate the robustness of deployed services) and consumers (to select the services that best fit architectural requirements).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Apache Software Foundation: Apache ActiveMQ, http://activemq.apache.org/

  2. Apache Software Foundation: Apache Geronimo, http://geronimo.apache.org/

  3. Apache Software Foundation: Jakarta Commons Validator, http://jakarta.apache.org/commons/validator/

  4. Avizienis, A.: The Methodology of N-Version Programming. In: Lyu, M.R. (ed.) Software Fault Tolerance, pp. 23–46. Wiley, Chichester (1995)

    Google Scholar 

  5. Carrette, G.J.: CRASHME: Random Input Testing (1996), http://people.delphi.com/gjc/crashme.html

  6. Chen, S., Greenfield, P.: QoS Evaluation of JMS: An Empirical Approach. In: 37th Annual Hawaii Intl Conf. on System Sciences (HICSS 2004), Track 9, vol. 9, pp. 90276.2 (2004)

    Google Scholar 

  7. Chillarege, R.: Orthogonal Defect Classification. In: Lyu, M. (ed.) Handbook of Software Reliability Engineering, ch. 9. IEEE Computer Society Press, McGrow-Hill (1995)

    Google Scholar 

  8. Curbera, F., et al.: Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI. IEEE Internet Computing 6, 86–93 (2002)

    Article  Google Scholar 

  9. Erl, T.: Service-Oriented Architecture: Concepts, Technology, and Design. Prentice Hall, Upper Saddle River (2005)

    Google Scholar 

  10. Fabre, J.-C., Salles, F., Rodríguez, M., Arlat, J.: Assessment of COTS Microkernels by Fault Injection. In: 7th IFIP Working Conference on Dependable Computing for Critical Applications: DCCA-7, San Jose, CA, USA (1999)

    Google Scholar 

  11. Green, R.: UTF: Java Glossary. Roedy Green’s Java & Internet Glossary, http://mindprod.com/jgloss/utf.html

  12. JBoss: JBoss Application Server Documentation Library, http://labs.jboss.com/portal/jbossas/docs

  13. Kalyanakrishnam, M., Kalbarczyk, Z., Iyer, R.: Failure Data Analysis of a LAN of Windows NT Based Computers. In: Symposium on Reliable Distributed Database Systems, SRDS18, Switzerland, October 1999, pp. 178–187 (1999)

    Google Scholar 

  14. Koopman, P., et al.: Comparing operating systems using robustness benchmarks. In: The Sixteenth Symposium on Reliable Distributed Systems, pp. 72–79 (1997)

    Google Scholar 

  15. Koopman, P., DeVale, J.: Comparing the robustness of POSIX operating systems. In: 29th Annual Intl Symposium on Fault-Tolerant Computing, Digest of Papers, pp. 30–37 (1999)

    Google Scholar 

  16. Laranjeiro, N., Vieira, M., Henrique, M.: Experimental Robustness Evaluation of JMS Middleware. In: IEEE Services Computing Conference (SCC 2008), pp. 119–126 (2008)

    Google Scholar 

  17. Laranjeiro, N., Canelas, S., Vieira, M.: wsrbench: An On-Line Tool for Robustness Benchmarking. In: IEEE Services Computing Conference (SCC 2008), pp. 187–194 (2008)

    Google Scholar 

  18. Lee, I., Iyer, R.K.: Software Dependability in the Tandem GUARDIAN System. IEEE Transactions on Software Engineering 21(5), 455–467 (1995)

    Article  Google Scholar 

  19. Maron, J.: An overview of the CTS for J2EE component developers, http://www2.sys-con.com/ITSG/virtualcd/Java/archives/0701/maron/index.html

  20. Marsden, E., Fabre, J.-C.: Failure Mode Analysis of CORBA Service Implementations. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, p. 216. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  21. Mendonça, M., Neves, N.: Robustness Testing of the Windows DDK. In: 37th Annual IEEE/IFIP Intl Conference on Dependable Systems and Networks, pp. 554–564 (2007)

    Google Scholar 

  22. Menth, M., et al.: Throughput performance of popular JMS servers. In: Joint international conference on Measurement and modeling of computer systems, pp. 367–368 (2006)

    Google Scholar 

  23. Microsoft Corporation: Web Services Performance: Comparing Java 2TM Enterprise Edition (J2EETM platform) and the Microsoft®.NET Framework - A Response to Sun Microsystem’s Benchmark (2004)

    Google Scholar 

  24. Miller, B.P., Koski, D., Lee, C.P., Maganty, V., Murthy, R., Natarajan, A., Steidl, J.: Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services, University of Wisconsin, USA, Research Report, N°CS-TR-95-1268 (1995)

    Google Scholar 

  25. Mukherjee, A., Siewiorek, D.P.: Measuring Software Dependability by Robustness Benchmarking. IEEE Trans. of Software Engineering 23(6) (1997)

    Google Scholar 

  26. Pan, J., Koopman, P.J., Siewiorek, D.P., Huang, Y., Gruber, R., Jiang, M.L.: Robustness Testing and Hardening of CORBA ORB Implementations. In: Intl. Conference on Dependable Systems and Networks, DSN-2001, Gothenburg, Sweden, pp. 141–50 (2001)

    Google Scholar 

  27. Red Hat Middleware: JBossMQ (2007), http://www.jboss.org/

  28. Rodríguez, M., Albinet, A., Arlat, J.: MAFALDA-RT: A Tool for Dependability Assessment of Real-Time Systems. In: IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2002, Bethesda, MD, USA (2002)

    Google Scholar 

  29. Rodríguez, M., Salles, F., Fabre, J.-C., Arlat, J.: MAFALDA: Microkernel Assessment by fault injection and design aid. In: 3rd European Depend. Computing Conf., EDCC-3 (1999)

    Google Scholar 

  30. Shelton, C., Koopman, P., Vale, K.D.: Robustness Testing of the Microsoft Win32 API. In: Intl Conf. on Dependable Systems and Networks, DSN 2000, New York, USA (2000)

    Google Scholar 

  31. Siblini, R., Mansour, N.: Testing Web services. In: The 3rd ACS/IEEE International Conference on Computer Systems and Applications, p. 135 (2005)

    Google Scholar 

  32. Siewiorek, D.P., Hudak, J.J., Suh, B.-H., Segall, Z.: Development of a Benchmark to Measure System Robustness. In: 23rd International Symposium on Fault-Tolerant Computing, FTCS-23, Toulouse, France, pp. 88–97 (1993)

    Google Scholar 

  33. Standard Performance Evaluation Corporation (SPEC), http://www.spec.org

  34. SPEC: SPECjAppServer2004, http://www.spec.org/jAppServer2004/

  35. SPEC: SPECjms2007, http://www.spec.org/jms2007/

  36. Sun Microsystems Inc.: Java Enterprise Edition, http://java.sun.com/javaee/

  37. Sun Microsystems Inc.: High Performance JMS Messaging: A Benchmark Comparison of Sun Java System Message Queue and IBM WebSphere MQ (2003)

    Google Scholar 

  38. Sun Microsystems Inc.: Java Message Service (JMS) Sun Developer Network, http://java.sun.com/products/jms/

  39. Sun Microsystems Inc.: Web Services Performance: Comparing JavaTM 2 Enterprise Edition (J2EETM platform) and .NET Framework (2004)

    Google Scholar 

  40. Sun Microsystems, Inc.: Open Message Queue, https://mq.dev.java.net/

  41. Transaction Processing Performance Council (TPC), http://www.tpc.org

  42. Transaction Processing Performance Council, TPC BenchmarkTM App (Application Server) Standard Specification, Version 1.1, http://www.tpc.org/tpc_app/

  43. Vieira, M., Laranjeiro, N., Madeira, H.: Assessing Robustness of Web Services Infrastructures. In: The 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2007), pp. 131–136 (2007)

    Google Scholar 

  44. Vieira, M.: Dependability Benchmarking for Transactional Systems. PhD dissertation, University of Coimbra (2005)

    Google Scholar 

  45. Weyuker, E.: Testing Component-Based Software: A Cautionary Tale. IEEE Software (1998)

    Google Scholar 

  46. XMethods.net.: XMethods, http://xmethods.net/

  47. Xu, W., et al.: Testing Web services by XML perturbation. In: 16th IEEE International Symposium on Software Reliability Engineering, p. 10 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CISUC, Department of Informatics Engineering, University of Coimbra, 3030-290, Coimbra, Portugal

    Nuno Laranjeiro, Marco Vieira & Henrique Madeira

Authors
  1. Nuno Laranjeiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Vieira
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henrique Madeira
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computing Laboratory, Canterbury, University of Kent, CT2 7NF, Kent, UK

    Rogério de Lemos

  2. LAAS-CNRS, 7, avenue du Colonel Roche, 31077, Toulouse Cedex 4, France

    Jean-Charles Fabre

  3. School of Computing Science, Newcastle upon Tyne, University of Newcastle upon Tyne, NE1 7RU, UK

    Cristina Gacek

  4. Dipartimento di Informatica, Largo Pontecorvo 3c, Università di Pisa, 56127, Pisa, Italy

    Fabio Gadducci

  5. Istituto di Scienza e Tecnologie dell’Informazione (ISTI-CNR), Area della Ricerca di Pisa, Via G. Moruzzi 1, 56124, Pisa, Italy

    Maurice ter Beek

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Laranjeiro, N., Vieira, M., Madeira, H. (2009). Robustness Validation in Service-Oriented Architectures. In: de Lemos, R., Fabre, JC., Gacek, C., Gadducci, F., ter Beek, M. (eds) Architecting Dependable Systems VI. Lecture Notes in Computer Science, vol 5835. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10248-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-10248-6_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-10247-9

  • Online ISBN: 978-3-642-10248-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation