Automatic Conformance Testing of Internet Applications

  • Harm M. A. van Beek
  • Sjouke Mauw
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2931)


We adapt and extend the theories used in the general framework of automated software testing in such a way that they become suitable for black-box conformance testing of thin client Internet applications. That is, we automatically test whether a running Internet application conforms to its formal specification. The actual implementation of the application is not taken into account, only its externally observable behaviour. In this paper, we show how to formally model this behaviour and how such formal specifications can serve as a basis for the automatic conformance testing of Internet applications.


Transition System Test Suite Label Transition System Internet Application Conformance Testing 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Regan, K.: U.S.: E-Commerce Topped $45B in 2002. E-Commerce Times (2003)Google Scholar
  2. 2.
    ACM Committee on Computers and Public Policy, P.G. Neumann, moderator: The Risk Digest, Forum On Risks To The Publi. In Computers And Related Systems (1985–2003),
  3. 3.
    Brinksma, E., Tretmans, J.: Testing Transition Systems: An Annotated Bibliography. In: Cassez, F., Jard, C., Rozoy, B., Dermot, M. (eds.) MOVEP 2000. LNCS, vol. 2067, pp. 44–50. Springer, Heidelberg (2000)Google Scholar
  4. 4.
    Fielding, R., Gettys, J., Mogul, J.C., Frystyk, H., Masinter, L., Leach, P., Berners-Lee, T.: Hypertext transfer protocol – HTTP/1.1. RFC 2616. The Internet Society, Network Working Group (1999)Google Scholar
  5. 5.
    Rice, J., Farquhar, A., Piernot, P., Gruber, T.: Using the web instead of a window system. In: Proceedings Human Factors in Computing Systems, CHI 1996 Conference, Vancouver, B.C, Canada, pp. 103–110 (1996)Google Scholar
  6. 6.
    Belinfante, A., Feenstra, J., de Vries, R., Tretmans, J., Goga, N., Feijs, L., Mauw, S., Heerink, L.: Formal test automation: A simple experiment. In: 12thInt. Workshop on Testing of Communicating Systems. Kluwer Academic Publishers, Dordrecht (1999)Google Scholar
  7. 7.
    Brinksma, E., Alderden, R., Langerak, J., van de Lagemaat, R., Tretmans, J.: A formal approach to conformance testing. In: Second International Workshop on Protocol Test Systems, pp. 349–363. North-Holland, Amsterdam (1990)Google Scholar
  8. 8.
    Tretmans, J.: A formal approach to conformance testing. In: Rafiq, O. (ed.) International Workshop on Protocol Test Systems VI. IFIP Transactions, vol. C-19, pp. 257–276. North-Holland, Amsterdam (1994)Google Scholar
  9. 9.
    ISO/IEC JTC1/SC21 WG7, ITU-T SG 10/Q.8: Proposed ITU-T Z.500 and committee draft on formal methods in conformance testing. CD 13245-1, ISO – ITU-T, Geneva (1996)Google Scholar
  10. 10.
    Bernot, G.: Testing against formal specifications: A theoretical view. In: Abramsky, S. (ed.) TAPSOFT 1991, CCPSD 1991, and ADC-Talks 1991. LNCS, vol. 494, pp. 99–119. Springer, Heidelberg (1991)Google Scholar
  11. 11.
    Tretmans, J.: Testing labelled transition systems with inputs and outputs. In: Cavalli, A., Budkowski, S. (eds.) Participants Proceedings of the Int. Workshop on Protocol Test Systems VIII – COST 247 Session, Evry, France, pp. 461–476 (1995)Google Scholar
  12. 12.
    Heerink, L.: Ins and outs in refusal testing. PhD thesis, University of Twente, The Netherlands (1998)Google Scholar
  13. 13.
    Brinksma, E., Scollo, G., Steenbergen, C.: LOTOS specifications, their implementations and their tests. Protocol Specification, Testing and Verification VI, IFIP 1987, 349–360 (1987)Google Scholar
  14. 14.
    Tretmans, J.: Test Generation with Inputs, Outputs and Repetitive Quiescence. Software— Concepts and Tools 17, 103–120 (1996)zbMATHGoogle Scholar
  15. 15.
    van Beek, H.: Internet protocols for distributed consensus – the DiCons language. Master’s thesis, Technische Universiteit Eindhoven (2000)Google Scholar
  16. 16.
    Baeten, J., van Beek, H., Mauw, S.: Specifying internet applications with DiCons. In: Proc. 16th ACM Symposium on Applied Computing, Las Vegas, USA (2001)Google Scholar
  17. 17.
    CollabNet, Inc.: MaxQ (1999–2003),
  18. 18.
    The Original Software Group Ltd.: TestWEB (2003),
  19. 19.
    Ricca, F., Tonella, P.: Analysis and testing of web applications. In: Proceedings of the 23rd International Conference on Software Engeneering (ICSE 2001), Toronto, Ontario, Canada, pp. 25–34. IEEE Computer Society, Los Alamitos (2001)CrossRefGoogle Scholar
  20. 20.
    Jia, X., Liu, H.: Rigorous and automatic testing of web applications. In: Proceedings of the 6th IASTED International Conference on Software Engineering and Applications (SEA 2002), Cambridge, MA, USA, pp. 280–285 (2002)Google Scholar
  21. 21.
    Wu, Y., Offutt, J.: Modeling and testing web-based applications. ISE Technical ISE-TR-02- 08, GMU (2002)Google Scholar
  22. 22.
    Niese, O., Margaria, T., Steffen, B.: Automated functional testing of web-based applications. In: Proceedings of the 5th Int. Conference On Software and Internet Quality Week Europe (QWE 2002), Brussels, Belgium (2002)Google Scholar
  23. 23.
    Benedikt, M., Freire, J., Godefroid, P.: VeriWeb: Automatically testing dynamic web sites. In: Proceedings of the 11th international world wide web conference (WWW 2002), Honolulu, Hawaii, USA (2002)Google Scholar
  24. 24.
    Dieselpoint, Inc.: dieseltest (2001),
  25. 25.
    Fulmer, J.: Siege (2002),

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Harm M. A. van Beek
    • 1
  • Sjouke Mauw
    • 1
  1. 1.Department of Mathematics and Computer ScienceTechnische Unversiteit EindhovenEindhovenThe Netherlands

Personalised recommendations