Skip to main content

Conformance Testing Techniques for Timed Systems

  • Conference paper
  • First Online:
SOFSEM 2002: Theory and Practice of Informatics (SOFSEM 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2540))

  • 196 Accesses

Abstract

In protocol engineering area, conformance testing is a very important step. It tries to detect remaining errors after the verification step. The addition of time in system modeling, makes this step more complicated. This paper aims to give an overview on techniques for conformance testing of timed systems. It first describes some important models used to specify timed systems. Then, it shows the main techniques used for testing such systems. It will focus on two specific techniques. The first one is based on the extraction of a reduced number of test sequences, guided by a property required by any designer (called a test purpose). The second technique is based on the identification of some states on the implementation. The paper also shows how to experiment those test sequences on a real implementation and how to consider time in such an architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ostro., J.: Deciding Properties of Timed Transitions Models. IEEE Transactions on Parallel Systems 1 (1990) 170–183. 2

    Article  Google Scholar 

  2. Ostro., J., Wonham, W.: A Framework for Real-Time Discret Event Control. IEEE Transactions on Automatic Control 4 (1990) 386-397. 2

    Google Scholar 

  3. Alur, R., Henzinger, T.: Real-time system = discrete system + clock variables. In Rus, T., Rattray, C., eds.: Theories and Experiences for Real-Time System Development-Papers presented at First AMAST Workshop on Real-Time System Development, Iowa City, Iowa, November 1993, World Scientific (1994) 1–29. 2

    Google Scholar 

  4. Alur, R., Dill, D.: A theory of timed automata. Theoretical Computer Science 126 (1994) 183–235. 2, 3

    Article  MATH  MathSciNet  Google Scholar 

  5. Alur, R., Dill, D.: Automata for modeling real-time systems. In Paterson, M., ed.: Proceedings 17th ICALP,Warwick. Volume 443 of Lecture Notes in Computer Science., Springer-Verlag (1990) 322–335. 2

    Google Scholar 

  6. Alur, R., Dill, D.: The theory of timed automata. In Bakker, J.d., Huizing, C., Roever, W.d., Rozenberg, G., eds.: Proceedings REX Workshop on Real-Time: Theory in Practice, Mook, The Netherlands, June 1991. Volume 600 of Lecture Notes in Computer Science., Springer-Verlag (1992) 45–73.

    Google Scholar 

  7. Alur, R., Courcoubetis, C., Henzinger, T.: The observational power of clocks. In Jonsson, B., Parrow, J., eds.: Proceedings CONCUR 94, Uppsala, Sweden. Volume 836 of Lecture Notes in Computer Science. Springer-Verlag (1994) 162–177. 4

    Google Scholar 

  8. Daws, C., Olivero, A., Yovine, S.: Verifying ET-LOTOS programs with kronos. In Hogrefe, D., Leue, S., eds.: Proceedings of the 7th International Conference on Formal Description Techniques, FORTE’94, North-Holland (1994) 207–222. 4

    Google Scholar 

  9. Daws, C., Yovine, S.: Two examples of verification of multirate timed automata with kronos. In: Proceedings of the 1995I EEE Real-Time Systems Symposium, RTSS’95, Pisa, Italy, IEEE Computer Society Press (1995). 4

    Google Scholar 

  10. Daws, C., Olivero, A., Tripakis, S., Yovine, S.: The tool Kronos. In Alur, R., Henzinger, T., Sontag, E., eds.: Hybrid Systems III. Volume 1066 of Lecture Notes in Computer Science., Springer-Verlag (1995). 4

    Chapter  Google Scholar 

  11. Bengtsson, J., Larsen, K., Larsen, F., Petterson, P., Yi, W., Weise, C.: New Generation of UPPAAL. In: Proceedings of the International Workshop on SOftware Tools and Technology Transfer (Aalborg, Denmark, July 12-13). (1998). 4

    Google Scholar 

  12. Koné, O.: Designing test for time dependant systems. In: Proceedings of the 13th IFIP International Conference on Computer Communication Séoul, South Korea. (1995). 4

    Google Scholar 

  13. Laurencot, P., Castanet, R.: Integration of Time in Canonical Testers for Real-Time Systems. In: International Workshop on Object-Oriented Real-Time Dependable Systems, California, IEEE Computer Society Press (1997). 4, 15

    Google Scholar 

  14. Clarke, D., Lee, I.: Automatic generation of tests for timing constraints from requirements. In: Proceedings of the Third International Workshop on Object-Oriented Real-Time Dependable Systems, Newport Beach, California. (1997). 4, 15

    Google Scholar 

  15. Cardel-Oliver, R., Glover, T.: A practical and complete algorithm for testing real-time systems. In: Proc. of the 5th. Formal Techniques in Real-Time and Fault-Tolerant Systems. Volume 1486 of Lecture Notes in Computer Science., SpringerVerlag (1998) 251–261. 4

    Google Scholar 

  16. Raymond, P., Nicollin, X., Halbwatchs, N., Waber, D.: Automatic testing of reactive systems, madrid, spain. In: Proceedings of the 1998 IEEE Real-Time Systems Symposium, RTSS’98, IEEE Computer Society Press (1998) 200–209. 4

    Google Scholar 

  17. Petitjean, E., Fouchal, H.: From Timed Automata to Testable Untimeed Automata. In: 24th IFAC/IFIP International Workshop on Real-Time Programming, Schloss Dagstuhl, Germany. (1999). 4, 5

    Google Scholar 

  18. Nielsen, B., Skou, A.: Automated Test Generation from Timed Automata. In Margaria, T., Yi, W., eds.: Proceedings of the Workshop on Tools and Algorithms for the Construction and Analysis of Systems, Genova, Italy. Volume 2031 of Lecture Notes in Computer Science., Springer-Verlag (2001) 343–357. 4

    Google Scholar 

  19. De Nicola, R., Hennessy, M.: Testing equivalences for processes. Theoretical Computer Science 34 (1984) 83–133. 4

    Article  MATH  MathSciNet  Google Scholar 

  20. Hogashino, T., Nakata, A., Taniguchi, K., Cavalli, A.R.: Generating Test Cases for a Timed I/O Automaton Model. In: IWTCS, 2001. (2001). 4

    Google Scholar 

  21. Springintveld, J., Vaandrager, F., D’Argenio, P.R.: Timed Testing Automata. Theoretical Computer Science 254 (2001) 225–257. 4

    Article  MATH  MathSciNet  Google Scholar 

  22. En-Nouaary, A., Dssouli, R., Khendek, F., Elqortobi, A.: Timed test cases generation based on state characterization technique. In: 19th IEEE Real Time Systems Symposium (RTSS’98) Madrid, Spain. (1998). 4

    Google Scholar 

  23. Fujiwara, S., Bochmann, G., Khendek, F., Amalou, M., Ghedamsi, A.: Test selection based on finite-state models. IEEE Transactions on Software Engineering 17 (1991) 591–603. 4, 5

    Article  Google Scholar 

  24. Gill, A.: Introduction to the theory of finite-state machines. Mc Graw-Hill, New York-USA (1962). 4

    Google Scholar 

  25. Chow, T.: Testing software design modeled by finite-state machines. IEEE Transactions on Software Engineering SE-4 (1978) 178–187. 4

    Article  Google Scholar 

  26. Dahbura, A., Sabnani, K.: An experience in estimating fault coverage of a protocol test. In: Proceedings of IEEE INFOCOM’88. (1988) 71–79. 4

    Google Scholar 

  27. Vuong, S., Chan, W., Ito, M.: The UIOv-Method for Protocol Test Sequence Generation. In: 2nd IWPTS International Workshop on Protocol Test Systems, Berlin. (1989). 4

    Google Scholar 

  28. Brinksma, E.: A theory for the derivation of tests. In Aggarwal, S., ed.: Proceedings of the Eighth International Conference on Protocol Specification, Testing and Verification, North-Holland (1987). 4

    Google Scholar 

  29. Brinksma, E., Rensink, A., Vogler, W.: Fair testing. In Lee, I., Smolka, S., eds.: Proceedings CONCUR 95, Philadelphia, United States. Volume 962 of Lecture Notes in Computer Science., Springer-Verlag (1995). 4

    Google Scholar 

  30. Tretmans, J.: A Formal Approach to Conformance Testing. PhD thesis, Department of Computer Science, University of Twente (1992). 4

    Google Scholar 

  31. Tretmans, J.: Test generation with input, outputs, and quiescence. In Margaria, T., Steffen, B., eds.: Proceedings of the Second Workshop on Tools and Algorithms for the Construction and Analysis of Systems, Passau, Germany. Volume 1055 of Lecture Notes in Computer Science., Springer-Verlag (1996) 127–146. 4

    Google Scholar 

  32. Tretmans, J.: Conformance testing with labelled transition systems: Implementation relations and test generation. Computer Networks and ISDN Systems 29 (1996) 49–79. 4

    Article  Google Scholar 

  33. Petrenko, A., T. Higashino, T. Kaji: Handling Redundant and Aditional States in Protocol Testing. In A. Cavalli, S.B., ed.: Proceedings of the 8th International Workshop on Test of Communicating Systems IWTCS’95( Evry, France), Amsterdam, North-Holland (1995). 4

    Google Scholar 

  34. Petrenko, A., Yevtushenko, N., v. Bochmann, G.: Testing Deterministic Implementations from Non-deterministic FSM Specifications. In Baumgarten, B., Burkhardt, H.J., Giessler, A., eds.: Proceedings of the 9th InternationalWorkshop on Test of Communicating Systems IWTCS’96 (Darmstadt, Germany), Amsterdam, North-Holland (1996). 4

    Google Scholar 

  35. Aho, A., Dahbura, A., Lee, D., Uyar, M.: An optimization technique for protocol conformance test generation based on UIO sequences and Rural Chinese Postman Tours. IEEE Transactions on Communications 39 (1991) 1604–1615. 4

    Article  Google Scholar 

  36. Lee, D., Yannakakis, M.: Testing finite-state machines: State identification and verification. IEEE Transactions on Computers 43 (1994) 306–320. 4

    Article  MathSciNet  Google Scholar 

  37. En-nouaary, A., Fouchal, H., Dssouli, R., Elqortobi, A., Petitjean, E.: Test derivation for timed systems with time verticies. Report LERI-98–05–01, LERI-RS (Université de Reims) (1997). 5

    Google Scholar 

  38. Fouchal, H., Petitjean, E., Salva, S.: Testing Timed Systems with Timed Purposes. In: Proceedings of the 7th International Conference on Real-Time Computing Systems and Applications, RTCSA’00 (Cheju Island, South Korea), IEEE Computer Society. (2000) 166–171. 6

    Google Scholar 

  39. Fouchal, H., Petitjean, E., Salva, S.: An User-Oriented Testing of Real Time Systems. In: Proceedings of the International Workshop on Real-Time Embeded Systems RTES’01 (London), IEEE Computer Society. (2001). 6

    Google Scholar 

  40. Salva, S., Petitjean, E., Fouchal, H.: A simple approach to testing timed systems. In: Workshop on Formal Approaches to Testing of Software, FATES’01 (Aalborg, Danmark), August 25, 2001 (Workshop of CONCUR’01). (2001) 93–107. 7

    Google Scholar 

  41. Fouchal, H.: Adapted test cases for timed systems. Journal of Electronics and Commputer Science 1 (2001) 1–8. 12

    Google Scholar 

  42. Q8, I.S.P.T.S.: Formal Methods in Conformance Testing. Technical report, Working document-Aproved Geneva Output (1993). 15

    Google Scholar 

  43. En-nouaary, A., Dssouli, R., Elqortobi, A.: Génération de tests temporisés. In: Proceedings of the 6th bi-Annual Colloque Francophone de l’ingénierie des Protocoles, Liéges, Belgique. (1997). 15, 16

    Google Scholar 

  44. Petitjean, E., Fouchal, H.: A Realistic Architecture for Timed Systems. In: 5th IEEE International Conference on Engineering of Complex Computer Systems, Las Vegas, USA. (1999) 109–118. 16

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fouchal, H. (2002). Conformance Testing Techniques for Timed Systems. In: Grosky, W.I., Plášil, F. (eds) SOFSEM 2002: Theory and Practice of Informatics. SOFSEM 2002. Lecture Notes in Computer Science, vol 2540. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36137-5_1

Download citation

  • DOI: https://doi.org/10.1007/3-540-36137-5_1

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-00145-4

  • Online ISBN: 978-3-540-36137-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics