Skip to main content

On the Complexity of Input Output Conformance Testing

  • Conference paper
  • First Online:
Formal Aspects of Component Software (FACS 2013)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 8348))

Included in the following conference series:

Abstract

Input-output conformance (ioco) testing is a well-known approach to model-based testing. In this paper, we study the complexity of checking ioco. We show that the problem of checking ioco is PSPACE-complete. To provide a more efficient algorithm, we propose a more restricted setting for checking ioco, namely with deterministic models and show that in this restricted setting ioco checking can be performed in polynomial time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aarts, F., Vaandrager, F.: Learning I/O automata. In: Gastin, P., Laroussinie, F. (eds.) CONCUR 2010. LNCS, vol. 6269, pp. 71–85. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  2. Abdulla, P.A., Chen, Y.-F., Holík, L., Mayr, R., Vojnar, T.: When simulation meets antichains. In: Esparza, J., Majumdar, R. (eds.) TACAS 2010. LNCS, vol. 6015, pp. 158–174. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  3. de Alfaro, L., Henzinger, T.A.: Interface automata. In: Proceedings of FSE/ESEC’01, pp. 109–120. ACM (2001)

    Google Scholar 

  4. Alur, R., Henzinger, T.A., Kupferman, O., Vardi, M.Y.: Alternating refinement relations. In: Sangiorgi, D., de Simone, R. (eds.) CONCUR 1998. LNCS, vol. 1466, pp. 163–178. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  5. Asaadi, H.R., Khosravi, R., Mousavi, M.R., Noroozi, N.: Towards model-based testing of electronic funds transfer systems. In: Arbab, F., Sirjani, M. (eds.) FSEN 2011. LNCS, vol. 7141, pp. 253–267. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. van der Bijl, M., Rensink, A., Tretmans, J.: Compositional testing with ioco. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 86–100. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  7. Chatterjee, K., Chaubal, S., Kamath, P.: Faster algorithms for alternating refinement relations. In: Proceedings of the CSL’12. LIPIcs, vol. 16, pp. 167–182. Dagstuhl (2012)

    Google Scholar 

  8. Dowling, W.F., Gallier, J.H.: Linear-time algorithms for testing the satisfiability of propositional horn formulae. JLAP 1(3), 267–284 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  9. Frantzen, L., Tretmans, J.: Model-based testing of environmental conformance of components. In: de Boer, F.S., Bonsangue, M.M., Graf, S., de Roever, W.-P. (eds.) FMCO 2006. LNCS, vol. 4709, pp. 1–25. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  10. Gregorio-Rodríguez, C., Llana, L., Martínez-Torres, R.: Input-Output Conformance Simulation \((\sf iocos)\) for Model Based Testing. In: Beyer, D., Boreale, M. (eds.) FORTE 2013 and FMOODS 2013. LNCS, vol. 7892, pp. 114–129. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  11. Hierons, R.M.: The complexity of asynchronous model based testing. TCS 451, 70–82 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  12. Kanellakis, P.C., Smolka, S.A.: CCS expressions, finite state processes, and three problems of equivalence. Inf. Comput. 86(1), 43–68 (1990)

    Article  MATH  MathSciNet  Google Scholar 

  13. Mostowski, W., Poll, E., Schmaltz, J., Tretmans, J., Wichers Schreur, R.: Model-based testing of electronic passports. In: Alpuente, M., Cook, B., Joubert, Ch. (eds.) FMICS 2009. LNCS, vol. 5825, pp. 207–209. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  14. Myers, G.J., Badgett, T., Sandler, C.: The Art of Software Testing, 3rd edn. Wiley, New York (2011)

    Google Scholar 

  15. Noroozi, N., Mousavi, M.R., Willemse, T.A.C.: Decomposability in input output conformance testing. In: Proceedings of MBT’13. EPTCS, vol. 111, pp. 51–66 (2013)

    Google Scholar 

  16. Ploeger, B.: Improved verification methods for concurrent systems. Ph.D. thesis, TU/Eindhoven (2009)

    Google Scholar 

  17. Pretschner, A.: One evaluation of model-based testing and its automation. In: Proceedings of ICSE’05, pp. 722–723. ACM (2005)

    Google Scholar 

  18. Shukla, S.K., Hunt III, H.B., Rosenkrantz, D.J., Stearns, R.E.: On the complexity of relational problems for finite state processes (extended abstract). In: Meyer auf der Heide, F., Monien, B. (eds.) ICALP 1996. LNCS, vol. 1099, pp. 466–477. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  19. Stockmeyer, L.J., Meyer, A.R.: Word problems requiring exponential time: preliminary report. In: Proceedings STOC’73, pp. 1–9. ACM (1973)

    Google Scholar 

  20. Thompson, K.: Regular expression search algorithms. CACM 11(6), 419–422 (1968)

    Article  MATH  Google Scholar 

  21. Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) FORTEST. LNCS, vol. 4949, pp. 1–38. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  22. Veanes, M., Bjorner, N.: Alternating simulation and ioco. STTT 14(4), 387–405 (2012)

    Article  Google Scholar 

  23. Veanes, M., Campbell, C., Grieskamp, W., Schulte, W., Tillmann, N., Nachmanson, L.: Model-based testing of object-oriented reactive systems with Spec Explorer. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) FORTEST. LNCS, vol. 4949, pp. 39–76. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  24. Vishal, V., Kovacioglu, M., Kherazi, R., Mousavi, M.R.: Integrating model-based and constraint-based testing using SpecExplorer. In: Proceedings MoTiP’12, pp. 219–224. IEEE (2012)

    Google Scholar 

Download references

Acknowledgments

We thank Sarmen Keshishzadeh and Jeroen Keiren (both TU/e) for feedback on earlier drafts of this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neda Noroozi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Noroozi, N., Mousavi, M.R., Willemse, T.A.C. (2014). On the Complexity of Input Output Conformance Testing. In: Fiadeiro, J., Liu, Z., Xue, J. (eds) Formal Aspects of Component Software. FACS 2013. Lecture Notes in Computer Science(), vol 8348. Springer, Cham. https://doi.org/10.1007/978-3-319-07602-7_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-07602-7_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-07601-0

  • Online ISBN: 978-3-319-07602-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics