Skip to main content
SpringerLink
Log in

A Quality Estimation of Mutation Clustering in C# Programs

  • Conference paper
New Results in Dependability and Computer Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 224))

Abstract

Mutation testing tasks are expensive in time and resources. Different cost reduction methods were developed to cope with this problem. In this chapter experimental evaluation of mutation clustering is presented. The approach was applied for object-oriented and standard mutation testing of C# programs. The quality metric was used to compare different solutions. It calculates a tradeoff between mutations score accuracy and mutation costs in terms of number of mutants and number of tests. The results show a substantive decrease in number of mutants and tests while suffering a small decline of mutation score accuracy. However the outcome is not superior to other cost reduction methods, as selective mutation or mutant sampling.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Transactions on Software Engineering 37(5), 649–678 (2011), doi:10.1109/TSE.2010.62

    Article  Google Scholar 

  2. Usaola, M.P., Mateo, P.R.: Mutation testing cost reduction techniques: a survey. IEEE Software 27(3), 80–86 (2010), doi:10.1109/MS.2010.79

    Article  Google Scholar 

  3. Hussain, S.: Mutation Clustering. Ms. Thesis, King’s College London, Strand, London (2008)

    Google Scholar 

  4. Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. ACM Computing Surveys 31(3), 264–323 (1999)

    Article  Google Scholar 

  5. Ji, C., Chen, Z.Y., Xu, B.W., Zhao, Z.H.: A novel method of mutation clustering based on domain analysis. In: Proc. of 21st Inter. Conf. on Softw. Eng. & Knowledge Eng., pp. 422–425 (2009)

    Google Scholar 

  6. Derezińska, A., Szustek, A.: Object-oriented testing capabilities and performance evaluation of the C# mutation system. In: Szmuc, T., Szpyrka, M., Zendulka, J. (eds.) CEE-SET 2009. LNCS, vol. 7054, pp. 229–242. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  7. Derezińska, A., Rudnik, M.: Quality evaluation of object-oriented and standard mutation operators applied to C# programs. In: Furia, C.A., Nanz, S. (eds.) TOOLS 2012. LNCS, vol. 7304, pp. 42–57. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  8. Derezińska, A., Szustek, A.: Tool-supported mutation approach for verification of C# programs. In: Zamojski, W., et al. (eds.) Proc. of Inter. Conf. on Dependability of Computer Systems, DepCoS-RELCOMEX 2008, pp. 261–268 (2008), doi:10.1109/DepCoS-RELCOMEX.2008.51

    Google Scholar 

  9. CREAM, http://galera.ii.pw.edu.pl/~adr/CREAM/

  10. Derezińska, A., Rudnik, M.: Empirical evaluation of cost reduction techniques of mutation testing for C# Programs, Warsaw University of Technology, ICS Res. Rep. 1/2012 (2012)

    Google Scholar 

  11. Offut, J., Rothermel, G., Zapf, C.: An experimental evaluation of selective mutation. In: Proc. of 15th Inter. Conf. on Software Engineering, pp. 100–107 (1993)

    Google Scholar 

  12. Zhang, L., Hou, S.-S., Hu, J.-J., Xie, T., Mei, H.: Is operator-based mutant selection superior to random mutant selection? In: Proc. of the 32nd International Conference on Software Engineering, ICSE 2010, pp. 435–444 (2010), doi:10.1145/1806799.1806863

    Google Scholar 

  13. Kaminski, G., Praphamontripong, U., Ammann, P., Offutt, J.: A logic mutation approach to selective mutation for programs and queries. Inform. and Softw. Technol. 53, 1137–1152 (2011), doi:10.1016/j.infsof.2011.03.009

    Article  Google Scholar 

  14. Hu, J., Li, N., Offutt, J.: An analysis of OO mutation operators. In: Proc. of 4th Inter. Conf. Softw. Test. Verif. and Validation Workshops, pp. 334–341 (2011), doi:10.1109/ICSTW.2011.47

    Google Scholar 

  15. Mathur, A.P., Wong, W.E.: Reducing the cost of mutation testing: an empirical study. J. of Systems and Softw. 31, 185–196 (1995)

    Article  Google Scholar 

  16. Derezińska, A., Kowalski, K.: Object-oriented mutation applied in Common Intermediate Language programs originated from C#. In: Proc. of 4th International Conference Software Testing Verification and Validation Workshops, pp. 342–350 (2011), doi:10.1109/ICSTW.2011.54

    Google Scholar 

  17. Kryszkiewicz, M.: Fast algorithm finding minima in monotonic Boolean functions, Warsaw Univ. of Technology, ICS Res. Rep. 42/93 (1993)

    Google Scholar 

  18. Just, R., Kapfhammer, G.M., Schweiggert, F.: Do redundant mutants affects the effectiveness and efficiency of mutation analysis? In: Proc. IEEE 5th Inter. Conf. on Software Testing, Verification and Validation, pp. 720–725 (2012), doi:10.1109/ICST.2012.162

    Google Scholar 

  19. Zhang, L., Marionov, D., Zhang, L., Khurshid, S.: Regression mutation testing. In: Proc. of Int. Symp. on Software Testing, ISSTA 2012, pp. 331–341 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science, Warsaw University of Technology, Nowowiejska 15/19, 00-665, Warsaw, Poland

    Anna Derezińska

Authors
  1. Anna Derezińska
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna Derezińska .

Editor information

Editors and Affiliations

  1. , Institute of Computer Engineering, Wrocław University of Technology, ul. Janiszewskiego 11/17, Wrocław, 50-372, Poland

    Wojciech Zamojski

  2. , Institute of Computer Engineering, Wrocław University of Technology, ul. Janiszewskiego 11/17, Wrocław, 50-372, Poland

    Jacek Mazurkiewicz

  3. , Institute of Computer Engineering, Wrocław University of Technology, ul. Janiszewskiego 11/17, Wrocław, 50-372, Poland

    Jarosław Sugier

  4. , Institute of Computer Engineering, Wrocław University of Technology, ul. Janiszewskiego 11/17, Wrocław, 50-372, Poland

    Tomasz Walkowiak

  5. , Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, Warszawa, 01-447, Poland

    Janusz Kacprzyk

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Derezińska, A. (2013). A Quality Estimation of Mutation Clustering in C# Programs. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) New Results in Dependability and Computer Systems. Advances in Intelligent Systems and Computing, vol 224. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-00945-2_11

Download citation

Publish with us

Policies and ethics

Search

Navigation