Skip to main content
SpringerLink
Log in

Mutation Testing and Test Data Generation Approaches: A Review

  • Conference paper
  • First Online:
Smart Trends in Information Technology and Computer Communications (SmartCom 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 628))

Abstract

Software advancement has increased the complexities many fold and to meet the quality standards, a lot of research is being done in designing new testing methodologies and tools. Mutation testing is a proven effective technique but the high cost attached with it averts it from establishing it as an industrial tool. The review is an extension of the previous work where a review was done on search based test data generation and mutation testing. The objective is to study the remaining techniques/approaches and summaries the discussion of both the reviews. The application of mutation testing with various techniques at various phases of software development along with various languages/tools show that it is a versatile, adaptable and efficient, which is motivating the researchers to explore the new areas.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Dave, M., Agrawal, R.: Search based techniques and mutation analysis in automatic test case generation: a survey. In: 2015 IEEE International Advance Computing Conference (IACC). IEEE (2015)

    Google Scholar 

  2. Papadakis, M., Malevris, N.: Automatic mutation test case generation via dynamic symbolic execution, Software reliability engineering (ISSRE). In: 2010 IEEE 21st International Symposium on IEEE (2010)

    Google Scholar 

  3. Offutt, A.J.: A practical system for mutation testing: help for the common programmer. In: Proceedings of the International Test Conference 1994. IEEE (1994)

    Google Scholar 

  4. Papadakis, M., Malevris, N.: Mutation bases test case generation via a path selection strategy. Information and Software Technology (2012)

    Google Scholar 

  5. Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. (2011)

    Google Scholar 

  6. Mateo, P., Reales, M.P.U., Offutt, J.: Mutation at system and functional levels. In: 2010 Third International Conference on IEEE Software Testing, Verification, and Validation Workshops (ICSTW) (2010)

    Google Scholar 

  7. Souza, F.C.M., et al.: Test Data Generation Techniques for Mutation Testing: A Systematic Mapping

    Google Scholar 

  8. Howden, W.E.: Weak mutation testing and completeness of test sets. IEEE Trans. Softw. Eng. 4 (1982)

    Google Scholar 

  9. Mathur, A.P.: Foundations of Software Testing, 2/e. Pearson Education India (2008)

    Google Scholar 

  10. De Millo, R.A., Lipton, R.J., Sayward, F.G.: Hints on test data selection: help for the practising programmer. Computer 11(4), 34–41 (1978)

    Article  Google Scholar 

  11. DeMillo, R.A., Jefferson, A.: Offutt., Constraint-based automatic test data generation. IEEE Trans. Softw. Eng. 17(9), 900–910 (1991)

    Article  Google Scholar 

  12. Zhang, L., et al.: Test generation via dynamic symbolic execution for mutation testing. In: 2010 IEEE International Conference on Software Maintenance (ICSM). IEEE (2010)

    Google Scholar 

  13. Patrick, M.T.: Mutation-Optimised Subdomains for Test Data Generation and Program Analysis. Diss. University of York (2013)

    Google Scholar 

  14. Papadakis, M., Malevris, N.: Searching and generating test inputs for mutation testing. SpringerPlus 2, 121 (2013)

    Article  Google Scholar 

  15. Bybro, M., Arnborg, S.: A mutation testing tool for java programs. Master’s thesis, Stockholm University, Stockholm, Sweden (2003)

    Google Scholar 

  16. Offutt, A.J., Untch, R.H.: Mutation 2000: uniting the orthogonal. In: Eric-Wong, W. (ed.) Mutation testing for the new century. Springer, New York (2001)

    Google Scholar 

  17. Okun, V.: Specification mutation for test generation and analysis. Diss. University of Maryland Baltimore County (2004)

    Google Scholar 

  18. Nilsson, R., Offutt, J., Mellin, J.: Test case generation for mutation-based testing of timeliness. Electronic Notes in Theoretical Computer Science (2006)

    Google Scholar 

  19. Aichernig, B.K., Salas, P.A.P.: Test case generation by OCL mutation and constraint solving. In: Fifth International Conference on Quality Software (QSIC 2005). IEEE (2005)

    Google Scholar 

  20. Wimmel, G., Jürjens, J.: Specification-based test generation for security-critical systems using mutations. In: George, C., Miao, H. (eds.) ICFEM 2002. LNCS, vol. 2495, pp. 471–482. Springer Berlin Heidelberg, Berlin, Heidelberg (2002). doi:10.1007/3-540-36103-0_48

    Chapter  Google Scholar 

  21. Shan, L., Zhu, H.: Testing software modelling tools using data mutation. In: Proceedings of the 2006 International Workshop on Automation of Software Test. ACM (2006)

    Google Scholar 

  22. De Millo, R.A., Jefferson Offutt, A.: Experimental results from an automatic test case generator. ACM Trans. Softw. Eng. Methodol. (TOSEM) 2(2), 109–127 (1993)

    Article  Google Scholar 

  23. Le Traon, Y., Baudry, B., Jézéquel, J.-M.: Design by contract to improve software vigilance. IEEE Trans. Softw. Eng. 32(8), 22 (2006)

    Article  Google Scholar 

  24. Liu, M.-H., et al.: An approach to test data generation for killing multiple mutants. In: 22nd IEEE International Conference on Software Maintenance, ICSM 2006. IEEE (2006)

    Google Scholar 

  25. Smith, B.H., Williams, L.: On guiding the augmentation of an automated test suite via mutation analysis. Empirical Softw. Eng. 14(3), 341–369 (2009)

    Article  Google Scholar 

  26. Papadakis, M., Malevris, N.: An effective path selection strategy for mutation testing. In: Software Engineering Conference, APSEC 2009, Asia-Pacific. IEEE (2009)

    Google Scholar 

  27. Brillout, A., He, N., Mazzucchi, M., Kroening, D., Purandare, M., Rümmer, P., Weissenbacher, G.: Mutation-based test case generation for Simulink models. In: Boer, F.S., Bonsangue, M.M., Hallerstede, S., Leuschel, M. (eds.) FMCO 2009. LNCS, vol. 6286, pp. 208–227. Springer Berlin Heidelberg, Berlin, Heidelberg (2010). doi:10.1007/978-3-642-17071-3_11

    Chapter  MATH  Google Scholar 

  28. Fraser, G., Zeller, A.: Mutation-driven generation of unit tests and oracles. IEEE Trans. Softw. Eng. 38(2), 278–292 (2012)

    Article  Google Scholar 

  29. Fraser, G., Zeller, A.: Generating parameterized unit tests. In: Proceedings of the 2011 International Symposium on Software Testing and Analysis. ACM (2011)

    Google Scholar 

  30. Jhamb, M., Singhal, A.: An Efficient Approach for Equivalent Mutants Detection using Fuzzy Logic

    Google Scholar 

  31. Souza, F.C.M., et al.: Strong mutation-based test data generation using hill climbing. In: Proceedings of the 9th International Workshop on Search-Based Software Testing. ACM (2016)

    Google Scholar 

  32. Filho, M., Angelo, R., Vergilio, S.R.: A mutation and multi-objective test data generation approach for feature testing of software product lines. In: 2015 29th Brazilian Symposium on Software Engineering (SBES). IEEE (2015)

    Google Scholar 

  33. Hanh, L.T.M., Thanh, K., Tung, N.T.B.: Mutation-based test data generation for simulink models using genetic algorithm and simulated annealing. Int. J. Comput. Inf. Technol. 3(04), 763–771 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Jagan Nath University, Jaipur, 302022, India

    Meenu Dave & Rashmi Agrawal

Authors
  1. Meenu Dave
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rashmi Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rashmi Agrawal .

Editor information

Editors and Affiliations

  1. Stanford University, Stanford, CA, USA

    Aynur Unal

  2. IT Buzz Limited, Dagenham, UK

    Malaya Nayak

  3. Microsoft Innovation Centre, Sri Aurobindo Institute of Technology, Indore, Madhya Pradesh, India

    Durgesh Kumar Mishra

  4. Namibia University of Science and Technology, Windhoek, Namibia

    Dharm Singh

  5. Sabar Institute of Technology, Sabarkantha, India

    Amit Joshi

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Dave, M., Agrawal, R. (2016). Mutation Testing and Test Data Generation Approaches: A Review. In: Unal, A., Nayak, M., Mishra, D.K., Singh, D., Joshi, A. (eds) Smart Trends in Information Technology and Computer Communications. SmartCom 2016. Communications in Computer and Information Science, vol 628. Springer, Singapore. https://doi.org/10.1007/978-981-10-3433-6_45

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3433-6_45

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3432-9

  • Online ISBN: 978-981-10-3433-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation