Skip to main content
SpringerLink
Log in

An Improvement of Applying Multi-objective Optimization Algorithm into Higher Order Mutation Testing

  • Conference paper
  • First Online:
Advanced Computational Methods for Knowledge Engineering (ICCSAMA 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1121))

Abstract

In order to raise the quality of higher order mutation testing, in this paper, we propose an approach for effect improving of multi-objective optimization algorithms which can be used in the field of higher order mutation testing in order to reduce the number of generated mutant, generate the hard-to-kill mutant and construct the quality higher order mutants. We have performed an empirical evaluation with 20 real-word, open-source projects and 10 multi-objective optimization algorithms (including 5 original algorithms and 5 corresponding modification algorithms) to evaluate experimental results as well as bring out some opinions to effectiveness apply multi-objective optimization algorithms into higher order mutation testing. The study results indicate that our approach is an effectiveness one to get better the quality of higher order mutation testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. DeMillo, R.A., Lipton, R.J., Sayward, F.G.: Hints on test data selection: help for the practicing programmer. IEEE Comput. 11(4), 34–41 (1978)

    Article  Google Scholar 

  2. Hamlet, R.G.: Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. SE-3(4), 279–290 (1977)

    Article  MathSciNet  Google Scholar 

  3. Nguyen, Q.V., Madeyski, L.: Problems of mutation testing and higher order mutation testing. In Do, T., Le Thi, H.A., Nguyen, N.T. (eds.) ICCSAMA 2014, Advanced Computational Methods for Knowledge Engineering. Advances in Intelligent Systems and Computing, vol. 282, pp. 157–172. Springer (2014). https://doi.org/10.1007/978-3-319-06569-4_12

    Chapter  Google Scholar 

  4. Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37(5), 649–678 (2011)

    Article  Google Scholar 

  5. Jia, Y., Harman, M.: Higher order mutation testing. Inf. Softw. Technol. 51, 1379–1393 (2009)

    Article  Google Scholar 

  6. Harman, M., Jia, Y., Langdon, W.B.: A manifesto for higher order mutation testing. In: Third International Conference on Software Testing, Verification, and Validation Workshops (2010)

    Google Scholar 

  7. Offutt, A.J.: Investigations of the software testing coupling effect. ACM Trans. Softw. Eng. Methodol. 1, 5–20 (1992)

    Article  Google Scholar 

  8. Polo, M., Piattini, M., Garcia-Rodriguez, I.: Decreasing the cost of mutation testing with second-order mutants. Softw. Test. Verif. Reliab. 19(2), 111–131 (2008)

    Article  Google Scholar 

  9. Madeyski, L., Orzeszyna, W., Torkar, R., Józala, M.: Overcoming the equivalent mutant problem: a systematic literature review and a comparative experiment of second order mutation. IEEE Trans. Softw. Eng. 40(1), 23–42 (2014). https://doi.org/10.1109/TSE.2013.44

    Article  Google Scholar 

  10. Jia, Y., Harman, M.: Constructing subtle faults using higher order mutation testing. In: Proceedings of Eighth International Working Conference on Source Code Analysis and Manipulation (2008)

    Google Scholar 

  11. Omar, E., Ghosh, S., Whitley, D.: Constructing subtle higher order mutants for Java and AspectJ programs. International Symposium on Software Reliability Engineering, pp. 340–349 (2013)

    Google Scholar 

  12. Omar, E., Ghosh, S., Whitley, D.: Comparing search techniques for fnding subtle higher order mutants. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, pp. 1271–1278 (2014)

    Google Scholar 

  13. Fevzi Belli, F., Guler, N., Hollmann A., Suna, E., Yildiz, E.: Model based higher-order mutation analysis. In: Advances in Software Engineering. Communications in Computer and Information Science, vol. 117, pp. 164–173 (2010)

    Chapter  Google Scholar 

  14. Akinde, A.O.: Using higher order mutation for reducing equivalent mutants in mutation testing. Asian J. Comput. Sci. Inf. Technol. 2(3), 13–18 (2012)

    Google Scholar 

  15. Langdon, W.B., Harman, M., Jia, Y.: Multi-objective higher order mutation testing with genetic programming. In: Proceedings Fourth Testing: Academic and Industrial Conference Practice and Research (2009)

    Google Scholar 

  16. Langdon, W.B., Harman, M., Jia, Y.: Efficient multi-objective higher order mutation testing with genetic programming. J. Syst. Softw. 83, 2416–2430 (2010)

    Article  Google Scholar 

  17. Nguyen, Q.V., Madeyski, L.: Searching for strongly subsuming higher order mutants by applying multi-objective optimization algorithm. In: Le Thi, H.A., Nguyen, N.T., Do, T.V. (eds.) Advanced Computational Methods for Knowledge Engineering. Advances in Intelligent Systems and Computing, vol. 358, pp. 391–402. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-17996-4_35

    Chapter  Google Scholar 

  18. Nguyen, Q.V., Madeyski, L.: Empirical evaluation of multi-objective optimization algorithms searching for higher order mutants. Cybern. Syst. Int. J. 47, 48–68 (2016)

    Article  Google Scholar 

  19. Nguyen, Q.V., Madeyski, L.: Higher order mutation testing to drive development of new test cases: an empirical comparison of three strategies. Lecture Notes in Computer Science (2016)

    Google Scholar 

  20. Nguyen, Q.V., Madeyski, L.: On the relationship between the order of mutation testing and the properties of generated higher order mutants. Lecture Notes in Computer Science (2016)

    Google Scholar 

  21. Nguyen, Q.V., Madeyski, L.: Addressing mutation testing problems by applying multi-objective optimization algorithms and higher order mutation. J. Intell. Fuzzy Syst. 32, 1173–1182 (2017). https://doi.org/10.3233/JIFS-169117

    Article  Google Scholar 

  22. Nguyen Q.V., Pham D.T.H.: Is higher order mutant harder to kill than first order mutant? An experimental study. Lecture Notes in Computer Science, vol. 10751. Springer (2018). https://doi.org/10.1007/978-3-319-75417-8_62

    Chapter  Google Scholar 

  23. Madeyski, L., Radyk, N.: Judy - a mutation testing tool for Java. IET Softw. 4(1), 32–42 (2010). https://doi.org/10.1049/iet-sen.2008.0038

    Article  Google Scholar 

  24. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multi objective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)

    Article  Google Scholar 

  25. Deb, K., Jain, H.: An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, Part I: solving problems with box constraints. IEEE Trans. Evol. Comput. 18(4), 577–601 (2014)

    Article  Google Scholar 

  26. Kollat, J.B., Reed, P.M.: The value of online adaptive search: a performance comparison of NSGAII, ε-NSGAII and ε-MOEA. In: Coello, C.A.C., Aguirre, A.H., Zitzler, E. (eds.) Third International Conference on Evolutionary Multi-Criterion Optimization, EMO 2005, Guanajuato, Mexico, 9–11 March 2005 (2005)

    Google Scholar 

  27. Deb, K., Mohan, M., Mishra, S.: A Fast Multi-objective Evolutionary Algorithm for Finding Well-Spread Pareto-Optimal Solutions. KenGAL, Report No. 2003002. Indian Institute of Technology, Kanpur, India (2003)

    Google Scholar 

  28. Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: improving the strength Pareto evolutionary algorithm for multi-objective optimization. In: Giannakoglou, K., Tsahalis, D., Periaux, J., Papailiou. K., Fogarty, T. (eds.) Evolutionary Methods for Design, Optimisations and Control, pp. 19–26 (2002)

    Google Scholar 

  29. McConnell, S.: Code Complete, 2nd edn. Microsoft Press, Redmond (2004)

    Google Scholar 

Download references

Acknowledgement

This paper is funded by Vietnam National University Ho Chi Minh City (VNU-HCM) under grant number C2018-26-09.

Author information

Authors and Affiliations

  1. Korea-Vietnam Friendship Information Technology College, Quangnam, Vietnam

    Quang-Vu Nguyen

  2. Faculty of Computer Science, University of Information Technology, Vietnam National University Ho Chi Minh City (VNU-HCM), Ho Chi Minh City, Vietnam

    Hai-Bang Truong

Authors
  1. Quang-Vu Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hai-Bang Truong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Quang-Vu Nguyen .

Editor information

Editors and Affiliations

  1. Computer Science and Applications Department LGIPM, University of Lorraine, Metz Cedex 03, France

    Hoai An Le Thi

  2. Computer Science and Applications Department LGIPM, University of Lorraine, Metz Cedex 03, France

    Hoai Minh Le

  3. Laboratory of Mathematics, National Institute for Applied Sciences, Saint-Étienne-du-Rouvray Cedex, France

    Tao Pham Dinh

  4. Department of Information Systems, Wroclaw University of Science and Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nguyen, QV., Truong, HB. (2020). An Improvement of Applying Multi-objective Optimization Algorithm into Higher Order Mutation Testing. In: Le Thi, H., Le, H., Pham Dinh, T., Nguyen, N. (eds) Advanced Computational Methods for Knowledge Engineering. ICCSAMA 2019. Advances in Intelligent Systems and Computing, vol 1121. Springer, Cham. https://doi.org/10.1007/978-3-030-38364-0_32

Download citation

Publish with us

Policies and ethics

Search

Navigation