Skip to main content

Evolutionary Testing: A Case Study

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4383))

Abstract

The paper presents a case study of applying genetic algorithms (GAs) to the automatic test data generation problem. We present the basic techniques implemented in our prototype test generation system, whose goal is to get branch coverage of the program under testing. We used our tool to experiment with simple programs, programs that have been used by others for test strategies benchmarking and the UNIX utility uniq. The effectiveness of GA-based testing system is compared with a Random testing system. We found that for simple programs both testing systems work fine, but as the complexity of the program or the complexity of input domain grows, GA-based testing system significantly outperforms Random testing.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McMinn, P.: Search-based software testing: A survey. Software Testing, Verification and Reliability 14(2), 105–156 (2004)

    Article  Google Scholar 

  2. Ferguson, R., Korel, B.: The chaining approach for software test data generation. ACM Transactions on Software Engineering and Methodology 5(1), 63–86 (1996)

    Article  Google Scholar 

  3. McGraw, G., Michael, C., Schatz, M.: Generating software test data by evolution. IEEE Transactions on Software Engineering 27(12), 1085–1110 (2001)

    Article  Google Scholar 

  4. Rad, S.K.: Can structural test adequacy criteria be used to predict the quality of generated invariants? MSc thesis, University of Antwerp (2005)

    Google Scholar 

  5. Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Kluwer Academic Publishers, Boston (1989)

    MATH  Google Scholar 

  6. Roper, M.: Software Testing. McGraw-Hill, New York (1994)

    Google Scholar 

  7. Codesurfer. http://www.grammatech.com/products/codesurfer , last visited July 2006

  8. http://www.mathtools.net/MATLAB/Genetic_algorithms , last visited July 2006

  9. Sthamer, H., Wegener, J., Baresel, A.: Using Evolutionary Testing to improve Efficiency and Quality in Software Testing. In: Proceedings of the 2nd Asia-Pacific Conference on Software Testing Analysis and Review (AsiaSTAR), 22-24th July (2002)

    Google Scholar 

  10. Xanthakis, S., et al.: Application of genetic algorithms to software testing (Application des algorithmes génétiques au test des logiciels). In: 5th International Conference on Software Engineering and its Applications, Toulouse, France, pp. 625–636 (1992)

    Google Scholar 

  11. Wegener, J., Buhr, K., Pohlheim, H.: Automatic test data generation for structural testing of embedded software systems by evolutionary testing. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002), New York, USA, pp. 1233–1240. Morgan Kaufmann, San Francisco (2002)

    Google Scholar 

  12. Wegener, J., Baresel, A., Sthamer, H.: Evolutionary test environment for automatic structural testing. Information and Software Technology 43(14), 841–854 (2001)

    Article  Google Scholar 

  13. GDB, The GNU Source-Level Debugger. http://www.fismat.umich.mx/mn1/gdb/gdb_toc.html , last visited July 2006

  14. Wikipedia, Uniq. http://en.wikipedia.org/wiki/Uniq , last visited November 2006

Download references

Author information

Authors and Affiliations

Authors

Editor information

Eyal Bin Avi Ziv Shmuel Ur

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Levin, S., Yehudai, A. (2007). Evolutionary Testing: A Case Study. In: Bin, E., Ziv, A., Ur, S. (eds) Hardware and Software, Verification and Testing. HVC 2006. Lecture Notes in Computer Science, vol 4383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70889-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-70889-6_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-70888-9

  • Online ISBN: 978-3-540-70889-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics