Skip to main content
SpringerLink
Log in

Evolutionary Testing of Embedded Systems

  • Chapter
Evolutionary Algorithms for Embedded System Design

Part of the book series: Genetic Algorithms and Evolutionary Computation ((GENA,volume 10))

Abstract

Testing is the most important analytical quality assurance measure for embedded systems. Test case design is the decisive testing activity for the quality of the test. Until now it has not been possible to automate test case design for common function-oriented and structure-oriented test procedures. This causes test case design to be fault-prone and cost-intensive. The evolutionary test is a new, promising approach for the automation of test case design. Evolutionary tests can be used to automate both the testing of functional and non-functional properties. For this purpose the respective test goal is transformed into an optimization problem which is solved by means of meta-heuristic search techniques. The definition of the fitness function is decisive. This chapter presents the fitness functions for testing the temporal behavior of systems, for the execution of safety tests, and for structure tests. Experiments performed demonstrate the effectiveness of the evolutionary test.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Thaller, G.:Software Engineering fir Echtzeit und Embedded Systems (Software Engineering for Real-time and Embedded Systems).bhv Verlags GmbH, 1997

    Google Scholar 

  2. http://matrix.rvs.uni-bielefeld.de/publications/Incidents/docs/fbw.html.

  3. http://catless.ncl.ac.uk/Risks.

  4. Wegener, J., and Pitschinetz, R.:TESSY - Yet Another Computer-Aided Software Testing Tool?Proceedings of the Second International Conference on Software Testing, Analysis and Review, Bruxelles, Belgium, 1994

    Google Scholar 

  5. Beizer, B.: Black-Box Testing - Techniques for Functional Testing of Software and Systems.John Wiley & Sons, 1995

    Google Scholar 

  6. Dijkstra, E.:Notes on Structured Programming.In: 0.-J. Dahl, E. Dijkstra and C. Hoare. Structured Programming. Academic Press, 1972, pp. 114–137

    Google Scholar 

  7. Wegener, J. and Grochtmann, M.:Verifying Timing Constraints of Real-Time Systems by means of Evolutionary Testing.Real-Time, Systems, vol. 15, no. 3; Springer Science+Business Media New York, 1998, pp. 275–298

    Google Scholar 

  8. Grochtmann, M. and Grimm, K.:Classification Trees for Partition Testing.Software Testing, Verification & Reliability, vol. 3, no. 2, 1993, pp. 63–82

    Article  Google Scholar 

  9. Ntafos, S.:On Testing with Required Elements.Proceedings of the Fifth International Computer Software and Applications Conference, Chicago, Illinois, USA, 1981, pp. 132–139

    Google Scholar 

  10. Hamlet, D.:Foundations of Software Testing: Dependability Theory. http://www.cs.pdx.edu/hamlet/testres.html.

  11. DeMillo, R., Lipton, R., and Sayward, F.:Program Mutation: A New Approach to Program Testing. Infotech State of the Art Report on Software Testingvol. 2, Infotech Int. Ltd., Maidenhead, Great Britain, 1979, pp. 107–127

    Google Scholar 

  12. Roper, M.:Software Testing.McGraw-Hill, 1994

    Google Scholar 

  13. Howden, W.:Functional Program Testing and Analysis.McGraw-Hill Book Company, 1987

    Google Scholar 

  14. Myers, G.:The Art of Software Testing.John Wiley & Sons, 1979

    Google Scholar 

  15. Belli, F., Grochtmann, M. and Jack, O.:Erprobte Modelle zur Quantifizierung der Software-Zuverlässigkeit (Proven Models for the Calculation of Software Reliability).Informatik Spektrum, vol. 21, no. 3, 1998, pp. 131–140

    Article  Google Scholar 

  16. Jones, B., Eyres, D. and Sthamer, H.:A Strategy for using Genetic Algorithms to Automate Branch and Fault-based Testing.The Computer Journal, vol. 41, no. 2, 1998, pp. 98–107

    Article  Google Scholar 

  17. Wegener, J., Grimm, K., Grochtmann, M., Sthamer, H., and Jones, B.:Systematic Testing of Real-Time Systems.Proceedings of the Fourth European International Conference on Software Testing, Analysis & Review, Amsterdam, Netherlands, 1996

    Google Scholar 

  18. Pohlheim, H.:Entwicklung und systemtechnische Anwendung evolutionärer Algorithmen (Development and application of evolutionary algorithms within system development).PhD thesis, Technical University Ilmenau, 1998

    Google Scholar 

  19. Pohlheim, H.:Genetic and Evolutionary Algorithm Toolbox for Use with Matlab - Documentation. http://www.geatbx.com/.

  20. Wegener, J., Pohlheim, H., and Sthamer, H.:Testing the Temporal Behaviour of Real-Time Tasks using Extended Evolutionary Algorithms.Proceedings of the Seventh European Conference on Software Testing, Analysis and Review, Barcelona, Spain, 1999

    Google Scholar 

  21. GAA: The Genetic Algorithms Archive. ftp://www.aic.nrl.navy.mil/pub/ga-list/index.html.

  22. GASN: The Genetic Algorithms Software Notebook. http://www.geneticprogramming.com/ga/GAsoftware.html.

  23. Whitley, D.:The GENITOR Algorithm and Selection Pressure: Why Rank-Based Allocation of Reproductive Trials is Best.Proceedings of the Third International Conference on Genetic Algorithms, San Mateo, California, USA, 1989, pp. 116–121

    Google Scholar 

  24. Baker, J.E.:Reducing Bias and Inefficiency in the Selection Algorithm. Proceedings of the Second International Conference on Genetic Algorithms and their Application, Cambridge, USA, 1987

    Google Scholar 

  25. Törngren, M.:Fundamentals of Implementing Real-Time Control Applications in Distributed Computer Systems.In Wikander, J. and Svensson, B. (Eds): Real-Time Systems in Mechatronic Applications, Springer Science+Business Media New York, 1998

    Google Scholar 

  26. Wegener, J., and Mueller, F.:A Comparison of Static Analysis and Evolutionary Testing for the Verification of Timing Constraints.Real-Time Systems, vol. 21, no. 3, 2001, pp. 241–268

    Article  MATH  Google Scholar 

  27. Puschner, R and Nossal, R.: Testing the Results of Static Worst-Case Execution-Time Analysis.Proc of the 19th Real-Time Systems Symposium, 1998, pp. 134–143

    Google Scholar 

  28. Gross, H., Jones, B. and Eyres, D.: Structural performance measure of Evolutionary Testing applied to worst-case timing of real-time systems.IEE Proc.-Softw., vol. 147, no. 2, 2000, pp. 25–30

    Article  Google Scholar 

  29. Tracey, N., Clark, J., Mander, K., and McDermid, J.:An Automated Framework for Structural Test-Data Generation.Proceedings of the 13th IEEE Conference on Automated Software Engineering, Hawaii, USA, 1998

    Google Scholar 

  30. Schultz, A., Grefenstette, J., and De Jong, K.: Test and Evaluation by Genetic Algorithms.IEEE Expert 8(5), 1993, pp. 9–14

    Article  Google Scholar 

  31. Wegener, J., Baresel, A., and Sthamer, H.:Evolutionary Test Environment for Automatic Structural Testing.Information and Software Technology, Special Issue devoted to the Application of Metaheuristic Algorithms to Problems in Software Engineering, vol. 43, 2001, pp. 841–854

    Google Scholar 

  32. Wegener, J., Baresel, A., and Buhr, K.: Assessing Evolutionary Testability by means of Structure-based Complexity Measures.Submission to the Annals of Software Engineering Special Volume on Computational Intelligence in Software Engineering, 2002

    Google Scholar 

  33. Mueller, F.:Generalizing Timing Predictions to Set-Associative Caches.Proc. EuroMicro Workshop on Real-Time Systems, Jun 1997, pp. 64–71

    Google Scholar 

  34. Puschner, P. and Vrchoticky, A.:Problems in Static Worst-Case Execution Time Analysis. Proceedings of the 9th ITG/GI-Conference Measurement, Modeling and Evaluation of Computational and Communication Systems, 1997, pp. 18–25

    Google Scholar 

  35. Sthamer, H.:The Automatic Generation of Software Test Data Using Genetic Algorithms. PhD Thesis, University of Glamorgan, Pontyprid, Wales, Great Britain, 1996

    Google Scholar 

  36. Hamlet, D. and Taylor, D.:Partition Testing Does Not Inspire Confidence.IEEE Transactions on Software Engineering, vol. 16, no. 2, 1990, pp. 1402–1411

    Article  MathSciNet  Google Scholar 

  37. Waeselynck, H., and Th¨¦venod-Fosse, P.:An Experimentation with Statistical Testing.Proceedings of the 2nd European International Conference on Software Testing, Analysis & Review, Brussels, Belgium, 1994, pp. 10/1–10/14.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DaimlerChrysler AG, Research and Technology, Alt-Moabit 96a, 10559, Berlin, Germany

    Joachim Wegener

Authors
  1. Joachim Wegener
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Bremen, Germany

    Rolf Drechsler  & Nicole Drechsler  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Science+Business Media New York

About this chapter

Cite this chapter

Wegener, J. (2003). Evolutionary Testing of Embedded Systems. In: Drechsler, R., Drechsler, N. (eds) Evolutionary Algorithms for Embedded System Design. Genetic Algorithms and Evolutionary Computation, vol 10. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-1035-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-1035-2_1

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-5362-1

  • Online ISBN: 978-1-4615-1035-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation