Test Suite Reduction and Fault Detecting Effectiveness: An Empirical Evaluation

  • Tsong Y. Chen
  • Man F. Lau
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2043)


Test suite reduction is aimed at finding representative sets that can satisfy the same testing objective as their original test suite. As a subset of the original test suite, the representative set may have less fault detection capability. However, researches show that a representative set and its original test suite have similar fault detection capabilities for the case of coverage based criteria. This paper investigates the relationship between the fault detection capabilities of a representative set and its original test suite when the generation of the test suite is based on some fault-based test case selection criteria.


Empirical study software testing specification based testing test suite reduction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    T.Y. Chen and M.F. Lau, A new heuristic for test suite reduction, Information and Software Technology, 40(5-6):347–354, 1998.CrossRefGoogle Scholar
  2. 2.
    T.Y. Chen, M.F. Lau, and Y.T. Yu, MUMCUT: A fault-based strategy for testing Boolean specifications, In Proceedings of APSEC’99, pp. 606–613, 1999.Google Scholar
  3. 3.
    J.J. Chilenski and S.P. Miller, Applicability of modified condition/decision coverage to software testing, Software Engineering Journal, 9(5):193–200, 1994.CrossRefGoogle Scholar
  4. 4.
    R.A. DeMillo, R.J. Lipton, and F.G. Sayward, Hints on test data selection: Help for the practicing programmer, Computer, 11(4):34–41, 1978.CrossRefGoogle Scholar
  5. 5.
    R.A. DeMillo and A.J. Offutt, Constraint-based automatic test data generation, IEEE Trans. on Software Engineering, 17(9):900–910, 1991.CrossRefGoogle Scholar
  6. 6.
    K.A. Foster, Error sensitive test cases analysis (estca), IEEE Trans. on Software Engineering, 6(2):258–264, 1980.CrossRefGoogle Scholar
  7. 7.
    K.A. Foster, Sensitive test data for logic expressions, ACM SIGSOFT Software Engineering Notes, 9(2):120–125, 1984.CrossRefGoogle Scholar
  8. 8.
    D.D. Givone, Introduction to Switching Circuit Theory, McGraw-Hill, 1970.Google Scholar
  9. 9.
    B. Korel, Automated software test data generation, IEEE Trans. on Software Engineering, 16(8):870–879, 1990.CrossRefGoogle Scholar
  10. 10.
    N.G. Leveson, M.P.E. Heimdahl, H. Hildreth, and J.D. Reese, Requirements specification for process-control systems, IEEE Trans. on Software Engineering, 20(9):684–707, 1994.CrossRefGoogle Scholar
  11. 11.
    G.J. Myers, The Art of Software Testing, John Wiley, Second edition, 1979.Google Scholar
  12. 12.
    W.V. Quine, The problem of simplifying truth functions, American Mathematical Monthly, 59:521–531, 1952.zbMATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    C.V. Ramamoorthy, S.-B.F. Ho, and W.T. Chen, On the automated generation of program test data, IEEE Trans. on Software Engineering, 2(4):293–300, 1976.CrossRefGoogle Scholar
  14. 14.
    K.C. Tai, Condition-based software testing strategies, In Proceedings of COMPSAC 90, pp. 564–569, Washington, DC, 1990.Google Scholar
  15. 15.
    K.C. Tai, Theory of fault-based predicate testing for computer programs, IEEE Trans. on Software Engineering, 22(8):552–563, 1996.CrossRefGoogle Scholar
  16. 16.
    K.C. Tai and H.K. Su, Test generation for boolean expressions, In Proceedings of COMPSAC 87, pp. 278–284, Washington, DC, 1987.Google Scholar
  17. 17.
    W.T. Tsai, D. Volovik, and T.F. Keefe, Automated test case generation for programs specified by relational algebra queries, IEEE Trans. on Software Engineering, 16(3):316–324, 1990.CrossRefGoogle Scholar
  18. 18.
    E.J. Weyuker, T. Goradia, and A. Singh, Automatically generating test data from a boolean specification, IEEE Trans. on Software Engineering, 20(5):353–363, 1994.zbMATHCrossRefGoogle Scholar
  19. 19.
    W.E. Wong, J.R. Horgan, S. London, and A.P. Mathur, Effect of test set minimization on fault detection effectiveness, Software-Practice and Experience, 28(4):347–369, 1998.CrossRefGoogle Scholar
  20. 20.
    W.E. Wong, J.R. Horgan, A.P. Mathur, and A. Pasquini, Test set size minimization and fault detection effectiveness: A case study in a space application, The Journal of Systems and Software, 48:79–89, 1999.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Tsong Y. Chen
    • 1
  • Man F. Lau
    • 1
  1. 1.School of Information TechnologySwinburne University of TechnologyHawthornVic.Australia

Personalised recommendations