Abstract
Software testing which plays an increasingly important role on the assurance of software quality and reliability has been paid more and more attention. However, when to stop testing is still one of the challenges in software testing field. Firstly, the stopping criteria for software testing were studied from the theoretical point of view. Then the stopping criteria for software testing based on test quality were put forward. According to the different purposes of testing, two kinds of stopping criteria were discussed, one for software correctness testing (SCT), and the other for software reliability testing (SRT). Referred to the achievements of the stopping criteria for SCT and combined with the characteristics of SRT, stopping criteria for SRT were put forward, which showed when to stop testing can be explicitly decided by the control of the test procedure.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Goodenough, J.B., Gerhart, S.L.: Toward a Theory of Test Data Selection. IEEE Transactions on Software Engineering SE-3(2), 156–173 (1975)
Musa, J.D., Frank Ackerman, A.: Quantifying Software Validation: When to Stop Testing? IEEE Software 6(3), 19–27 (1989)
Schneidewind, N.F.: Reliability modeling for safety-critical software. IEEE Transactions on Reliability 46(1), 88–98 (1997)
Garg, M., Lai, R., Jen Huang, S.: When to stop testing A study from the perspective of software reliability models. IET Softw. 5(3), 263–273 (2011)
Hou, R.-H., Kuo, S.-Y., Chang, Y.-P.: Optimal release times for software systems with scheduled delivery time based on the HGDM. IEEE Transactions on Computers 46(2), 216–221 (1997)
Yang, B., Hu, H., Zhou, J.: Optimal Software Release Time Determination with Risk Constraint. In: Proc. 54th Ann. Reliability and Maintainability Symp., pp. 393–398 (2008)
Huang, C.-Y., Kuo, S.-Y., Lyu, M.R.: Optimal software release policy based on cost and reliability with testing efficiency. In: IEEE Computer Society’s International Computer Software and Applications Conference, pp. 468–473 (1999)
Ehrlich, W., Prasanna, B., Stampfel, J., Wu, J.: Determining the cost of a stop-test decision. IEEE Software 10(2), 33–42 (1993)
Xie, M.: On the determination of optimum software release time. In: 1991 International Symposium on Software Reliability Engineering, pp. 218–224 (1991)
Siddhartha, R.D., McIntosh, A.A.: When to Stop Testing for Large Software Systems with Changing Code. IEEE Trans. on Software Engineering 30(4), 318–323 (1994)
Li, Q., Ruan, L., Liu, B.: Research on Software Reliability Testing Adequacy. Measurement & Control Technology (11), 49–52 (2003) (in Chinese)
Zhu, H., Jin, L.: Software Quality Assurance and Testing, pp. 70–215. Science Press, Beijing (1997) (in Chinese)
Li, Q., Lu, M., Ruan, L.: Theoretical Research on Software Reliability Testing Adequacy. Journal of Beijing University of Aeronautics and Astronautics 29(4), 312–316 (2003) (in Chinese)
Li, Q.: Theoretical Research on Software Reliability Testing Adequacy. Ph.D. Thesis, Beijing University of Aeronautics and Astronautics (2004) (in Chinese)
Chen, Y.: Modelling Software Operational Reliability via Input Domain-Based Reliability Growth Model. In: Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing, pp. 314–323 (1998)
Musa, J.D.: Operational Profiles in Software Reliability Engineering. IEEE Software 10(2), 14–32 (1993)
Whittaker, J.A.: A Markov Chain Model for Statistical Software Testing. IEEE Transaction on Software Engineering 20(10), 812–824 (1994)
Kullback, S.: Information Theory and Statistics. Wiley, New York (1958)
Zeng, G., et al.: Summary of Systems Theory, Information Theory, and Control Theory, pp. 149–151. Central South University of Technology Press, Hunan (1986) (in Chinese)
Bin, L.: Software Reliability Research. Postdoctoral research report. Beijing University of Aeronautics and Astronautics (2002) (in Chinese)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag GmbH Berlin Heidelberg
About this paper
Cite this paper
Li, Q., Wang, J. (2012). The Stopping Criteria for Software Reliability Testing Based on Test Quality. In: Thaung, K. (eds) Advanced Information Technology in Education. Advances in Intelligent and Soft Computing, vol 126. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25908-1_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-25908-1_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25907-4
Online ISBN: 978-3-642-25908-1
eBook Packages: EngineeringEngineering (R0)