Abstract
The role of statistics in software reliability assessment is reviewed in the light of current experience. It is argued that there is a place for statistical methods provided they are founded on the proper sources of uncertainty. These sources are defined and two of them emerge as the basis for reliability predictions. Various perceptions of reliability are identified and attention focuses on one of them, namely the in-use reliability. A general discussion of past and current models for reliability prediction is given together with remarks on several other applications of statistical methods. Some areas of future work are briefly described.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Veevers, A. and Davies, K.A., Credibility as a quantification of software reliability. Internat. J. Quality and Reliab., 1985, 2. 5–9.
Dale, C.J. and Harris, L.N., Software reliability evaluation methods. ST-26750 Report, British Aerospace Dynamic Group, Sept. 1982.
Ramamoorthy, C.V. and Bastani, F., Software reliability status and perspectives. IEEE Trans. Soft. Engin., 1982, SE-8. 354–71.
Shanthikumar, J.G., Software reliability models : a review. Microel. and Reliab., 1983, 22-903–43.
Bendell, A. and Mellor, P., (Eds.) Software reliability : State of the art report, Pergamon Infotech Ltd, England, 1986.
Ohba, M., Software reliability analysis models. IBM J. Res. Develop., 1984, 28. 428–43.
Musa, J.D. and Okumoto, K., A logarithmic Poisson execution time model for software reliability measurement. In Proc. 7th Int. Conf. Soft. Engin., Orlando, 1983, PP. 230–7.
Miller, D.R., Exponential order statistic models of software reliability growth. IEEE Trans. Soft. Engin., 1986, SE-12. 12–24.
Scholz, F.W., Software reliability modelling and analysis. IEEE Trans. Soft. Engin., 1986, SE-12. 25–31.
Yamada, S., Ohtera, H. and Narisha, H., Software reliability growth models with testing-effort. IEEE Trans. Reliab., 1986, R-35. 19–23.
Currit, P.A., Dyer, M. and Mills, H.D., Certifying the reliability of software., IEEE Trans. Soft. Engin., 1986, SE-12. 3–11.
Kyparisis, J. and Singpurwalla, N.D., Bayesian inference for the Weibull process with applications to assessing software reliability growth and predicting software failures. In Comp. Science and Stat., The Interface Elsevier Science Publishers, BV, North-Holland, 1985, Pp. 57–64.
Langberg, N. and Singpurwalla, N.D., A unification of some software reliability models. SIAM J. Sci. Stat. Comput., 1985, 6, 781–90.
Abdel-Ghaly, A.A., Chan, P.Y. and Littlewood, B., Evaluation of competing software reliability predictions. IEEE Trans. Soft. Engin., 1986, SE-12. 950–67.
Kremer, W., Birth death and bug counting. IEEE Trans. Reliab., 1983, R-32. 37–46.
Sumita, U. and Shanthikumar, J.G., A software reliability model with multiple-error introduction and removal. IEEE Trans. Reliab., 1986. R-35. 459–62.
Crow, L.H. and Singpurwalla, N.D., An empirically developed Fourier series model for describing software failures. IEEE Trans. Reliab., 1984, R-33. 176–83.
Horigome, M., Singpurwalla, N.D. and Soyer, R., A Bayes empirical Bayes approach for (software) reliability growth, In Comp. Science and Stat., The Interface Elsevier Science Publishers, BV, North-Holland, 1985, pp. 47–55.
Singpurwalla, N.D. and Soyer, R., Assessing (software) reliability growth using a random coefficients autoregressive process and its ramifications. IEEE Trans. Soft. Engin., 1985, SE-11. 1456–64.
Luman, R.L., Practical Kaiman filter software performance testing and validification. IEEE Trans. Reliab., 1984, R-33. 219–26.
Walls, L.A. and Bendell A., Time series methods in reliability. Proc. 9th Advances in Reliab. Tech. Symp., Bradford, 1986, pp. C2/3/1–18.
Jelinski, Z. and Moranda, P., Software reliability research. In Statist. Comp. Performance Evaluation, ed. W. Freiberger, Academic Press, N. York, London, 1972, pp. 465–84.
Littlewood, B. and Verrai, J.L., A Bayesian reliability model with a stochastically monotone failure rate. IEEE Trans. Reliab., 1974, R-23. 108–14.
Bishop, P., Esp, D., Barnes, M., Humphreys, P., Dahll, G., Lahti, J. and Yoshimura, S., Project on diverse software - an experiment in software reliability. In IFAC Safecomp., Como, 1985, pp. 153–8.
Humphreys, P., Diversity by design : Reliability aspects of systems with embedded software. In Centre for Software Reliability Workshop on Software Reliability :_ Achievement and Assessment, Keele, 1985- (To be published by BlackweÃls Oxford.)
Knight, J.C. and Leveson, N.G., An experimental evaluation of the assumption of independence in multiversion programming. IEEE Trans. Soft. Engin., 1986, SE-12. 96–109.
Ohba, M., Software quality = test accuracy x test coverage. In Proc. COMPSAC, Chicago, II., 1982, pp. 287–93.
Ido, S. et al., On the estimation of hidden bugs by the capture and recapture method and its application, (in Japanese.) IPS-J Proc. WGSE meeting, 1981, 19.
Forman, E.H. and Singpurwalla, N.D., An empirical stopping rule for debugging and testing computer software. J. Americ. Stat. Assoc., 1977, 72. 750–7.
Okumoto, K. and Goel, A.L., Optimum release time for software systems based on reliability and cost criteria. J. Systems and Soft., 1980, 1. 315–18.
Jewell, W.S., Bayesian extensions to a basic model of software reliability. IEEE Trans. Soft. Engin., 1985, SE-11. 1472–6.
Ross, S.H., Software reliability : the stopping rule problem. IEEE Trans. Soft. Engin., 1985, SE-11, 1472–6.
Petrova, E., Unpublished Ph.D. Thesis, Dept. S.C.M., University of Liverpool, I988.
Littlewood, B., How reliable is a program which has never failed? In Software Reliability and Metrics Newsletter, 1986, 4.
Kendell, A. and Byatt, W.J., Fuzzy sets, fuzzy algebra, and fuzzy statistics. Proc. IEEE., 1978, 66. 1619–39.
Demillo, R.A., Lipton, R.J. and Sayward, F.G., Hints on test data selection : Help for the practical programmer. Computer, 1978, 11. 34–41.
Marshall, A.C., Notes, ideas and comments on mutation analysis. TRUST Project Report AM/Mut/000002, Dept. S.C.M., University of Liverpool, 1987.
Littlewood, B., A semi-Markov model for software reliability with failure costs. In Proc. Symp. Comp. Soft. Engin., N. York, 1976, pp. 281–300.
Cheung, R.C., A user oriented software reliability model. In Proc COMPSAC, Chicago, II., 1978, pp. 565–70.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1987 Elsevier Applied Science Publishers Ltd
About this chapter
Cite this chapter
Veevers, A., Petrova, E., Marshall, A.C. (1987). Statistical Methods for Software Reliability Assessment, Past, Present and Future. In: Daniels, B.K. (eds) Achieving Safety and Reliability with Computer Systems. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3461-0_11
Download citation
DOI: https://doi.org/10.1007/978-94-009-3461-0_11
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-8050-7
Online ISBN: 978-94-009-3461-0
eBook Packages: Springer Book Archive