Skip to main content
SpringerLink
Log in
Book cover

Achieving Safety and Reliability with Computer Systems pp 131–140Cite as

Statistical Methods for Software Reliability Assessment, Past, Present and Future

  • Chapter

Abstract

The role of statistics in software reliability assessment is reviewed in the light of current experience. It is argued that there is a place for statistical methods provided they are founded on the proper sources of uncertainty. These sources are defined and two of them emerge as the basis for reliability predictions. Various perceptions of reliability are identified and attention focuses on one of them, namely the in-use reliability. A general discussion of past and current models for reliability prediction is given together with remarks on several other applications of statistical methods. Some areas of future work are briefly described.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Veevers, A. and Davies, K.A., Credibility as a quantification of software reliability. Internat. J. Quality and Reliab., 1985, 2. 5–9.

    Article  Google Scholar 

  2. Dale, C.J. and Harris, L.N., Software reliability evaluation methods. ST-26750 Report, British Aerospace Dynamic Group, Sept. 1982.

    Google Scholar 

  3. Ramamoorthy, C.V. and Bastani, F., Software reliability status and perspectives. IEEE Trans. Soft. Engin., 1982, SE-8. 354–71.

    Article  Google Scholar 

  4. Shanthikumar, J.G., Software reliability models : a review. Microel. and Reliab., 1983, 22-903–43.

    Article  Google Scholar 

  5. Bendell, A. and Mellor, P., (Eds.) Software reliability : State of the art report, Pergamon Infotech Ltd, England, 1986.

    Google Scholar 

  6. Ohba, M., Software reliability analysis models. IBM J. Res. Develop., 1984, 28. 428–43.

    Article  Google Scholar 

  7. Musa, J.D. and Okumoto, K., A logarithmic Poisson execution time model for software reliability measurement. In Proc. 7th Int. Conf. Soft. Engin., Orlando, 1983, PP. 230–7.

    Google Scholar 

  8. Miller, D.R., Exponential order statistic models of software reliability growth. IEEE Trans. Soft. Engin., 1986, SE-12. 12–24.

    Google Scholar 

  9. Scholz, F.W., Software reliability modelling and analysis. IEEE Trans. Soft. Engin., 1986, SE-12. 25–31.

    Google Scholar 

  10. Yamada, S., Ohtera, H. and Narisha, H., Software reliability growth models with testing-effort. IEEE Trans. Reliab., 1986, R-35. 19–23.

    Article  Google Scholar 

  11. Currit, P.A., Dyer, M. and Mills, H.D., Certifying the reliability of software., IEEE Trans. Soft. Engin., 1986, SE-12. 3–11.

    Google Scholar 

  12. Kyparisis, J. and Singpurwalla, N.D., Bayesian inference for the Weibull process with applications to assessing software reliability growth and predicting software failures. In Comp. Science and Stat., The Interface Elsevier Science Publishers, BV, North-Holland, 1985, Pp. 57–64.

    Google Scholar 

  13. Langberg, N. and Singpurwalla, N.D., A unification of some software reliability models. SIAM J. Sci. Stat. Comput., 1985, 6, 781–90.

    Article  MathSciNet  MATH  Google Scholar 

  14. Abdel-Ghaly, A.A., Chan, P.Y. and Littlewood, B., Evaluation of competing software reliability predictions. IEEE Trans. Soft. Engin., 1986, SE-12. 950–67.

    Google Scholar 

  15. Kremer, W., Birth death and bug counting. IEEE Trans. Reliab., 1983, R-32. 37–46.

    Article  Google Scholar 

  16. Sumita, U. and Shanthikumar, J.G., A software reliability model with multiple-error introduction and removal. IEEE Trans. Reliab., 1986. R-35. 459–62.

    Article  Google Scholar 

  17. Crow, L.H. and Singpurwalla, N.D., An empirically developed Fourier series model for describing software failures. IEEE Trans. Reliab., 1984, R-33. 176–83.

    Article  Google Scholar 

  18. Horigome, M., Singpurwalla, N.D. and Soyer, R., A Bayes empirical Bayes approach for (software) reliability growth, In Comp. Science and Stat., The Interface Elsevier Science Publishers, BV, North-Holland, 1985, pp. 47–55.

    Google Scholar 

  19. Singpurwalla, N.D. and Soyer, R., Assessing (software) reliability growth using a random coefficients autoregressive process and its ramifications. IEEE Trans. Soft. Engin., 1985, SE-11. 1456–64.

    Article  Google Scholar 

  20. Luman, R.L., Practical Kaiman filter software performance testing and validification. IEEE Trans. Reliab., 1984, R-33. 219–26.

    Article  Google Scholar 

  21. Walls, L.A. and Bendell A., Time series methods in reliability. Proc. 9th Advances in Reliab. Tech. Symp., Bradford, 1986, pp. C2/3/1–18.

    Google Scholar 

  22. Jelinski, Z. and Moranda, P., Software reliability research. In Statist. Comp. Performance Evaluation, ed. W. Freiberger, Academic Press, N. York, London, 1972, pp. 465–84.

    Google Scholar 

  23. Littlewood, B. and Verrai, J.L., A Bayesian reliability model with a stochastically monotone failure rate. IEEE Trans. Reliab., 1974, R-23. 108–14.

    Article  Google Scholar 

  24. Bishop, P., Esp, D., Barnes, M., Humphreys, P., Dahll, G., Lahti, J. and Yoshimura, S., Project on diverse software - an experiment in software reliability. In IFAC Safecomp., Como, 1985, pp. 153–8.

    Google Scholar 

  25. Humphreys, P., Diversity by design : Reliability aspects of systems with embedded software. In Centre for Software Reliability Workshop on Software Reliability :_ Achievement and Assessment, Keele, 1985- (To be published by Blackweíls Oxford.)

    Google Scholar 

  26. Knight, J.C. and Leveson, N.G., An experimental evaluation of the assumption of independence in multiversion programming. IEEE Trans. Soft. Engin., 1986, SE-12. 96–109.

    Google Scholar 

  27. Ohba, M., Software quality = test accuracy x test coverage. In Proc. COMPSAC, Chicago, II., 1982, pp. 287–93.

    Google Scholar 

  28. Ido, S. et al., On the estimation of hidden bugs by the capture and recapture method and its application, (in Japanese.) IPS-J Proc. WGSE meeting, 1981, 19.

    Google Scholar 

  29. Forman, E.H. and Singpurwalla, N.D., An empirical stopping rule for debugging and testing computer software. J. Americ. Stat. Assoc., 1977, 72. 750–7.

    Article  Google Scholar 

  30. Okumoto, K. and Goel, A.L., Optimum release time for software systems based on reliability and cost criteria. J. Systems and Soft., 1980, 1. 315–18.

    Article  Google Scholar 

  31. Jewell, W.S., Bayesian extensions to a basic model of software reliability. IEEE Trans. Soft. Engin., 1985, SE-11. 1472–6.

    Article  Google Scholar 

  32. Ross, S.H., Software reliability : the stopping rule problem. IEEE Trans. Soft. Engin., 1985, SE-11, 1472–6.

    Article  Google Scholar 

  33. Petrova, E., Unpublished Ph.D. Thesis, Dept. S.C.M., University of Liverpool, I988.

    Google Scholar 

  34. Littlewood, B., How reliable is a program which has never failed? In Software Reliability and Metrics Newsletter, 1986, 4.

    Google Scholar 

  35. Kendell, A. and Byatt, W.J., Fuzzy sets, fuzzy algebra, and fuzzy statistics. Proc. IEEE., 1978, 66. 1619–39.

    Article  Google Scholar 

  36. Demillo, R.A., Lipton, R.J. and Sayward, F.G., Hints on test data selection : Help for the practical programmer. Computer, 1978, 11. 34–41.

    Article  Google Scholar 

  37. Marshall, A.C., Notes, ideas and comments on mutation analysis. TRUST Project Report AM/Mut/000002, Dept. S.C.M., University of Liverpool, 1987.

    Google Scholar 

  38. Littlewood, B., A semi-Markov model for software reliability with failure costs. In Proc. Symp. Comp. Soft. Engin., N. York, 1976, pp. 281–300.

    Google Scholar 

  39. Cheung, R.C., A user oriented software reliability model. In Proc COMPSAC, Chicago, II., 1978, pp. 565–70.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics and Computational Mathematics, The University of Liverpool, PO Box 147, Liverpool, L69 3BX, UK

    A. Veevers, E. Petrova & A. C. Marshall

Authors
  1. A. Veevers
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. Petrova
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. C. Marshall
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. National Computing Centre Ltd, Manchester, UK

    B. K. Daniels

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Elsevier Applied Science Publishers Ltd

About this chapter

Cite this chapter

Veevers, A., Petrova, E., Marshall, A.C. (1987). Statistical Methods for Software Reliability Assessment, Past, Present and Future. In: Daniels, B.K. (eds) Achieving Safety and Reliability with Computer Systems. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3461-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-3461-0_11

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-8050-7

  • Online ISBN: 978-94-009-3461-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation