Skip to main content

On Some Statistical Aspects of Software Testing and Reliability

  • Conference paper
Complex Systems and Dependability

Part of the book series: Advances in Intelligent and Soft Computing ((AINSC,volume 170))

  • 902 Accesses

Abstract

This article discusses the author’s views on possible contributions statistics can make to software testing and reliability. Several difficulties are highlighted and several research challenges are discussed. Overall, the message is that statistical methods cannot provide proper support for software testing or provide useful inferences on software reliability if the statistical methods are considered to be an ‘add-on’; careful treatment of the uncertainties and the adequate use of statistical methods have to be right at the center of the software development and test processes to ensure better tested and more reliable software. In line with this requirement, the development of suitable statistical methods requires collaboration of software developers and testers with statisticians on real-world problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Coolen, F.P.A.: On probabilistic safety assessment in case of zero failures. Journal of Risk and Reliability 220, 105–114 (2006)

    Google Scholar 

  2. Coolen, F.P.A.: Nonparametric prediction of unobserved failure modes. Journal of Risk and Reliability 221, 207–216 (2007)

    Google Scholar 

  3. Coolen, F.P.A.: Discussion on: ‘A discussion of statistical testing on a safety-related application’ by Kuball and May. Journal of Risk and Reliability 222, 265–267 (2008)

    Google Scholar 

  4. Coolen, F.P.A.: Nonparametric predictive inference. In: Lovric (ed.) International Encyclopedia of Statistical Science, pp. 968–970. Springer, Berlin (2011)

    Google Scholar 

  5. Coolen, F.P.A., Coolen-Schrijner, P.: On zero-failure testing for Bayesian high reliability demonstration. Journal of Risk and Reliability 220, 35–44 (2006)

    Google Scholar 

  6. Coolen, F.P.A., Goldstein, M., Munro, M.: Generalized partition testing via Bayes linear methods. Information and Software Technology 43, 783–793 (2001)

    Article  Google Scholar 

  7. Coolen, F.P.A., Goldstein, M., Wooff, D.A.: Project viability assessment for support of software testing via Bayesian graphical modelling. In: Bedford, van Gelder (eds.) Safety and Reliability, pp. 417–422. Swets & Zeitlinger, Lisse (2003)

    Google Scholar 

  8. Coolen, F.P.A., Goldstein, M., Wooff, D.A.: Using Bayesian statistics to support testing of software systems. Journal of Risk and Reliability 221, 85–93 (2007)

    Google Scholar 

  9. Coolen, F.P.A., Troffaes, M.C.M., Augustin, T.: Imprecise probability. In: Lovric (ed.) International Encyclopedia of Statistical Science, pp. 645–648. Springer, Berlin (2011)

    Google Scholar 

  10. Coolen, F.P.A., Utkin, L.V.: Imprecise reliability. In: Lovric (ed.) International Encyclopedia of Statistical Science, pp. 649–650. Springer, Berlin (2011)

    Google Scholar 

  11. Coolen-Maturi, T., Coolen, F.P.A.: Unobserved, re-defined, unknown or removed failure modes in competing risks. Journal of Risk and Reliability 225, 461–474 (2011)

    Google Scholar 

  12. De Finetti, B.: Theory of probability (2 volumes). Wiley, London (1974)

    Google Scholar 

  13. Houlding, B., Coolen, F.P.A.: Sequential adaptive utility decision making for system failure correction. Journal of Risk and Reliability 221, 285–295 (2007)

    Google Scholar 

  14. Houlding, B., Coolen, F.P.A.: Adaptive utility and trial aversion. Journal of Statistical Planning and Inference 141, 734–747 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  15. Houlding, B., Coolen, F.P.A.: Nonparametric predictive utility inference. European Journal of Operational Research (to appear, 2012)

    Google Scholar 

  16. Wooff, D.A., Goldstein, M., Coolen, F.P.A.: Bayesian graphical models for software testing. IEEE Transactions on Software Engineering 28, 510–525 (2002)

    Article  Google Scholar 

  17. Wooff, D.A., Goldstein, M., Coolen, F.P.A.: Bayesian graphical models for high-complexity software and system testing. Springer (in preparation)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Frank P. A. Coolen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Coolen, F.P.A. (2013). On Some Statistical Aspects of Software Testing and Reliability. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Complex Systems and Dependability. Advances in Intelligent and Soft Computing, vol 170. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30662-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30662-4_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30661-7

  • Online ISBN: 978-3-642-30662-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics