Benchmarking Software Reliability Growth Models

  • Yunwei Hu
  • Wei Zhang
  • Bin Li
Conference paper


A number of classical software reliability growth models were benchmarked in this paper. Ten popular models were selected. A set of performance characteristics/factors which were believed to be related to the model’s benchmark was identified. A benchmark quantification scheme with respect to the set of performance factors was proposed. The procedure to conduct the benchmarking was established and then applied to the selected ten software reliability growth models. Some interesting results were observed and analyzed.


Analytical Hierarchy Process Software Reliability Aggregation Scheme Reliability Growth Soft Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Goel AL. and Okumoto, K. A time dependent error detection model for software reliability and other performance measure, IEEE Trans. Relia., 1979; 8: 206–211.CrossRefGoogle Scholar
  2. 2.
    Goel AL. Software Reliability Models: Assumptions, Limitations, and Applicability, IEEE Trans. Software Engr, 1985; 12: 1411–1423.CrossRefGoogle Scholar
  3. 3.
    Hossain S. and Dahiya R. Estimating the Parameters of a Non-Homogeneous Poission-Process Model of Software Reliability, IEEE Trans. Reliability, 1993; 12: 604–612.CrossRefGoogle Scholar
  4. 4.
    Jelinski Z. and Moranda, Software Reliability Research, In Statistical Computer Performance Evaluation, W. Freiberger, Ed, New York, pp.465-484, 1972.Google Scholar
  5. 5.
    Li, M, Smidts, C., A Ranking of Software Engineering Measures Based On Expert Opinion, IEEE Trans. Software Engr, 2003; 29: 9: 811–824CrossRefGoogle Scholar
  6. 6.
    Littlewood B. Stochastic Reliability Growth: A Model for Fault Removal in Computer Programs and Hardware Design, IEEE Trans. Reliability, 1981; 12: 313–320.CrossRefGoogle Scholar
  7. 7.
    Littlewood B. Rationale for a Modified Duane Model, IEEE Trans. Reliability, Jun, pp. 157-159, 1984.Google Scholar
  8. 8.
    Musa J. Software Reliability Data, DACS, RADC, New York, 1980.Google Scholar
  9. 9.
    Musa J. and Okumoto, A Logarithmic Possion Execution Time Model for Software Reliability Measurement, Proceedings of 7th International IEEE Conference on Software Engineering, 1984; 3: 230–238.Google Scholar
  10. 10.
    Musa J. and Okumoto, A Comparison of Time Domains for Softwre Reliability Models, J. Systems and Software, 4, pp.277–287, 1984.CrossRefGoogle Scholar
  11. 11.
    Musa J., Iannino J. and Okumoto, Software Reliability, McGraw-Hill, New York, 1987.Google Scholar
  12. 12.
    Alan Wood, Predicting Software Reliability, IEEE Comput. Soc, 1996; 29: 11: 69–77.CrossRefGoogle Scholar
  13. 13.
    Xie M. Software Reliability Modeling, World Scientific, 1991.Google Scholar
  14. 14.
    Yamada S. Ohba M. Osaki, S-Shaped Reliability Growth Modeling for Software Error Detection, IEEE Trans. Relia, 1983; 12: 475–484CrossRefGoogle Scholar
  15. 15.
    Yamada S. Software Reliability Growth Modeling: Models and Applications, IEEE Trans. Software Engr, Number 12, pp. 1431-1437, 1985.Google Scholar
  16. 16.
    Yamada S. Ohtera, and Narihisa, Software Reliability Growth Models with Testing Effort, IEEE Trans. Software Engr, 1986; 4: 19–23.Google Scholar
  17. 17.
    Saaty, T.L. Fundamentals of Decision Making and Priority Theory with the Analytic Hierarchy Process, RWS Publications, Pittsburgh, PA. 1994Google Scholar

Copyright information

© Springer-Verlag London 2004

Authors and Affiliations

  • Yunwei Hu
    • 1
  • Wei Zhang
    • 1
  • Bin Li
    • 1
  1. 1.University of MarylandCollege ParkUSA

Personalised recommendations