First Steps towards Validating a Cost-Benefit Model of Reviews and Tests

  • Tilmann Hampp
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5338)


Software project managers’ decisions on reviews and tests are difficult. This paper describes a cost-benefit model for specific decisions on quality assurance. The quantitative model is based on single relationships and is quantified with historical data. Its results are shown and are compared with cost estimations. The model is able to reflect reported results of process improvement. Data collected in student projects is used to evaluate the model. Project averages and single projects are considered. Furthermore, results of a cross-validation are shown.


Defect Detection Integration Test Single Project Student Project Design Review 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Biffl, S.: Software Inspection Techniques to Support Project and Quality Management, Habilitationsschrift. Shaker Verlag (2001)Google Scholar
  2. 2.
    Biffl, S., Halling, M.: Investigating the Influence of Inspector Capability Factors with Four Inspection Techniques on Inspection Performance. In: Proc. of METRICS 2002 (2002)Google Scholar
  3. 3.
    Biffl, S., Halling, M.: Investigating the Defect Detection Effectiveness and Cost Benefit of Nominal Inspection Teams. IEEE Trans. on Softw. Eng. 29(5) (2003)Google Scholar
  4. 4.
    Boehm, B.W.: Software Engineering Economics. Prentice Hall, Englewood Cliffs (1981)zbMATHGoogle Scholar
  5. 5.
    Boehm, B.W.: Software Cost Estimation with COCOMO II. Prentice Hall, Englewood Cliffs (2000)Google Scholar
  6. 6.
    Boehm, B.W., Huang, L., Jain, A., Madachy, R.: The ROI of Software Dependability: The iDave Model. IEEE Softw. 21(3) (2004)Google Scholar
  7. 7.
    Bossel, H.: Systeme, Dynamik, Simulation. Books on Demand (2004)Google Scholar
  8. 8.
    Cangussu, J.W., Mathur, A.P., Karcich, R.M., DeCarlo, R.A.: Software Release Control using Defect Based Quality Estimation. In: Proc. of ISSRE 2004 (2004)Google Scholar
  9. 9.
    Cuadrado-Gallego, J.J., Fernandez-Sanz, L., Sicilia, M.-A.: Enhancing Input Value Selection in Parametric Software Cost Estimation Models through Second Level Cost Drivers. Software Quality Journal 14(4) (2006)Google Scholar
  10. 10.
    Dahl, O.-J., Dijkstra, E.W., Hoare, C.A.R.: Structured Programming. Academic Press, London (1972)zbMATHGoogle Scholar
  11. 11.
    Diaz, M., King, J.: How CMM Impacts Quality, Productivity, Rework, and the Bottom Line. CrossTalk (March 2002)Google Scholar
  12. 12.
    Drappa, A., Deininger, M., Ludewig, J., Melchisedech, R.: Modeling and Simulation of Software Projects. In: Proc. of the 20th Annual Softw. Eng. Workshop (1995)Google Scholar
  13. 13.
    El Emam, K.: The ROI from Software Quality. Auerbach Publications (2005)Google Scholar
  14. 14.
    Endres, A., Rombach, H.D.: A Handbook of Software and Systems Engineering. Empirical Observations, Laws and Theories. Pearson, London (2003)Google Scholar
  15. 15.
    Fagan, M.E.: Advances in Software Inspections. IEEE Trans. on Softw. Eng. SE-12(7) (1986)Google Scholar
  16. 16.
    Fenton, N.E., Pfleeger, S.L.: Software Metrics. A Rigorous & Practical Approach, 2nd edn. PWS Publishing Company (1997)Google Scholar
  17. 17.
    Freedman, D.P., Weinberg, G.M.: Handbook of Walkthroughs, Inspections, and Technical Reviews, 3rd edn. Little, Brown and Company (1982)Google Scholar
  18. 18.
    Freimut, B., Briand, L.C., Vollei, F.: Determining Inspection Cost-Effectiveness by Combining Project Data and Expert Opinion. IEEE Trans. on Softw. Eng. 31(12) (2005)Google Scholar
  19. 19.
    Grady, R.B.: Practical Software Metrics for Project Management and Process Improvement. Prentice Hall, Englewood Cliffs (1992)Google Scholar
  20. 20.
    Haley, T., Ireland, B., Wojtaszek, E., Nash, D., Dion, R.: Raytheon Electronic Systems Experience in Software Process Improvement. CMU/SEI-95-TR-017 (1995)Google Scholar
  21. 21.
    Hampp, T., Knauß, M.: Eine Untersuchung über Korrekturkosten von Software-Fehlern. Softwaretechnik-Trends 28(2) (2008)Google Scholar
  22. 22.
    Huang, C.-Y., Lyu, M.R.: Optimal Release Time for Software Systems Considering Cost, Testing-Effort, and Test Efficiency. IEEE Trans. on Reliability 54(4) (2005)Google Scholar
  23. 23.
    Jalote, P.: CMM in Practice: Processes for Executing Software Projects at Infosys. Addison-Wesley, Reading (2000)Google Scholar
  24. 24.
    Jones, C.: Applied Software Measurement. 2nd edn. McGraw-Hill, New York (1997)Google Scholar
  25. 25.
    Jones, C.: Estimating Software Costs. McGraw-Hill, New York (2007)Google Scholar
  26. 26.
    Kan, S.H.: Metrics and Models in Software Quality Engineering, 2nd edn. Addison-Wesley, Reading (2003)zbMATHGoogle Scholar
  27. 27.
    Kemerer, C.F.: An Empirical Validation of Software Cost Estimation Models. Comm. of the ACM 30(5) (1987)Google Scholar
  28. 28.
    Kusumoto, S., Matsumoto, K., Kikuno, T., Torii, K.: A New Metrics for Cost Effectiveness of Software Reviews. IEICE Trans. on Inf. and Syst. E75-D(5) (1992)Google Scholar
  29. 29.
    Liggesmeyer, P.: Software-Qualität. Spektrum (2002)Google Scholar
  30. 30.
    Ludewig, J. (ed.): Praktische Lehrveranstaltungen im Studiengang Softwaretechnik. Bericht der Fakultät Informatik, Universität Stuttgart, 2nd edn. (2001)Google Scholar
  31. 31.
    Martin, R., Raffo, D.M.: Application of a Hybrid Process Simulation Model to a Software Development Project. Journal of Systems and Software 59(3) (2001)Google Scholar
  32. 32.
    Mizuno, O., Shigematsu, E., Takagi, Y., Kikuno, T.: On Estimating Testing Effort Needed to Assure Field Quality in Software Development. In: Proc. of ISSRE 2002 (2002)Google Scholar
  33. 33.
    Müller, M.: Analyzing Software Quality Assurance Strategies through Simulation. Dissertation, Fraunhofer IESE (2007)Google Scholar
  34. 34.
    Piwowarski, P., Ohba, M., Caruso, J.: Coverage Measurement Experience During Function Test. In: Proc. of ICSE 1993 (1993)Google Scholar
  35. 35.
    Rubey, R.J., Browning, L.A., Roberts, A.R.: Cost Effectiveness of Software Quality Assurance. In: Proc. of NAECON (1989)Google Scholar
  36. 36.
    Van Megen, R., Meyerhoff, D.B.: Costs and Benefits of Early Defect Detection: Experiences from Developing Client Server and Host Applications. Software Quality Journal 4(4) (1995)Google Scholar
  37. 37.
    Wagner, S.: Cost-Optimisation of Analytical Software Quality Assurance. Dissertation, TU München (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Tilmann Hampp
    • 1
  1. 1.Institut für SoftwaretechnologieUniversität StuttgartStuttgartGermany

Personalised recommendations