Bridge the Gap between Software Test Process and Business Value: A Case Study

  • Qi Li
  • Mingshu Li
  • Ye Yang
  • Qing Wang
  • Thomas Tan
  • Barry Boehm
  • Chenyong Hu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5543)


For a software project to succeed, acceptable quality must be achieved within an acceptable cost, providing business value to the customers, and keeping delivery time short. Software testing is a strenuous and expensive process and is often not organized to maximize business value. In this article, we propose a practical value based software testing method which aligns the internal test process with the value objectives coming from the customers and the market. Our case study in a real-life business project shows that this method helps manage testing process effectively and efficiently.


value business importance risk cost testing AHP 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Boehm, B., Basili, V.R.: Software Defect Reduction Top10 List. IEEE Computer 34(1), 135–137 (2001)CrossRefGoogle Scholar
  2. 2.
    Boehm, B.: Value-Based Software Engineering: Overview and Agenda. In: Value-Based Software Engineering. Springer, Heidelberg (2005)Google Scholar
  3. 3.
    Ramler, R., Biffl, S., Grunbacher, P.: Value-Based Management of Software Testing. In: Value-Based Software Engineering, pp. 226–244. Springer, Heidelberg (2005)Google Scholar
  4. 4.
    Beizer, B.: Software Testing Techniques, 2nd edn. International Thomson Computer Press, New York (1990)zbMATHGoogle Scholar
  5. 5.
    Boehm, B.: Value-Based Software Engineering. ACM Software Engineering Notes, 28(2) (2003)Google Scholar
  6. 6.
    Bullock, J.: Calculating the Value of Testing. Software Testing and Quality Engineering 2(3), 56–62 (2000)MathSciNetGoogle Scholar
  7. 7.
    Pyster, A.B., Thayer, R.H.: Software Engineering Project Management 20 Years Later. IEEE Software 22(5), 18–21 (2005)CrossRefGoogle Scholar
  8. 8.
    Boehm, B., Jain, A.: An Initial Theory of Value-Based Software Engineering. In: Value-Based Software Engineering, pp. 16–37. Springer, Heidelberg (2005)Google Scholar
  9. 9.
    Boehm, B., et al.: Using the WinWin spiral model: a case study. IEEE Computer 31(7), 33–44 (1998)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Boehm, B.: A Spiral Model of Software Development and Enhancement. IEEE Computer 21(5), 61–72 (1988)CrossRefGoogle Scholar
  11. 11.
    Boehm, B., Huang, L.G.: Value-Based Software Engineering: A Case Study. IEEE Computer 36(3), 33–41 (2003)CrossRefGoogle Scholar
  12. 12.
    Amland, S.: Risk Based Testing and Metrics. In: 5th International Conference EuroSTAR 1999, Barcelona, Spain (1999)Google Scholar
  13. 13.
    Raz, O., Shaw, M.: Software Risk Management and Insurance. In: Proceedings of the 23rd International Conference on Software Engineering (Workshop on Economics-Driven Software Engineering Research) (2001)Google Scholar
  14. 14.
    Lee, K., Boehm, B.: Empirical Results from an Experiment on Value-Based Review (VBR) Processes. In: International Symposium on Empirical Software Engineering (2005)Google Scholar
  15. 15.
    Boehm, B., et al.: The ROI of Software Dependability: The iDAVE Model. IEEE Software 21(3), 54–61 (2004)CrossRefGoogle Scholar
  16. 16.
    Wiegers, E.K.: First Things First: Prioritizing Requirements. Software Development 7(10), 24–30 (1999)Google Scholar
  17. 17.
    Saaty, T.L.: The Analytic Hierarchy Process. McGraw-Hill, New York (1980)zbMATHGoogle Scholar
  18. 18.
    Boehm, B., et al.: Software Cost Estimation with COCOMOII, Har/Cdr th edn. Prentice-Hall, Englewood Cliffs (2000)Google Scholar
  19. 19.
    Chulani, S., Boehm, B.: Modeling Software Defect Introduction and Removal: COQUALMO (COnstructive QUALity MOdel),Technical Report, University of Southern California (2002)Google Scholar
  20. 20.
    Huang, L., Boehm, B.: How Much Software Quality Investment Is Enough: A Value-Based Approach. IEEE Software 23(5), 88–95 (2006)CrossRefGoogle Scholar
  21. 21.
    Srikanth, H., Williams, L.: On the Economics of Requirements-Based Test Case Prioritization. In: EDSER 2005, St. Louis, Missouri, USA (2005)Google Scholar
  22. 22.
    Wang, Q., et al.: BSR: A Statistic-based Approach for Establishing and Refining Software Process Performance Baseline. In: Proceedings of the 28th International Conference on Software Engineering, Shanghai, China (2006)Google Scholar
  23. 23.
    Wang, Q., et al.: An Empirical Study on Establishing Quantitative Management Model for Testing Process. In: Wang, Q., Pfahl, D., Raffo, D.M. (eds.) ICSP 2007. LNCS, vol. 4470, pp. 233–245. Springer, Heidelberg (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Qi Li
    • 1
  • Mingshu Li
    • 2
  • Ye Yang
    • 2
  • Qing Wang
    • 2
  • Thomas Tan
    • 1
  • Barry Boehm
    • 1
  • Chenyong Hu
    • 2
  1. 1.University of Southern CaliforniaUSA
  2. 2.Institute of SoftwareChinese Academy of SciencesChina

Personalised recommendations