Statistically Based Process Monitoring: Lessons from the Trench

  • Maria Teresa Baldassarre
  • Nicola Boffoli
  • Giovanni Bruno
  • Danilo Caivano
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5543)


Monitoring software processes is a non trivial task. Recently many authors have suggested the use of Statistical Process Control (SPC) for monitoring software processes, while others have pointed out its potential pitfalls. Indeed, the main problem is that SPC is often used “as is” without the appropriate customizations or extensions needed for making it applicable to software contexts. This work points out and discusses four main issues related to software process monitoring and highlights how SPC can be used as solution to address each problem. The solutions arise from experience collected by the authors during empirical investigations in industrial contexts. As so, this work is intended as a first step in clarifying how SPC can contribute to practically solve some monitoring issues and guide practitioners towards a more disciplined and correct use of the approach in controlling software processes.


Statistical Process Control Software Process Monitoring 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Florac, W.A., Carleton, A.D.: Measuring the Software Process: Statistical Process Control for Software Process Improvement. Addison-Wesley, Reading (1999)Google Scholar
  2. 2.
    Shewhart, W.A.: Statistical Method from the Viewpoint of Quality Control. Dover Publications, Mineola (1939) (republished 1986)zbMATHGoogle Scholar
  3. 3.
    IEEE Software: Process Diversity. IEEE Software 17, 4 (July-August 2000), entire issue Google Scholar
  4. 4.
    IEEE Software: The Global View. IEEE Software (March-April 2001), entire issue Google Scholar
  5. 5.
    Grant, E.L., Leavenworth, R.S.: Statistical quality control. McGraw-Hill, New York (1980)zbMATHGoogle Scholar
  6. 6.
    Wheeler, D.J., Chambers, D.S.: Understanding Statistical Process Control. SPC Press (1992)Google Scholar
  7. 7.
    Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: Managing SPI through SPC. In: Bomarius, F., Iida, H. (eds.) PROFES 2004. LNCS, vol. 3009, pp. 30–46. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Baldassarre, M.T., Caivano, D., Visaggio, G.: Software Renewal Projects Estimation Using Dynamic Calibration. In: 19th ICSM, pp. 105–115. IEEE Press, Amsterdam (2003)Google Scholar
  9. 9.
    Caivano, D.: Continuous Software Process Improvement through Statistical Process Control. In: 9th European CSMR, pp. 288–293. IEEE Press, Manchester (2005)Google Scholar
  10. 10.
    Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: Improving Dynamic Calibration through Statistical Process Control. In: 21st ICSM, pp. 273–282. IEEE Press, Budapest (2005)Google Scholar
  11. 11.
    Caivano, D., Lanubile, F., Visaggio, G.: Software Renewal Process Comprehension using Dynamic Effort Estimation. In: 17th ICSM, pp. 209–218. IEEE Press, Florence (2001)Google Scholar
  12. 12.
    Boffoli, N.: Non-Intrusive Monitoring of Software Quality. In: 10th European conference on Software Maintenance and Reengineering, pp. 319–322. IEEE Press, Bari (2006)Google Scholar
  13. 13.
    Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: SPEED: Software Project Effort Evaluator based on Dynamic-calibration. In: 22nd ICSM, pp. 272–273. IEEE Press, Philadelphia (2006)Google Scholar
  14. 14.
    Baldassarre, M.T., Caivano, D., Kitchenham, B., Visaggio, G.: Systematic Review of Statistical Process Control: an Experience Report. In: 11th EASE, pp. 119–129. BCS, Keele (2007)Google Scholar
  15. 15.
    Card, D.: Statistical Process Control for Software. IEEE Software, 95–97 (1994)Google Scholar
  16. 16.
    Sargut, K.U., Demirors, O.: Utilization of statistical process control in emergent software organizations: pitfalls and suggestions. Software Quality Journal 14, 135–157 (2006)CrossRefGoogle Scholar
  17. 17.
    Eickelmann, N., Anant, A.: Statistical Process Control: What You Don’t Measure Can Hurt You! IEEE Software, 49–51 (March/April 2003)Google Scholar
  18. 18.
    Weller, E., Card, D.: Applying SPC to Software Development: Where and Why. IEEE Software, 48–51 (May/June 2008)Google Scholar
  19. 19.
    Raczynski, B., Curtis, B.: Software Data Violate SPC’s Underlying Assumptions. IEEE Software, 49–51 (May/June 2008)Google Scholar
  20. 20.
    Shewhart, W.A.: The Economic Control of Quality of Manufactured Product. D. Van Nostrand Company, New York (1931) (reprinted by ASQC Quality Press) (1980)Google Scholar
  21. 21.
    Paulk, M.C.: Applying SPC to the Personal Software Process. In: Proc. 10th ICSQ (2000)Google Scholar
  22. 22.
    Florac, W.A., Carleton, A.D., Bernard, J.R.: Statistical Process Control: Analyzing a Space Shuttle Onboard Software Process. IEEE Software, 97–106 (July/August 2000)Google Scholar
  23. 23.
    Jalote, P.: CMM in Practice: Processes for Executing Software Projects at Infosys. Addison-Wesley, Reading (1999)Google Scholar
  24. 24.
    Weller, E.: Applying Quantitative Methods to Software Maintenance. ASQ Software Quality Professional 3(1) (2000)Google Scholar
  25. 25.
    Jacob, A.L., Pillai, S.K.: Statistical Process Control to Improve Coding and Code Review. IEEE Software, 50–55 (May 2003)Google Scholar
  26. 26.
    Jalote, P.: Optimum Control Limits for Employing Statistical Process Control in Software Process. IEEE TSE 28(12), 1126–1134 (2002)Google Scholar
  27. 27.
    Nelson, L.: The Shewhart control chart - tests for special causes. Journal of Quality Technology 15, 237–239 (1984)Google Scholar
  28. 28.
    Nelson, L.: Interpreting Shewart X-bar Control Charts. J.of Quality Technology 17, 114–116 (1985)Google Scholar
  29. 29.
    Weller, E.F.: Practical Applications of SPC. IEEE Software, 48–55 (May/June 2000)Google Scholar
  30. 30.
    Gardiner, J.S., Montgomery, D.C.: Using Statistical Control Chart for Software Quality Control. In: Quality and Reliability Eng. Int’l., vol. 3, pp. 40–43. Wiley, Chichester (1987)Google Scholar
  31. 31.
    Park, Y., Choi, H., Baik, J.: A Framework for the Use of Six Sigma Tools in PSP/TSP. In: 5th International Conference SERA, Busan, Korea, pp. 807–814. Springer, Heidelberg (2007)Google Scholar
  32. 32.
    IEEE Software. Estimation 17(6) (November–December 2000)Google Scholar
  33. 33.
    Bohem, B.W.: Software Cost Estimation with COCOMO II. Prentice-Hall, Englewood Cliffs (2000)Google Scholar
  34. 34.
    Florac, W.A., Park, R.E., Carleton, A.D.: Practical Software Measurement: Measuring for Process Management and Improvement. Carnagie Mellon University (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Maria Teresa Baldassarre
    • 1
  • Nicola Boffoli
    • 1
  • Giovanni Bruno
    • 1
  • Danilo Caivano
    • 1
  1. 1.Department of InformaticsUniversity of Bari – SER&Practices SPIN OFFBariItaly

Personalised recommendations