Skip to main content

Statistically Based Process Monitoring: Lessons from the Trench

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5543))

Abstract

Monitoring software processes is a non trivial task. Recently many authors have suggested the use of Statistical Process Control (SPC) for monitoring software processes, while others have pointed out its potential pitfalls. Indeed, the main problem is that SPC is often used “as is” without the appropriate customizations or extensions needed for making it applicable to software contexts. This work points out and discusses four main issues related to software process monitoring and highlights how SPC can be used as solution to address each problem. The solutions arise from experience collected by the authors during empirical investigations in industrial contexts. As so, this work is intended as a first step in clarifying how SPC can contribute to practically solve some monitoring issues and guide practitioners towards a more disciplined and correct use of the approach in controlling software processes.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Florac, W.A., Carleton, A.D.: Measuring the Software Process: Statistical Process Control for Software Process Improvement. Addison-Wesley, Reading (1999)

    Google Scholar 

  2. Shewhart, W.A.: Statistical Method from the Viewpoint of Quality Control. Dover Publications, Mineola (1939) (republished 1986)

    MATH  Google Scholar 

  3. IEEE Software: Process Diversity. IEEE Software 17, 4 (July-August 2000), entire issue

    Google Scholar 

  4. IEEE Software: The Global View. IEEE Software (March-April 2001), entire issue

    Google Scholar 

  5. Grant, E.L., Leavenworth, R.S.: Statistical quality control. McGraw-Hill, New York (1980)

    MATH  Google Scholar 

  6. Wheeler, D.J., Chambers, D.S.: Understanding Statistical Process Control. SPC Press (1992)

    Google Scholar 

  7. Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: Managing SPI through SPC. In: Bomarius, F., Iida, H. (eds.) PROFES 2004. LNCS, vol. 3009, pp. 30–46. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  8. Baldassarre, M.T., Caivano, D., Visaggio, G.: Software Renewal Projects Estimation Using Dynamic Calibration. In: 19th ICSM, pp. 105–115. IEEE Press, Amsterdam (2003)

    Google Scholar 

  9. Caivano, D.: Continuous Software Process Improvement through Statistical Process Control. In: 9th European CSMR, pp. 288–293. IEEE Press, Manchester (2005)

    Google Scholar 

  10. Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: Improving Dynamic Calibration through Statistical Process Control. In: 21st ICSM, pp. 273–282. IEEE Press, Budapest (2005)

    Google Scholar 

  11. Caivano, D., Lanubile, F., Visaggio, G.: Software Renewal Process Comprehension using Dynamic Effort Estimation. In: 17th ICSM, pp. 209–218. IEEE Press, Florence (2001)

    Google Scholar 

  12. Boffoli, N.: Non-Intrusive Monitoring of Software Quality. In: 10th European conference on Software Maintenance and Reengineering, pp. 319–322. IEEE Press, Bari (2006)

    Google Scholar 

  13. Baldassarre, M.T., Boffoli, N., Caivano, D., Visaggio, G.: SPEED: Software Project Effort Evaluator based on Dynamic-calibration. In: 22nd ICSM, pp. 272–273. IEEE Press, Philadelphia (2006)

    Google Scholar 

  14. Baldassarre, M.T., Caivano, D., Kitchenham, B., Visaggio, G.: Systematic Review of Statistical Process Control: an Experience Report. In: 11th EASE, pp. 119–129. BCS, Keele (2007)

    Google Scholar 

  15. Card, D.: Statistical Process Control for Software. IEEE Software, 95–97 (1994)

    Google Scholar 

  16. Sargut, K.U., Demirors, O.: Utilization of statistical process control in emergent software organizations: pitfalls and suggestions. Software Quality Journal 14, 135–157 (2006)

    Article  Google Scholar 

  17. Eickelmann, N., Anant, A.: Statistical Process Control: What You Don’t Measure Can Hurt You! IEEE Software, 49–51 (March/April 2003)

    Google Scholar 

  18. Weller, E., Card, D.: Applying SPC to Software Development: Where and Why. IEEE Software, 48–51 (May/June 2008)

    Google Scholar 

  19. Raczynski, B., Curtis, B.: Software Data Violate SPC’s Underlying Assumptions. IEEE Software, 49–51 (May/June 2008)

    Google Scholar 

  20. Shewhart, W.A.: The Economic Control of Quality of Manufactured Product. D. Van Nostrand Company, New York (1931) (reprinted by ASQC Quality Press) (1980)

    Google Scholar 

  21. Paulk, M.C.: Applying SPC to the Personal Software Process. In: Proc. 10th ICSQ (2000)

    Google Scholar 

  22. Florac, W.A., Carleton, A.D., Bernard, J.R.: Statistical Process Control: Analyzing a Space Shuttle Onboard Software Process. IEEE Software, 97–106 (July/August 2000)

    Google Scholar 

  23. Jalote, P.: CMM in Practice: Processes for Executing Software Projects at Infosys. Addison-Wesley, Reading (1999)

    Google Scholar 

  24. Weller, E.: Applying Quantitative Methods to Software Maintenance. ASQ Software Quality Professional 3(1) (2000)

    Google Scholar 

  25. Jacob, A.L., Pillai, S.K.: Statistical Process Control to Improve Coding and Code Review. IEEE Software, 50–55 (May 2003)

    Google Scholar 

  26. Jalote, P.: Optimum Control Limits for Employing Statistical Process Control in Software Process. IEEE TSE 28(12), 1126–1134 (2002)

    Google Scholar 

  27. Nelson, L.: The Shewhart control chart - tests for special causes. Journal of Quality Technology 15, 237–239 (1984)

    Google Scholar 

  28. Nelson, L.: Interpreting Shewart X-bar Control Charts. J.of Quality Technology 17, 114–116 (1985)

    Google Scholar 

  29. Weller, E.F.: Practical Applications of SPC. IEEE Software, 48–55 (May/June 2000)

    Google Scholar 

  30. Gardiner, J.S., Montgomery, D.C.: Using Statistical Control Chart for Software Quality Control. In: Quality and Reliability Eng. Int’l., vol. 3, pp. 40–43. Wiley, Chichester (1987)

    Google Scholar 

  31. Park, Y., Choi, H., Baik, J.: A Framework for the Use of Six Sigma Tools in PSP/TSP. In: 5th International Conference SERA, Busan, Korea, pp. 807–814. Springer, Heidelberg (2007)

    Google Scholar 

  32. IEEE Software. Estimation 17(6) (November–December 2000)

    Google Scholar 

  33. Bohem, B.W.: Software Cost Estimation with COCOMO II. Prentice-Hall, Englewood Cliffs (2000)

    Google Scholar 

  34. Florac, W.A., Park, R.E., Carleton, A.D.: Practical Software Measurement: Measuring for Process Management and Improvement. Carnagie Mellon University (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Baldassarre, M.T., Boffoli, N., Bruno, G., Caivano, D. (2009). Statistically Based Process Monitoring: Lessons from the Trench. In: Wang, Q., Garousi, V., Madachy, R., Pfahl, D. (eds) Trustworthy Software Development Processes. ICSP 2009. Lecture Notes in Computer Science, vol 5543. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01680-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01680-6_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01679-0

  • Online ISBN: 978-3-642-01680-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics