Software Process Measurement in the Real World: Dealing with Operating Constraints
Process measurement occurs in an increasingly dynamic context, characterized by limited resources and by the need to deliver results at the pace of changing technologies, processes and products. Traditional measurement techniques (like the GQM) have been extensively and successfully employed in situations with little or no operating constraints. This paper reports about a measurement project in which –in order to limit the cost and duration of the activities– the team could not perform ad hoc measurements, but had to rely almost exclusively on the data that could be extracted automatically from development and measurement tools already in use. Exploiting the flexibility of the GQM technique, and with the support of a tool supporting the GQM, it was possible to define and execute the measurement plan, to analyze the collected data, and to formulate results in only three months, and spending a very small amount of resources.
KeywordsProcess metrics Product metrics Goal/Question/Metrics Process quality assessment
Unable to display preview. Download preview PDF.
- 1.Auer, M., Graser, B., Biffl, S.: A Survey on the Fitness of Commercial Software Metric Tools for Service in Heterogeneous Environments: Common Pitfalls. In: 9th International Software Metrics Symposium (METRICS 2003), Sydney, Australia (September 2003)Google Scholar
- 2.Aversano, L., Bodhuin, T., Canfora, G., Tortorella, M.: A Framework for Measuring Business Processes based on GQM. In: 37th Hawaii Int. Conference on System Sciences (2004)Google Scholar
- 3.Basili, V.: GQM approach has evolved to include models. IEEE Software 11(1) (1994)Google Scholar
- 4.Basili, V., Rombach, H.D.: The TAME project: towards improvement-oriented software environments. IEEE Transactions on Software Engineering (June 1988)Google Scholar
- 5.Fuggetta, A., Lavazza, L., Morasca, S., Cinti, S., Oldano, G., Orazi, E.: Applying G/Q/M in an Industrial Software Factory. ACM ToSEM 7(4) (October 1998)Google Scholar
- 6.Gresse, C., Rombach, D., Ruhe, G.: Tutorial: A practical approach for building GQM-based measurement programs - Lessons learned from three industrial case studies. In: Proceedings of 10th Brasilian Symposium on Software Engineering, Sao Carlos (Brasil) (1996)Google Scholar
- 7.Hall, T., Fenton, N.: Implementing software metrics — the critical success factors. Software Quality Journal 3(4) (December 1994)Google Scholar
- 9.Lavazza, L.: Providing automated support for the GQM measurement process. IEEE Software 17(3) (May-June 2000)Google Scholar
- 10.Lavazza, L., Barresi, G.: Automated Support for Process-aware Definition and Execution of Measurement Plans. In: ICSE 2005, St. Louis (May 2005)Google Scholar
- 11.Lavazza, L., Mauri, M.: Measurement tool support in the real world: a GQM experience, CEFRIEL Technical Report RT06001 (March 2006)Google Scholar
- 12.Mendonça, M.G., Basili, V.R.: Validation of an Approach for Improving Existing Measurement Frameworks. IEEE TSE 26(6) (June 2000)Google Scholar
- 13.van Solingen, R., van Latum, F., Oivo, M., Berghout, E.: Application of software measurement at Schlumberger RPS. In: Proceedings of Sixth European Software Cost Modeling Conference, Paris (1995)Google Scholar