Abstract
Following the general software process improvement initiatives, improvement models particular to the software test process have also been developed. Although these models have been based on nearly similar principles, yet they differ in a variety of aspects. To compare and critically analyze strengths and weaknesses of these test process models, we need a common analysis framework. Existing SPI evaluation frameworks focus only on some basic and key process characteristics and elements. A number of critical success factors for software process improvement have been identified in literature which impose higher level of requirements on SPI approaches. We present a consolidated evaluation framework derived from critical success factors/literature review and apply it to analyze well known test process improvement approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wang, Y., King, G.: Software engineering processes: principles and applications. CRC Press, Inc., Boca Raton (2000)
Komi-Sirviö, S.: Development and Evaluation of Software Process Improvement Methods. PhD thesis, Faculty of Science, University of Oulu, Oulu, Finland (2004), http://www.vtt.fi/inf/pdf/publications/2004/P535.pdf
Braungarten, R.: The SMPI model: A stepwise process model to facilitate software measurement process improvement along the measurement paradigms. PhD thesis, University of Magdeburg, Magdeburg, Germany (2007)
Burnstein, I.: Practical Software Testing: A Process-oriented Approach. Springer Inc., New York (2003)
Jacobs, J.C., Trienekens, J.J.M.: Towards a metrics based verification and validation maturity model. In: STEP 2002: Proceedings of the 10th International Workshop on Software Technology and Engineering Practice, p. 123. IEEE Computer Society Press, Washington (2002)
Ericson, T., Subotic, A., Ursing, S.: TIM a test improvement model. J. Softw. Test., Verif. Reliab. 7(4), 229–246 (1998)
Farooq, A., Hegewald, H., Dumke, R.R.: A critical analysis of the Testing Maturity Model. Metrics News, Journal of GI-Interest Group on Software Metrics 12(1), 35–40 (2007)
Swinkels, R.: A comparison of TMM and other test process improvement models. Technical report, Frits Philips Institute, Technische Universiteit Eindhoven, Netherlands (2000), http://is.tm.tue.nl/research/v2m2/wp1/12-4-1-FPdef.pdf
Kulkarni, S.: Test process maturity models - yesterday, today and tomorrow. In: Proceedings of the 6th Annual International Software Testing Conference in India (2006)
Saiedian, H., Chennupati, K.: Towards an evaluative framework for software process improvement models. J. Syst. Softw. 47(2–3), 139–148 (1999)
Halvorsen, C.P., Conradi, R.: A taxonomy to compare SPI frameworks. In: Ambriola, V. (ed.) EWSPT 2001. LNCS, vol. 2077, pp. 217–235. Springer, Heidelberg (2001)
Dyba, T.: An empirical investigation of the key factors for success in software process improvement. IEEE Trans. Softw. Eng. 31(5), 410–424 (2005)
Niazi, M., Wilson, D., Zowghi, D.: Critical success factors for software process improvement implementation: an empirical study. Software Process: Improvement and Practice 11(2), 193–211 (2006)
Wilson, D.N., Hall, T., Baddoo, N.: A framework for evaluation and prediction of software process improvement success. J. Syst. Softw. 59(2), 135–142 (2001)
Conradi, R., Fuggetta, A.: Improving software process improvement. IEEE Software 19(4), 92–99 (2002)
Humphrey, W.S.: Managing the software process. Addison-Wesley Longman Publishing Co., Inc, Boston (1989)
van Solingen, R.: Product Focused Software Process Improvement: SPI in the Embedded Software Domain. PhD thesis, Eindhoven University of Technology, Eindhoven, The Netherlands (2000), http://alexandria.tue.nl/extra2/200000702.pdf
Haug, M., Olsen, E.W., Bergman, L.: Software Process Improvement: Metrics, Measurement and Process Modelling. Software Best Practice 4. Springer, Berlin, Germany (2001)
O’Hara, F.: European experiences with software process improvement. In: ICSE 2000: Proceedings of the 22nd international conference on Software engineering, pp. 635–640. ACM Press, New York (2000)
Dumke, R.R., Braungarten, R., Blazey, M., Hegewald, H., Reitz, D., Richter, K.: Software process measurement and control - a measurement-based point of view of software processes. Technical report, Dept. of Computer Science, University of Magdeburg (2006)
Dumke, R.R., Hegewald, M.B.H., Reitz, D., Richter, K.: Causalities in software process measurement and improvement. In: MENSURA 2006: Proceedings of the International Conference on Software Process and Product Measurement, Cádiz, Spain, pp. 42–52. Servicio de Publicaciones de la Universidad de Cádiz (2006), http://paginaspersonales.deusto.es/cortazar/doctorado/articulos/2006/MENSURA2006Proceedings.pdf
Pfleeger, S.L., Rombach, H.D.: Measurement based process improvement. IEEE Softw. 11(4), 8–11 (1994)
Goldenson, D.R., Jarzombek, J., Rout, T.: Measurement and analysis in capability maturity model integration models and software process improvement. CrossTalk The Journal of Defense Software Engineering (2003), http://www.stsc.hill.af.mil/crosstalk/2003/07/goldenson.html
Sommerville, I.: Software Engineering, 8th edn. Pearson Education Limited, Harlow, England (2007)
Abran, A., Bourque, P., Dupuis, R., Moore, J.W. (eds.): Guide to the Software Engineering Body of Knowledge - SWEBOK. IEEE Press, Piscataway (2004)
de Almeida Falbo, R., Borges, L.S.M., Valente, F.F.R.: Using knowledge management to improve software process performance in a CMM level 3 organization. In: QSIC 2004: Proceedings of the Fourth International Conference on Quality Software, pp. 162–169. IEEE Computer Society Press, Washington (2004)
Kneuper, R.: Supporing software process using knowledge management. Handbook of Software Engineering and Knowledge Engineering (2001), http://cs.pitt.edu/chang/handbook/37b.pdf
Rainer, A., Hall, T.: Key success factors for implementing software process improvement: a maturity-based analysis. J. Syst. Softw. 62(2), 71–84 (2001)
Niazi, M., Wilson, D., Zowghi, D.: A model for the implementation of software process improvement: A pilot study. In: QSIC: Proceedings of the 3rd International Conference on Quality Software, pp. 196–203. IEEE Computer Society, Washington (2003)
Koomen, T.: Worldwide survey on Test Process Improvement. Technical report, Sogeti (2002)
Koomen, T.: Worldwide survey on Test Process Improvement. Technical report, Sogeti (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Farooq, A., Dumke, R.R. (2008). Developing and Applying a Consolidated Evaluation Framework to Analyze Test Process Improvement Approaches. In: Cuadrado-Gallego, J.J., Braungarten, R., Dumke, R.R., Abran, A. (eds) Software Process and Product Measurement. Mensura IWSM 2007 2007. Lecture Notes in Computer Science, vol 4895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85553-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-85553-8_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85552-1
Online ISBN: 978-3-540-85553-8
eBook Packages: Computer ScienceComputer Science (R0)