Abstract
Monitoring and controlling of software projects executed according to Lean or Agile software development requires, in principle, continuous measurement and use of indicators to monitor development areas and/or identify problem areas. Indicators are specific kind of measures with associated analysis models and decision criteria (ISO/IEC 15939). Indicating/highlighting problems in processes, is often used in Lean SW development and despite obvious benefits there are also dangers with improper use of indicators – using inadequate indicators can mislead the stakeholders towards sub-optimizations/erroneous decisions. In this paper we present a method for assessing completeness of information provided by measurement systems (i.e. both measures and indicators). The method is a variation of value stream mapping modeling with an application in a software development organization in the telecom domain. We also show the use of this method at one of the units of Ericsson where it was applied to provide stakeholders with an early warning system about upcoming problems with software quality.
Keywords
- Measurement System
- Software Development
- Information Quality
- Software Project
- Software Development Process
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Staron, M., Meding, W., Karlsson, G., Nilsson, C.: Developing measurement systems: an industrial case study. Journal of Software Maintenance and Evolution: Research and Practice (2010)
Staron, M., Meding, W., Nilsson, C.: A Framework for Developing Measurement Systems and Its Industrial Evaluation. Information and Software Technology 51, 721–737 (2008)
McGarry, J.: Practical software measurement: objective information for decision makers. Addison-Wesley, Boston (2002)
Meding, W., Staron, M.: The Role of Design and Implementation Models in Establishing Mature Measurement Programs. Presented at the Nordic Workshop on Model Driven Engineering, Tampere, Finland (2009)
van Solingen, R., Berghout, E.: The Goal/Question/Metric Method. A Practical Guide for Quality Improvement of Software Development. McGraw-Hill, London (1999)
Staron, M., Meding, W.: Defect Inflow Prediction in Large Software Projects. e-Informatica Software Engineering Journal 4, 1–23 (2010)
International Standard Organization and International Electrotechnical Commission, ISO/IEC 15939 Software engineering – Software measurement process, International Standard Organization/International Electrotechnical Commission, Geneva (2007)
Brockers, A., Differding, C., Threin, G.: The role of software process modeling in planning industrial measurement programs. In: The 3rd International Software Metrics Symposium, pp. 31–40 (1996)
Staron, M., Meding, W.: Using Models to Develop Measurement Systems: A Method and Its Industrial Use, Presented at the Software Process and Product Measurement, Amsterdam, NL (2009)
Dolcemascolo, D.: Improving the extended value stream: lean for the entire supply chain. Productivity Press, New York (2006)
Kitchenham, B., Hughes, R.T., Linkman, S.C.: Modeling Software Measurement Data. IEEE Transactions on Software Engineering 27, 788–804 (2001)
Lawler, J., Kitchenham, B.: Measurement modeling technology. IEEE Software 20, 68–75 (2003)
Monperrus, M., Jézéquel, J.-M., Champeau, J., Hoeltzener, B.: A Model-Driven Measurement Approach. In: Czarnecki, K., Ober, I., Bruel, J.-M., Uhl, A., Völter, M. (eds.) MoDELS 2008. LNCS, vol. 5301, pp. 505–519. Springer, Heidelberg (2008)
Lee, Y.W., Strong, D.M., Kahn, B.K., Wang, R.Y.: AIMQ: a methodology for information quality assessment. Information & Management 40, 133–146 (2002)
Staron, M., Meding, W.: Ensuring Reliability of Information Provided by Measurement Systems. In: Abran, A., Braungarten, R., Dumke, R.R., Cuadrado-Gallego, J.J., Brunekreef, J. (eds.) IWSM 2009. LNCS, vol. 5891, pp. 1–16. Springer, Heidelberg (2009)
Kahn, B.K., Strong, D.M., Wang, R.Y.: Information Quality Benchmarks: Product and Service Performance. Communications of the ACM 45, 184–192 (2002)
Mayer, D.M., Willshire, M.J.: A Data Quality Engineering Framework. In: International Conference on Information Quality, pp. 1–8 (1997)
Goodhue, D.L., Thompson, R.L.: Task-technology fit and individual performance. MIS Quarterly 19, 213–237 (1995)
Serrano, M., Calero, C., Trujillo, J., Luján-Mora, S., Piattini, M.: Empirical Validation of Metrics for Conceptual Models of Data Warehouses. In: Persson, A., Stirna, J. (eds.) CAiSE 2004. LNCS, vol. 3084, pp. 506–520. Springer, Heidelberg (2004)
Caballero, I., Verbo, E., Calero, C., Piattini, M.: A Data Quality Measurement Information Model Based on ISO/IEC 15939 (2007), http://mitiq.mit.edu/iciq/PDF/
Burkhard, R., Spescha, G., Meier, M.: “A-ha!”: How to Visualize Strategies with Complementary Visualizations. In: Conference on Visualising and Presenting Indicator Systems (2005)
International Bureau of Weights and Measures, International vocabulary of basic and general terms in metrology = Vocabulaire international des termes fondamentaux et généraux de métrologie, 2nd edn. International Organization for Standardization, Genève (1993)
International Standard Organization and International Electrotechnical Commission, Software engineering – Software measurement process, ISO/IEC, Geneva (2002)
International Standard Organization, Systems engineering – System life cycle processes 15288:2002 (2002)
International Standard Organization, Information technology – Software product evaluation 14598-1:1999 (1999)
International Standard Organization and International Electrotechnical Commission, ISO/IEC 9126 - Software engineering – Product quality Part: 1 Quality model, International Standard Organization/International Electrotechnical Commission, Geneva (2001)
Umarji, M., Emurian, H.: Acceptance Issues in Metrics Program Implementation, p. 20 (2005)
Gopal, A., Mukhopadhyay, T., Krishnan, M.S.: The impact of institutional forces on software metrics programs. IEEE Transactions on Software Engineering 31, 679–694 (2005)
Umarji, M., Emurian, H.: Acceptance issues in metrics program implementation, p. 10 (2005)
Kilpi, T.: Implementing a Software Metrics Program at Nokia. IEEE Software 18, 72–77 (2001)
Wand, Y., Wang, R.Y.: Anchoring data quality dimensions in ontological foundations. Commun. ACM 39, 86–95 (1996)
Fenton, N.E., Pfleeger, S.L.: Software metrics: a rigorous and practical approach, 2nd edn. International Thomson Computer Press, London (1996)
Tomaszewski, P., Berander, P., Damm, L.-O.: From Traditional to Streamline Development - Opportunities and Challenges. Software Process Improvement and Practice 2007, 1–20 (2007)
Baskerville, R.L., Wood-Harper, A.T.: A Critical Perspective on Action Research as a Method for Information Systems Research. Journal of Information Technology 1996, 235–246 (1996)
Susman, G.I., Evered, R.D.: An Assessment of the Scientific Merits of Action Research. Administrative Science Quarterly 1978, 582–603 (1978)
Fenton, N., Krause, P., Neil, M.: Software measurement: uncertainty and causal modeling. IEEE Software 19, 116–122 (2002)
Fenton, N.E., Neil, M.: Software metrics: successes, failures and new directions. Journal of Systems and Software 47, 149–157 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Staron, M., Meding, W., Caiman, M. (2013). Improving Completeness of Measurement Systems for Monitoring Software Development Workflows. In: Winkler, D., Biffl, S., Bergsmann, J. (eds) Software Quality. Increasing Value in Software and Systems Development. SWQD 2013. Lecture Notes in Business Information Processing, vol 133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35702-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-35702-2_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35701-5
Online ISBN: 978-3-642-35702-2
eBook Packages: Computer ScienceComputer Science (R0)