Skip to main content
SpringerLink
Log in

Quality Models

  • Chapter
  • First Online:
Software Product Quality Control

Abstract

In this chapter, after discussing existing quality models and putting them into context, I introduce basics of software measures and details of the ISO/IEC 25010 quality model. The main part of this chapter constitutes the quality modelling approach developed in the research project Quamoco, how to maintain such quality models and three detailed examples of quality models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.uml.org.

  2. 2.

    http://www.quamoco.de/.

  3. 3.

    http://www.gimpel.com.

  4. 4.

    http://pmd.sourceforge.net.

  5. 5.

    http://www.conqat.org/.

  6. 6.

    http://tomcat.apache.org/.

  7. 7.

    http://www.quamoco.de.

  8. 8.

    Clone coverage is the probability that a randomly chosen line of code is duplicated.

  9. 9.

    Eclipse Modeling Framework, http://emf.eclipse.org/.

  10. 10.

    http://www.conqat.org/.

  11. 11.

    http://www.quamoco.de.

  12. 12.

    http://www.cert.org/stats/vulnerability_remediation.html.

  13. 13.

    http://www.csoonline.com/documents/pdfs/e-crime_release_091107.pdf.

  14. 14.

    http://www.webguidelines.nl/.

References

  1. Al-Kilidar, H., Cox, K., Kitchenham, B.: The use and usefulness of the ISO/IEC 9126 quality standard. In: Proceedings of the International Symposium on Empirical Software Engineering (ISESE’05). IEEE Computer Society, Silver Spring (2005)

    Google Scholar 

  2. Bakota, T., Hegedūs, P., Körtvélyesi, P., Ferenc, R., Gyimóthy, T.: A probabilistic software quality model. In: Proceedings of the 27th IEEE International Conference on Software Maintenance (ICSM’11). IEEE Computer Society, Silver Spring (2011)

    Google Scholar 

  3. Bansiya, J., Davis, C.G.: A hierarchical model for object-oriented design quality assessment. IEEE Trans. Softw. Eng. 28(1), 4–17 (2002)

    Article  Google Scholar 

  4. Basili, V., Donzelli, P., Asgari, S.: A unified model of dependability: Capturing dependability in context. IEEE Softw. 21(6), 19–25 (2004)

    Article  Google Scholar 

  5. Basili, V., Rombach, H.: The TAME project: Towards improvement-oriented software environments. IEEE Trans. Softw. Eng. 14(6), 758–773 (1998)

    Article  Google Scholar 

  6. Basili, V.R., Caldiera, G., Rombach, H.D.: Goal question metric paradigm. In: Marciniak, J.C. (ed.) Encyclopedia of Software Engineering, vol. 1. Wiley, New York (1994)

    Google Scholar 

  7. Beliakov, G., Calvo, T., Mesiar, R.: Guest editorial. Foreword to the special issue on aggregation operators. IEEE Trans. Fuzzy Syst. 15(6), 1030–1031 (2007)

    Article  Google Scholar 

  8. Beliakov, G., Pradera, A., Calvo, T.: Aggregation Functions: A Guide for Practicioners. Studies in Fuzziness and Soft Computing. Springer, Berlin (2007)

    Google Scholar 

  9. Blin, M.J., Tsoukiàs, A.: Multi-criteria methodology contribution to the software quality evaluation. Softw. Qual. J. 9, 113–132 (2001)

    Article  Google Scholar 

  10. Boegh, J., Depanfilis, S., Kitchenham, B., Pasquini, A.: A method for software quality planning, control, and evaluation. IEEE Softw. 16(2), 69–77 (1999)

    Article  Google Scholar 

  11. Boehm, B.W.: Software Engineering Economics. Prentice Hall, Englewood Cliffs (1981)

    MATH  Google Scholar 

  12. Boehm, B.W., Brown, J.R., Kaspar, H., Lipow, M., Macleod, G.J., Merrit, M.J.: Characteristics of Software Quality. North-Holland, Amsterdam (1978)

    Google Scholar 

  13. Boehm, B.W., Brown, J.R., Kaspar, H., Lipow, M., MacLeod, G.J., Merrit, M.J.: Characteristics of Software Quality. TRW Series of Software Technology, vol. 1. North-Holland, Amsterdam (1978)

    Google Scholar 

  14. Broy, M., Deissenboeck, F., Pizka, M.: Demystifying maintainability. In: Proceedings of the 4th Workshop on Software Quality (4-WoSQ), pp. 21–26. ACM Press, New York (2006)

    Google Scholar 

  15. Calvo, T., Mayor, G., Mesiar, R. (eds.): Aggregation Operators. New Trends and Applications. Studies in Fuzziness and Soft Computing. Physica, Wurzburg (2002)

    MATH  Google Scholar 

  16. Chidamber, S.R., Kemerer, C.F.: A metrics suite for object oriented design. IEEE Trans. Softw. Eng. 20(6), 476–493 (1994)

    Article  Google Scholar 

  17. Chulani-Devnani, S.: Bayesian analysis of software cost and quality models. Ph.D. thesis, University of Southern California (1997)

    Google Scholar 

  18. Coleman, D., Lowther, B., Oman, P.: The application of software maintainability models in industrial software systems. J. Syst. Softw. 29(1), 3–16 (1995)

    Article  Google Scholar 

  19. Common criteria for information technology security evaluation, version 3.1. Available Online at http://www.commoncriteriaportal.org/

  20. Deissenboeck, F.: Continuous quality control of long-lived software systems. Ph.D. thesis, Technische Universität München (2009)

    Google Scholar 

  21. Deissenboeck, F., Juergens, E., Hummel, B., Wagner, S., y Parareda, B.M., Pizka, M.: Tool support for continuous quality control. IEEE Softw. 25(5), 60–67 (2008)

    Google Scholar 

  22. Deissenboeck, F., Juergens, E., Lochmann, K., Wagner, S.: Software quality models: Purposes, usage scenarios and requirements. In: Proceedings of the 7th International Workshop on Software Quality (WoSQ ’09). IEEE Computer Society, Silver Spring (2009)

    Google Scholar 

  23. Deissenboeck, F., Wagner, S., Pizka, M., Teuchert, S., Girard, J.F.: An activity-based quality model for maintainability. In: Proceedings of the 23rd International Conference on Software Maintenance (ICSM ’07). IEEE Computer Society, Silver Spring (2007)

    Google Scholar 

  24. Detyniecki, M.: Fundamentals on aggregation operators. In: Proceedings of the AOGP 2001 (2001) http://www-poleia.lip6.fr/~marcin/papers/Detynieck_AGOP_01.pdf

  25. Dromey, R.G.: A model for software product quality. IEEE Trans. Softw. Eng. 21(2) (1995)

    Google Scholar 

  26. Endres, A., Rombach, D.: A Handbook of Software and Systems Engineering: Empirical Observations, Laws and Theories. The Fraunhofer IESE Series on Software Engineering. Pearson Education Limited, Harlow (2003)

    Google Scholar 

  27. Fenton, N.: Software measurement: A necessary scientific basis. IEEE Trans. Softw. Eng. 20(3), 199–206 (1994)

    Article  Google Scholar 

  28. Fenton, N.E., Neil, M.: A critique of software defect prediction models. IEEE Trans. Softw. Eng. 25(5), 675–689 (1999). doi:http://dx.doi.org/10.1109/32.815326

    Google Scholar 

  29. Florac, W.A., Carleton, A.D.: Measuring the Software Process: Statistical Process Control for Software Process Improvement. Addison-Wesley, Reading (1999)

    Google Scholar 

  30. Franch, X., Carvallo, J.P.: Using quality models in software package selection. IEEE Softw. 20(1), 34–41 (2003)

    Article  Google Scholar 

  31. Frye, C.: CMM founder: Focus on the product to improve quality. http://searchsoftwarequality.techtarget.com/news/interview/0,289202,sid92_gci1316385,00.html (2008)

  32. Georgiadou, E.: GEQUAMO—a generic, multilayered, cusomisable, software quality model. Softw. Qual. J. 11, 313–323 (2003)

    Article  Google Scholar 

  33. Grady, R.B., Caswell, D.L.: Software Metrics: Establishing a Company-Wide Program. Prentice Hall, Englewood Cliffs (1987)

    Google Scholar 

  34. Hayes, J.H., Zhao, L.: Maintainability prediction: A regression analysis of measures of evolving systems. In: Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM’05), pp. 601–604. IEEE Computer Society, Silver Spring (2005)

    Google Scholar 

  35. Heitlager, I., Kuipers, T., Visser, J.: A practical model for measuring maintainability. In: Proceedings of the 6th International Conference on Quality of Information and Communications Technology (2007)

    Google Scholar 

  36. Homeland Security: Common attack pattern enumeration and classification (CAPEC). Available Online at http://capec.mitre.org/. Accessed Oct 2008

  37. Homeland Security: Common weakness enumeration (CWE). Available Online at http://cwe.mitre.org/. Accessed in Oct 2008

  38. Hudepohl, J.P., Aud, S.J., Koshgoftaar, T.M., Allen, E.B., Mayrand, J.: Emerald: Software metrics and models on the desktop. IEEE Softw. 13(5), 56–60 (1996)

    Article  Google Scholar 

  39. IEEE: Standard 830-1998: Recommended practice for software requirements specifications (1998)

    Google Scholar 

  40. ISO/IEC 14598: Information technology – software product evaluation (1999)

    Google Scholar 

  41. ISO/IEC 25010:2011: Systems and software engineering – systems and software quality requirements and evaluation (SQuaRE) – system and software quality models (2011)

    Google Scholar 

  42. ISO/IEC 25012:2008: Systems and software engineering – systems and software quality requirements and evaluation (SQuaRE) – data quality model (2008)

    Google Scholar 

  43. ISO/IEC 25040:2011: Systems and software engineering – systems and software quality requirements and evaluation (SQuaRE) – evaluation process (2011)

    Google Scholar 

  44. ISO/IEC 26262:2011: Road vehicles – functional safety (2011)

    Google Scholar 

  45. ISO/IEC 27001: Information technology – security techniques – information security management systems – requirements (2005)

    Google Scholar 

  46. ISO/IEC TR 9126-1:2001: Software engineering – product quality – Part 1: Quality model (2001)

    Google Scholar 

  47. Jones, C.: Applied Software Measurement: Assuring Productivity and Quality. McGraw-Hill, New York (1991)

    MATH  Google Scholar 

  48. Jones, W.D., Vouk, M.A.: Field Data Analysis. In: Lyu, M.R. (ed.) Handbook of Software Reliability Engineering, Chap. 11. IEEE Computer Society Press/McGraw-Hill, Silver Spring/New York (1996)

    Google Scholar 

  49. Khaddaj, S., Horgan, G.: A proposed adaptable quality model for software quality assurance. J. Comput. Sci. 1(4), 482–487 (2005)

    Article  Google Scholar 

  50. Kitchenham, B.: Towards a constructive quality model. Part I: Software quality modelling, measurement and prediction. Softw. Eng. J. 2(4), 105–113 (1987)

    Google Scholar 

  51. Kitchenham, B., Linkman, S., Pasquini, A., Nanni, V.: The SQUID approach to defining a quality model. Softw. Qual. J. 6(3), 211–233 (1997)

    Article  Google Scholar 

  52. Kitchenham, B., Pfleeger, S.L.: Software quality: The elusive target. IEEE Softw. 13(1), 12–21 (1996)

    Article  Google Scholar 

  53. Kitchenham, B., Pfleeger, S.L., Fenton, N.: Towards a framework for software measurement validation. IEEE Trans. Softw. Eng. 21(12), 929–944 (1995). doi:http://dx.doi.org/10.1109/32.489070

    Google Scholar 

  54. Kitchenham, B., Pickard, L.M.: Towards a constructive quality model. Part 2: Statistical techniques for modelling software quality in the ESPRIT REQUEST project. Softw. Eng. J. 2(4), 114–126 (1987)

    Google Scholar 

  55. Kläs, M., Heidrich, J., Münch, J., Trendowicz, A.: CQML scheme: A classification scheme for comprehensive quality model landscapes. In: Proceedings of the 35th Euromicro Conference on Software Engineering and Advanced Applications (2009)

    Google Scholar 

  56. Lindvall, M., Donzelli, P., Asgari, S., Basili, V.: Towards reusable measurement patterns. In: Proceedings of the 11th IEEE International Software Metrics Symposium (METRICS’05). IEEE Computer Society, Silver Spring (2005)

    Google Scholar 

  57. Littlewood, B., Verall, J.: A Bayesian Reliability Growth Model for Computer Software. Appl. Stat. 22(3), 332–346 (1973)

    Article  Google Scholar 

  58. Luckey, M., Baumann, A., Méndez Fernández, D., Wagner, S.: Reusing security requirements using an extend quality model. In: Proceedings of the 2010 ICSE Workshop on Software Engineering for Secure Systems (2010)

    Google Scholar 

  59. Lyu, M.R. (ed.): Handbook of Software Reliability Engineering. IEEE Computer Society Press/McGraw-Hill, Silver Spring/New York (1996)

    Google Scholar 

  60. MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms. Cambridge Press, Cambridge (2003)

    MATH  Google Scholar 

  61. Marinescu, C., Marinescu, R., Mihancea, R.F., Ratiu, D., Wettel, R.: iPlasma: An integrated platform for quality assessment of object-oriented design. In: Proceedings of the 21st IEEE International Conference on Software Maintenance. IEEE Computer Society, Silver Spring (2005)

    Google Scholar 

  62. Marinescu, R., Ratiu, D.: Quantifying the quality of object-oriented design: The factor-strategy model. In: Proceedings of the 11th Working Conference on Reverse Engineering (WCRE’04), pp. 192–201. IEEE Computer Society, Silver Spring (2004)

    Google Scholar 

  63. McCabe, T.: A complexity measure. IEEE Trans. Softw. Eng. SE-2(4), 308–320 (1976)

    Article  MathSciNet  Google Scholar 

  64. McCall, J., Walters, G.: Factors in Software Quality. The National Technical Information Service, Springfield (1977)

    Google Scholar 

  65. McCall, J.A., Richards, P.K., Walters, G.F.: Factors in Software Quality. National Technical Information Service, Springfield (1977)

    Google Scholar 

  66. Menzies, T., Butcher, A., Marcus, A., Zimmermann, T., Cok, D.: Loval vs. global models for effort estimation and defect prediction. In: Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE ’11), pp. 343–351. IEEE Computer Society, Silver Spring (2011)

    Google Scholar 

  67. Mordal-Manet, K., Balmas, F., Denier, S., Ducasse, S., Wertz, H., Laval, J., Bellingard, F., Vaillergues, P.: The squale model – a practice-based industrial quality model. In: Proceedings of the IEEE International Conference on Software Maintenance (2009)

    Google Scholar 

  68. Münch, J., Kläs, M.: Balancing upfront definition and customization of quality models. In: Workshop-Band Software-Qualitätsmodellierung und -bewertung (SQMB 2008). Technische Universität München (2008)

    Google Scholar 

  69. Musa, J., Ackerman, A.: Quantifying software validation: When to stop testing? IEEE Softw. 6(3), 19–27 (1989)

    Article  Google Scholar 

  70. Musa, J.D.: Software Reliability Engineering: More Reliable Software Faster and Cheaper, 2nd edn. AuthorHouse, Bloomington (2004)

    Google Scholar 

  71. Musa, J.D., Iannino, A., Okumoto, K.: Software Reliability: Measurement, Prediction, Application. McGraw-Hill, New York (1987)

    Google Scholar 

  72. Nagappan, N., Ball, T.: Static analysis tools as early indicators of pre-release defect density. In: Proceedings of the International Conference on Software Engineering (ICSE ’05). ACM Press, New York (2005)

    Google Scholar 

  73. Nagappan, N., Ball, T., Zeller, A.: Mining metrics to predict component failures. In: Proceedings of the 28th International Conference on Software Engineering (ICSE’06), pp. 452–461. ACM Press, New York (2006)

    Google Scholar 

  74. Neuhaus, S., Zimmermann, T., Holler, C., Zeller, A.: Predicting vulnerable software components. In: Proceedings of the 14th ACM Conference on Computer and Communications Security (CCS ’07), pp. 529–540. ACM Press, New York (2007)

    Google Scholar 

  75. Oman, P., Hagemeister, J.: Metrics for assessing a software system’s maintainability. In: Proceedings of the International Conference on Software Maintenance (1992)

    Google Scholar 

  76. Ortega, M., Pérez, M., Rojas, T.: Construction of a systemic quality model for evaluating a software product. Softw. Qual. J. 11, 219–242 (2003)

    Article  Google Scholar 

  77. Plösch, R., Gruber, H., Hentschel, A., Körner, C., Pomberger, G., Schiffer, S., Saft, M., Storck, S.: The EMISQ method and its tool support – expert based evaluation of internal software quality. J. Innov. Syst. Softw. Eng. 4(1) (2008)

    Google Scholar 

  78. Plösch, R., Gruber, H., Körner, C., Pomberger, G., Schiffer, S.: A proposal for a quality model based on a technical topic classification. In: Tagungsband des 2. Workshops zur Software-Qualitätsmodellierung und -bewertung (2009)

    Google Scholar 

  79. Plösch, R., Gruber, H., Pomberger, G., Saft, M., Schiffer, S.: Tool support for expert-centred code assessments. In: Proceedings of the International Conference on Software Testing, Verification, and Validation (ICST), pp. 258–267. IEEE Computer Society, Silver Spring (2008)

    Google Scholar 

  80. Samoladas, I., Gousios, G., Spinellis, D., Stamelos, I.: The SQO-OSS quality model: Measurement based open source software evaluation. In: Proceedings of the 4th International Conference on Open Source Systems, vol. 275. Springer, New York (2008)

    Google Scholar 

  81. Schackmann, H., Jansen, M., Lichter, H.: Tool support for user-defined quality assessment models. In: Proceedings of the MetriKon 2009 (2009)

    Google Scholar 

  82. van Solingen, R., Berghout, E.: Goal/Question/Metric Method. McGraw-Hill Professional, New York (1999)

    Google Scholar 

  83. Sun Microsystems: Secure coding guidelines for the java programming language, version 2.0. Available Online at http://java.sun.com/security/seccodeguide.html

  84. Tian, J.: Quality-Evaluation Models and Measurements. IEEE Softw. 21(3), 84–91 (2004)

    Article  Google Scholar 

  85. Wagner, S.: Using economics as basis for modelling and evaluating software quality. In: Proceedings of the First International Workshop on the Economics of Software and Computation (ESC-1) (2007)

    Google Scholar 

  86. Wagner, S.: Cost-Optimisation of Analytical Software Quality Assurance. VDM Verlag Dr. Müller, Saarbrücken (2008)

    Google Scholar 

  87. Wagner, S.: A Bayesian network approach to assess and predict software quality using activity-based quality models. Inf. Softw. Technol. 52(11), 1230–1241 (2010)

    Article  Google Scholar 

  88. Wagner, S., Deissenboeck, F.: An integrated approach to quality modelling. In: Proceedings of the 5th Workshop on Software Quality (5-WoSQ). IEEE Computer Society (2007)

    Google Scholar 

  89. Wagner, S., Fischer, H.: A Software Reliability Model Based on a Geometric Sequence of Failure Rates. In: Proceedings of the 11th International Conference on Reliable Software Technologies (Ada-Europe ’06). Lecture Notes in Computer Science, vol. 4006, pp. 143–154. Springer, Berlin (2006)

    Google Scholar 

  90. Wagner, S., Jürjens, J.: Model-based identification of fault-prone components. In: Proceedings of the Fifth European Dependable Computing Conference (EDCC-5). Lecture Notes in Computer Science, vol. 3463, pp. 435–452. Springer, New York (2005)

    Google Scholar 

  91. Wagner, S., Lochmann, K., Heinemann, L., Kläs, M., Trendowicz, A., Plösch, R., Seidl, A., Goeb, A., Streit, J.: The Quamoco product quality modelling and assessment approach. In: Proceedings of the 34th International Conference on Software Engineering. IEEE Computer Society, Silver Spring (2012)

    Google Scholar 

  92. Wagner, S., Lochmann, K., Winter, S., Goeb, A., Kläs, M., Nunnenmacher, S.: Software quality in practice. survey results. Technical Report TUM-I128, Technische Universität München (2012)

    Google Scholar 

  93. Wagner, S., Méndez Fernández, D., Islam, S., Lochmann, K.: A security requirements approach for web systems. In: Proceedings of the Quality Assessment in Web (QAW 2009). CEUR (2009)

    Google Scholar 

  94. Wiesmann, A., van der Stock, A., Curphey, M., Stirbei, R. (eds.): A Guide to Building Secure Web Applications and Web Services. OWASP (2005)

    Google Scholar 

  95. Winter, S., Wagner, S., Deissenboeck, F.: A comprehensive model of usability. In: Proceedings of the Engineering Interactive Systems 2007. Lecture Notes in Computer Science, vol. 4940, pp. 106–122. Springer, New York (2008)

    Google Scholar 

  96. van Zeist, R.H.J., Hendriks, P.R.H.: Specifying software quality with the extended ISO model. Softw. Qual. J. 5(4), 273–284 (1996)

    Article  Google Scholar 

  97. Zhou, Y., Leung, H.: Predicting object-oriented software maintainability using multivariate adaptive regression splines. J. Syst. Softw. 80(8), 1349–1361 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Software Technology, University of Stuttgart, Stuttgart, Germany

    Stefan Wagner

Authors
  1. Stefan Wagner
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wagner, S. (2013). Quality Models. In: Software Product Quality Control. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38571-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38571-1_2

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38570-4

  • Online ISBN: 978-3-642-38571-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation