Relating Verification and Validation Methods to Software Product Quality Characteristics: Results of an Expert Survey
[Context] Employing appropriate verification and validation (V&V) methods is essential to improve software product quality. However, while several V&V methods have been documented, little is known about how these methods relate to specific product quality characteristics. [Goal] The goal of this paper is to provide an initial configuration on the suitability of selected V&V methods to address ISO 25010 software product quality characteristics. [Method] Therefore, we compiled a list of V&V methods and conducted a survey with V&V experts, asking them to evaluate how well each V&V method allows for addressing the ISO 25010 characteristics. [Results] We received 19 answers from experts of 7 different countries. Our results express the aggregated expert opinion. It is noteworthy that the experts mostly agreed in their opinions, indicating consistency in the results. [Conclusions] This work provides the first result on the relationship between V&V methods and quality characteristics. We believe that the aggregated opinion of 19 experts can serve as a starting point for further investigations by other researchers and to provide an additional understanding to practitioners.
KeywordsVerification and validation methods Software product quality
The authors would like to thank all the survey respondents.
- 1.Bourque, P., Fairley, R.E.: SWEBOK Guide V3.0, Guide to the Software Engineering Body of Knowledge. IEEE Computer Society, Los Alamitos (2004)Google Scholar
- 2.Endres, A., Rombach, D.: A Handbook of Software and Systems Engineering. Addison Wesley, Boston (2003)Google Scholar
- 3.Felderer, M., Auer, F.: Software quality assurance during implementation: results of a survey in software houses from Germany, Austria and Switzerland. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2017. LNBIP, vol. 269, pp. 87–102. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-49421-0_7CrossRefGoogle Scholar
- 4.Feldt, R., Marculescu, B., Schulte, J., Torkar, R., Preissing, P., Hult, E.: Optimizing Verification and Validation Activities for Software in the Space Industry. Data Systems in Aerospace (DASIA), Budapest (2010)Google Scholar
- 5.ISO25000 Software Product Quality, ISO/IEC 25010 (2011). http://iso25000.com/index.php/en/iso-25000-standards/iso-25010
- 6.Linåker, J., Sulaman, S.M., Maiani de Mello, R., Höst, M.: Guidelines for Conducting Surveys in Software Engineering. Technical report Lund University, Sweden (2015)Google Scholar
- 7.Meyers, G.J., Badgett, T., Thomas, T., Csandler, C.: The Art of Software Testing, 3rd edn. Wiley, Hoboken (2011)Google Scholar
- 8.Torchiano, M., Fernández, D.M., Travassos, G.H. de Mello, R.M.: Lessons learnt in conducting survey research. In: Proceedings of the 5th International Workshop on Conducting Empirical Studies in Industry, pp. 33–39 (2017)Google Scholar
- 10.Wiegers, K.E.: Peer Reviews in Software: A Practical Guide. Addison-Wesley, Boston (2002)Google Scholar