Skip to main content

An Overview of Experimental Studies on Software Inspection Process

  • Conference paper
  • First Online:
Book cover Enterprise Information Systems (ICEIS 2013)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 190))

Included in the following conference series:

  • 1072 Accesses

Abstract

Software inspection process is an effective activity to find defects on software artifacts as soon as they are introduced. The development of experimental knowledge on this area is useful to everyone who needs to make decisions about inspection activity. This paper aims to map the empirical studies conducted in the software inspection process area. The steps of the Systematic Mapping (SM) process was performed with the support of the StArt tool. Seventy nine papers were accepted in this SM and attributes related to inspection process, techniques, tools, inspected artifacts, research groups and universities were extracted. The results show different inspection processes, which have been experimentally investigated. Fagan’s process is the most investigated of them. In relation to inspected artifacts, requirements document and source code were the most used. Moreover, different tools and techniques have been used to support these processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anderson, P., Reps, T., Teitelbaum, T.: Design and implementation of a fine-grained software inspection tool. IEEE Trans. Softw. Eng. 29(8), 721–733 (2003)

    Article  Google Scholar 

  2. BooSerd, C., Moonen, L.: Prioritizing software inspection results using static profiling. In: 6th IEEE International Workshop on Source Code Analysis and Manipulation. IEEE Computer Society, Los Alamitos (2006)

    Google Scholar 

  3. Fagan, M.E.: Design and code inspections to reduce errors in program development. IBM Syst. J. 15(7), 182–211 (1976)

    Article  Google Scholar 

  4. Fagan, M.E.: Advances in software inspections. IEEE Trans. Softw. Eng. 12(7), 744–751 (1986)

    Article  Google Scholar 

  5. Humphrey, W.S.: Managing the Software Process. Addison-Wesley Longman Publishing Company, Boston (1989)

    Google Scholar 

  6. NASA. http://www.cs.nott.ac.uk/~cah/G53QAT/fi.pdf

  7. Gilb, T., Graham, D.: Software Inspection. Addison-Wesley, England (1993)

    Google Scholar 

  8. Murphy, P., Miller, J.: A process for asynchronous software inspection. In: 8th IEEE International Workshop on Software Technology and Engineering Practice. IEEE Press, Los Alamitos (1997)

    Google Scholar 

  9. Sauer, C., Jeffery, D., Land, L., Yetton, P.: The effectiveness of software development technical review: a behaviorally motivated program of research. IEEE Trans. Softw. Eng. 1(26), 1–14 (2000)

    Article  Google Scholar 

  10. Halling, M., Biffl, S., Grunbacher, P.: A groupware-supported inspection process for active inspection management. In: Euromicro Conference. IEEE Press, Los Alamitos (2002)

    Google Scholar 

  11. Denger, C., Elberzhager, F.: Unifying inspection processes to create a framework to support static quality assurance planning. In: 33rd Euromicro Conference on Software Engineering and Advanced Applications. IEEE Press, Los Alamitos (2007)

    Google Scholar 

  12. Travassos, G.H., Gurov, D., Amaral, E.: Introdução à Engenharia de software experimental. Technical report, UFRJ (2002)

    Google Scholar 

  13. Basili, V.R., Green, S., Laitenberger, O., Shull, F., Sørumgård, S., Zelkowitz, M.: The empirical investigation of perspective-based reading. Empir. Softw. Eng. 1(2), 133–164 (1996)

    Article  Google Scholar 

  14. Kitchenham, B.A.: Procedures for performing systematic reviews. Technical report, Keele University (2004)

    Google Scholar 

  15. Bailey, J., Budgen, D., Turner, M., Kitchenham, B., Brereton, P., Linkman, S.: Evidence relating to object-oriented software design: a survey. In: International Symposium on Empirical Software Engineering and Measurement. IEEE Press, Los Alamitos (2007)

    Google Scholar 

  16. Petticrew, M., Roberts, H.: Systematic Reviews in the Social Sciences - a practical guide. Blackwell Publishing, Malden (2006)

    Book  Google Scholar 

  17. Petersen, K., Feldt, R., Mujtaba, S., Mattson, M.: Systematic mapping studies in software engineering. In: International Conference on Evaluation and Assessment in Software Engineering (2008)

    Google Scholar 

  18. Kitchenham, B.A.: Guidelines for performing systematic literature reviews in software. Technical report, Keele University (2007)

    Google Scholar 

  19. Hernandes, E.C.M., Zamboni, A.B., Thommazo, A.D., Fabbri, S.C.P.F.: Avaliação da ferramenta StArt utilizando o modelo TAM e o paradigma GQM. In: 7th Experimental Software Engineering Latin American Workshop (2010)

    Google Scholar 

  20. Zamboni, A.B., Thommazo, A.D., Hernandes, E.C.M., Fabbri, S.C.P.F.: StArt Uma Ferramenta Computacional de Apoio à Revisão Sistemática. In: Brazilian Conference on Software: Theory and Practice - Tools session (2010)

    Google Scholar 

  21. Fabbri, S., Hernandes, E., Di Thommazo, A., Belgamo, A., Zamboni, A., Silva, C.: Managing literature reviews information through visualization. In: 14th International Conference on Enterprise Information Systems. SciTePress, New York (2012)

    Google Scholar 

  22. Dieste, O., Grimán, A., Juristo, N.: Developing search strategies for detecting relevant experiments. Empir. Softw. Eng. 14(5), 513–539 (2009)

    Article  Google Scholar 

  23. Wieringa, R., Maiden, N., Mead, N., Rolland, C.: Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requir. Eng. 11(1), 102–107 (2005)

    Article  Google Scholar 

  24. Cruzes, D., Dyba, T.: Recommended steps for thematic synthesis in software engineering. In: International Symposium on Empirical Software Engineering and Measurement. IEEE Computer Society, Los Alamitos (2011)

    Google Scholar 

  25. Pai, M., McCulloch, M., Gorman, J.D., Pai, N., Enanoria, W., Kennedy, G., Tharyan, P., Colford Jr, J.M.: Clinical research methods - systematic reviews and meta-analyses: an illustrated, step-by-step guide. Natl. Med. J. India 17(2), 86–95 (2004)

    Google Scholar 

  26. Porter, A., Siy, H., Mockus, A., Votta, L.: Understanding the sources of variation in software inspections. ACM Trans. Softw. Eng. Methodol. 7(1), 41–79 (1998)

    Article  Google Scholar 

  27. Kelly, D., Shepard, T.: Task-directed software inspection technique: an experiment and case study. In: Conference of the Centre for Advanced Studies on Collaborative Research. IBM Press, Palo Alto (2000)

    Google Scholar 

  28. Harjumaa, L.: Distributed software inspections - an experiment with Adobe Acrobat. In: 26th International Conference on Computer Science and Technology. IASTED, New York (2003)

    Google Scholar 

  29. Vitharana, P., Ramamurthy, K.: Computer-mediated group support, anonymity, and the software inspection process: an empirical investigation. IEEE Trans. Softw. Eng. 29(2), 167–180 (2003)

    Article  Google Scholar 

  30. Torner, T., Ivarsson, M., Pettersson, F., Öhman, P.: Defects in automotive use cases. In: ACM/IEEE International Symposium on Empirical Software Engineering. ACM Press, New York (2006)

    Google Scholar 

  31. Porto, D., Mendonca, M., Fabbri, S.: The use of reading technique and visualization for program understanding. In: 21st International Conference on Software Engineering and Knowledge Engineering. ACM Press, New York (2009)

    Google Scholar 

  32. Bernardez, B., Genero, M., Duran, A., Toro, M.: A controlled experiment for evaluating a metric-based reading technique for requirements inspection. In: 10th International Symposium on Software Metrics. IEEE Press, Los Alamitos (2004)

    Google Scholar 

  33. Winkler, D., Biffl, S., Thurnher, B.: Investigating the impact of active guidance on design inspection. In: Bomarius, F., Komi-Sirviö, S. (eds.) PROFES 2005. LNCS, vol. 3547, pp. 458–473. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  34. Walia, G., Carver, J.: Evaluation of capture-recapture models for estimating the abundance of naturally-occurring defects. In: 2nd ACM-IEEE International Symposium on Empirical software Engineering and Measurement. ACM Press, New York (2008)

    Google Scholar 

  35. Perpich, J., Perry, D., Porter, A., Votta, L., Wade, M.: Anywhere, anytime code inspections: using the web to remove inspection bottlenecks in large-scale software development. In: International Conference on Software Engineering. IEEE Computer Society, Los Alamitos (1997)

    Google Scholar 

  36. Perry, D., Porter, A., Wade, M., Votta, L., Perpich, J.: Reducing inspection interval in large-scale software development. IEEE Trans. Softw. Eng. 28(7), 695–705 (2002)

    Article  Google Scholar 

  37. Schneider, M., Martin, J., Tsai, W.T.: An experimental study of fault detection in user requirements documents. ACM Trans. Softw. Eng. Methodol. 1(2), 188–204 (1992)

    Article  Google Scholar 

  38. He, L., Carver, J.: PBR vs. checklist: a replication in the n-fold inspection context. In: ACM/IEEE International Symposium on Empirical Software Engineering. ACM Press, New York (2006)

    Google Scholar 

  39. Frøkjær, E., Hornbæk, K.: Metaphors of human thinking for usability inspection and design. ACM Trans. Comput.-Hum. Interact. 14(4), 1–33 (2008)

    Article  Google Scholar 

  40. Runeson, P., Wohlin, C.: An experimental evaluation of an experience-based capture-recapture method in software code inspections. Empir. Softw. Eng. 3(4), 381–406 (1998)

    Article  Google Scholar 

  41. Miller, J.: Estimating the number of remaining defects after inspection. Softw. Test. Verif. Reliab. 9(3), 167–189 (1999)

    Article  Google Scholar 

  42. Freimut, B., Laitenberger, O., Biffl, S.: Investigating the impact of reading techniques on the accuracy of different defect content estimation techniques. In: 17th Software Metrics Symposium. IEEE Press, Los Alamitos (2001)

    Google Scholar 

  43. Thelin, T.: Empirical evaluations of usage-based reading and fault content estimation for software inspections. Empir. Softw. Eng. 8(3), 309–313 (2003)

    Article  Google Scholar 

  44. Thelin. T.: Team-based fault content estimation in the software inspection process. In: 26th International Conference on Software Engineering. IEEE Computer, Washington (2004)

    Google Scholar 

  45. Eick, S., Loader, C., Long, D., Votta, L., Vander Wiel, S.: Estimating software fault content before coding. In: 14th International Conference on Software Engineering. IEEE Computer Society, Los Alamitos (1992)

    Google Scholar 

  46. Lanubile, F., Mallardo, T., Calefato, F.: Tool support for geographically dispersed inspection teams. Softw. Process: Improv. Pract. 8(4), 217–231 (2004)

    Article  Google Scholar 

  47. Kalinowski, M., Travassos, G.H.: A computational framework for supporting software inspections. In: 19th Conference on Automated Software Engineering. IEEE Press, Los Alamitos (2004)

    Google Scholar 

  48. Ardito, C., Lanzilotti, R., Buono, P., Piccinno, A.: A tool to support usability inspection. In: 11th Working Conference on Advanced Visual Interfaces. ACM Press, New York (2006)

    Google Scholar 

  49. Tyran, C.K., George, J.F.: Improving software inspections with group process support. Commun. ACM 45(9), 87–92 (2002)

    Article  Google Scholar 

  50. Wojcicki, M., Strooper, P.: Maximising the information gained from an experimental analysis of code inspection and static analysis for concurrent java components. In: ACM/IEEE International Symposium on Empirical Software Engineering. ACM Press, New York (2006)

    Google Scholar 

  51. Budgen, D., Kitchenham, B., Charters, S., Turner, M., Brereton, P., Linkman, S.: Presenting software engineering results using structured abstracts: a randomised experiment. Empir. Softw. Eng. 13(4), 435–468 (2008)

    Article  Google Scholar 

  52. Jedlitschka, A., Pfahl, D.: Reporting guidelines for controlled experiments in software engineering. In: International Symposium on Empirical Software Engineering. IEEE Press, Los Alamitos (2005)

    Google Scholar 

Download references

Acknowledgements

Our thanks to the Brazilian funding agencies CAPES and CNPq and INEP (Observatório da Educação, project 3280). E.M.H thanks CAPES foundation (BEX 11833/12-2).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elis Montoro Hernandes .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Hernandes, E.M., Belgamo, A., Fabbri, S. (2014). An Overview of Experimental Studies on Software Inspection Process. In: Hammoudi, S., Cordeiro, J., Maciaszek, L., Filipe, J. (eds) Enterprise Information Systems. ICEIS 2013. Lecture Notes in Business Information Processing, vol 190. Springer, Cham. https://doi.org/10.1007/978-3-319-09492-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-09492-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-09491-5

  • Online ISBN: 978-3-319-09492-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics