Skip to main content
SpringerLink
Log in
Book cover

International Conference on Software and Data Technologies

ICSOFT 2010: Software and Data Technologies pp 58–71Cite as

Systematic Review on Software Product Line Testing

  • Conference paper

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 170))

Abstract

This article presents a systematic review of the literature about Testing in Software Product Lines. The objective is to analyze the existing approaches to testing in software product lines, discussing the significant issues related to this area of knowledge and providing an up-to-date state of the art, which can serve as a basis for innovative research activities. The paper includes an analysis on how SPL research can contribute to dynamize the research in software testing.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Clements, P.C., Northrop, L.M.: Salion, Inc.: A Software Product Line Case Study (2002)

    Google Scholar 

  2. Grindal, M., Offutt, J., Andler, S.: Combination testing strategies: A survey. Software Testing Verification and Reliability 15(3), 167–200 (2005)

    Article  Google Scholar 

  3. van der Linden, F.: Software product families in Europe: the Esaps and Cafe projects. IEEE Software 19(4), 41–49 (2002)

    Article  MathSciNet  Google Scholar 

  4. Krueger, C.W.: Introduction to Software Product Lines in Methods and Tools (2006)

    Google Scholar 

  5. McGregor, J.D., et al.: Initiating software product lines. IEEE Software 19(4), 24–27 (2002)

    Article  Google Scholar 

  6. Bertolino, A.: Software Testing Research: Achievements, Challenges, Dreams. In: International Conference on Software Engineering. IEEE Computer Society (2007)

    Google Scholar 

  7. Pérez Lamancha, B., Polo Usaola, M., Piattini, M.: Software Product Line Testing, A systematic review. In: 4th International Conference on Software and Data Technologies (ICSOFT 2009), Sofia, Bulgaria: To be published (2009)

    Google Scholar 

  8. Kitchenham, B.: Procedures for performing systematic reviews. Keele University TR/SE-0401/NICTA Technical Report 0400011T (2004)

    Google Scholar 

  9. Biolchini, J., et al.: Systematic review in software engineering. System Engineering and Computer Science Department COPPE/UFRJ, Technical Report ES 679(05) (2005)

    Google Scholar 

  10. Pino, F.J., GarcÌa, F., Piattini, M.: Software process improvement in small and medium software enterprises: a systematic review. Software Quality Journal 16(2), 237–261 (2008)

    Article  Google Scholar 

  11. Pérez Lamancha, B., Polo Usaola, M.: Testing Product Generation in Software Product Lines Using Pairwise for Features Coverage. In: Petrenko, A., Simão, A., Maldonado, J.C. (eds.) ICTSS 2010. LNCS, vol. 6435, pp. 111–125. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  12. Rodrigues, E.D.M., Viccari, L.D., Zorzo, A.F.: PLeTs-Test Automation using Software Product Lines and Model Based Testing. In: Int. Conf. on Software Eng. & Knowledge Engineering (2010)

    Google Scholar 

  13. Pérez Lamancha, B., Polo, M., Piattini, M.: An Automated Model-Driven Testing Framework for Model-Driven Development and Software Product Lines. In: International Conference on Evaluation of Novel Approaches to Software Eng. (2010)

    Google Scholar 

  14. Cabral, I., Cohen, M.B., Rothermel, G.: Improving the Testing and Testability of Software Product Lines. In: Bosch, J., Lee, J. (eds.) SPLC 2010. LNCS, vol. 6287, pp. 241–255. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  15. Oster, S., Markert, F., Ritter, P.: Automated Incremental Pairwise Testing of Software Product Lines. In: Bosch, J., Lee, J. (eds.) SPLC 2010. LNCS, vol. 6287, pp. 196–210. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  16. Stricker, V., Metzger, A., Pohl, K.: Avoiding Redundant Testing in Application Engineering. In: Bosch, J., Lee, J. (eds.) SPLC 2010. LNCS, vol. 6287, pp. 226–240. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  17. Ganesan, D., Lindvall, M., McComas, D., Bartholomew, M., Slegel, S., Medina, B.: Architecture-Based Unit Testing of the Flight Software Product Line. In: Bosch, J., Lee, J. (eds.) SPLC 2010. LNCS, vol. 6287, pp. 256–270. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  18. Ghanam, Y., Maurer, F.: Linking Feature Models to Code Artifacts Using Executable Acceptance Tests. In: Bosch, J., Lee, J. (eds.) SPLC 2010. LNCS, vol. 6287, pp. 211–225. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  19. Perrouin, G., et al.: Automated and scalable t-wise test case generation strategies for software product lines. In: International Conference on Software Testing (ICST 2010). IEEE (2010)

    Google Scholar 

  20. Segura, S., et al.: Automated test data generation on the analyses of feature models: a metamorphic testing approach. In: Int. Conference on Software Testing. IEEE (2010)

    Google Scholar 

  21. Uzuncaova, E., Khurshid, S., Batory, D.: Incremental Test Generation for Software Product Lines. IEEE Transactions on Software Engineering, 309–322 (2010)

    Google Scholar 

  22. Reales Mateo, P., Pérez Lamancha, B., Polo Usaola, M.: Automatic Generation of Test Cases in Software Product Lines. In: Int. Conference on Enterprise Information Systems (2009)

    Google Scholar 

  23. Camara, J., Kobsa, A.: Facilitating Controlled Tests of Website Design Changes Using Aspect-Oriented Software Development and Software Product Lines. Transactions on Large-Scale Data-and Knowledge-Centered Systems I, 116–135 (2009)

    Article  Google Scholar 

  24. Olimpiew, E.M., Gomaa, H.: Reusable Model-Based Testing. In: Edwards, S.H., Kulczycki, G. (eds.) ICSR 2009. LNCS, vol. 5791, pp. 76–85. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  25. Kahsai, T., Roggenbach, M., Schlingloff, B.H.: Specification-Based Testing for Software Product Lines. In: IEEE Int. Conf. on Software Eng. and Formal Methods. IEEE (2008)

    Google Scholar 

  26. Al Dallal, J., Sorenson, P.: Testing software assets of framework-based product families during application engineering stage. Journal of Software 3(5), 11–25 (2008)

    Google Scholar 

  27. Reis, S., Metzger, A., Pohl, K.: Integration Testing in Software Product Line Engineering: A Model-Based Technique. In: Dwyer, M.B., Lopes, A. (eds.) FASE 2007. LNCS, vol. 4422, pp. 321–335. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  28. Ganesan, D., et al.: Comparing costs and benefits of different test strategies for a software product line: a study from Testo AG. In: International Software Product Line Conference (2007)

    Google Scholar 

  29. Kang, S., et al.: Towards a Formal Framework for Product Line Test Development. Computer and Information Technology. In: CIT 2007, pp. 921–926 (2007)

    Google Scholar 

  30. Baerisch, S.: Model-driven test-case construction. In: Foundations of Software Engineering, pp. 587–590 (2007)

    Google Scholar 

  31. Ajila, S., Dumitrescu, R.: Experimental use of code delta, code churn, and rate of change to understand software product line evolution. Journal of Systems & Software 80(1), 74–91 (2007)

    Article  Google Scholar 

  32. Cohen, M., Dwyer, M., Shi, J.: Coverage and adequacy in software product line testing. In: Workshop on Role of Software Architecture for Testing and Analysis, pp. 53–63 (2006)

    Google Scholar 

  33. Pohl, K., Metzger, A.: Software product line testing. Communications of the ACM 49(12), 78–81 (2006)

    Article  Google Scholar 

  34. Denger, C., Kolb, R.: Testing and inspecting reusable product line components: first empirical results. In: International Symposium on Empirical Software Eng., pp. 184–193 (2006)

    Google Scholar 

  35. Kim, K., et al.: ASADAL: a tool system for co-development of software and test environment based on product line engineering. In: International Conference on Software Engineering, pp. 783–786 (2006)

    Google Scholar 

  36. Kishi, T., Natsuko, N.: Design Testing for Product Line Development based on Test Scenarios. In: International Workshop on Software Product Line Testing (2004)

    Google Scholar 

  37. Kolb, R., Muthig, D.: Making testing product lines more efficient by improving the testability of product line architectures. In: Proceedings of the ISSTA 2006 Workshop on Role of Software Architecture for Testing and Analysis, pp. 22–27 (2006)

    Google Scholar 

  38. Pesonen, J., Katara, M., Mikkonen, T.: Production-Testing of Embedded Systems with Aspects. In: Ur, S., Bin, E., Wolfsthal, Y. (eds.) HVC 2005. LNCS, vol. 3875, pp. 90–102. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  39. Trew, T.: Enabling the Smooth Integration of Core Assets: Defining and Packaging Architectural Rules for a Family of Embedded Products. In: Obbink, H., Pohl, K. (eds.) SPLC 2005. LNCS, vol. 3714, pp. 137–149. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  40. Reuys, A., Kamsties, E., Pohl, K., Reis, S.: Model-Based System Testing of Software Product Families. In: Pastor, Ó., Falcão e Cunha, J. (eds.) CAiSE 2005. LNCS, vol. 3520, pp. 519–534. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  41. Bertolino, A., Gnesi, S., di Pisa, A.: PLUTO: A Test Methodology for Product Families. In: van der Linden, F.J. (ed.) PFE 2003. LNCS, vol. 3014, pp. 181–197. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  42. Geppert, B., Li, J., Rößler, F., Weiss, D.M.: Towards Generating Acceptance Tests for Product Lines. In: Dannenberg, R.B., Krueger, C. (eds.) ICOIN 2004 and ICSR 2004. LNCS, vol. 3107, pp. 35–48. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  43. Nebut, C., Fleurey, F., Le Traon, Y., Jézéquel, J.-M.: A Requirement-Based Approach to Test Product Families. In: van der Linden, F.J. (ed.) PFE 2003. LNCS, vol. 3014, pp. 198–210. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  44. Tevanlinna, A.: Product Family Testing with RITA. In: Proceedings of the Eleventh Nordic Workshop on Programming and Software Development Tools and Techniques (NWPER 2004), pp. 251–265 (2004)

    Google Scholar 

  45. Nebut, C., et al.: Automated requirements-based generation of test cases for product families. In: Proceedings of 18th IEEE International Conference on Automated Software Engineering, pp. 263–266 (2003)

    Google Scholar 

  46. McGregor, J.D.: Testing a Software Product Line, Carnegie Mellon University, Software Engineering Institute (2001)

    Google Scholar 

  47. Ardis, M., et al.: Software product lines: a case study. Software Practice and Experience 30(7), 825–847 (2000)

    Article  MATH  Google Scholar 

  48. Tevanlinna, A., Taina, J., Kauppinen, R.: Product family testing: a survey. ACM SIGSOFT Software Engineering Notes 29(2), 12 (2004)

    Article  Google Scholar 

  49. Pohl, K., Böckle, G., Van Der Linden, F.: Software Product Line Engineering: Foundations, Principles, and Techniques. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  50. Pérez Lamancha, B., Polo Usaola, M., García Rodriguez de Guzmán, I.: I. García Rodriguez de Guzmán. Model-Driven Testing in Software Product Lines. In: 25th International IEEE Conference on Software Maintenance (ICSM 2009). IEEE (2009)

    Google Scholar 

  51. Pérez Lamancha, B., et al.: Automated Model-based Testing using the UML Testing Profile and QVT. In: International Workshop on Model-Driven Engineering, Verification and Validation, MODEVVA 2009 (2009)

    Google Scholar 

  52. Pérez Lamancha, B., et al.: Model-Driven Testing: Transformations from test models to test code. In: International Conference on Evaluation of Novel Approaches to Software Engineering, Beijing, China: To be Published (2011)

    Google Scholar 

  53. OMG, MOF Query/View/Transformation Specification (2007)

    Google Scholar 

  54. OMG, MOF Model to Text Transformation Language (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Software Testing Center, Republic University, Montevideo, Uruguay

    Beatriz Pérez Lamancha

  2. ALARCOS Research Group, Castilla – La Mancha University, Ciudad Real, Spain

    Macario Polo & Mario Piattini

Authors
  1. Beatriz Pérez Lamancha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Macario Polo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mario Piattini
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Systems and Informatics, INSTICC / IPS, Rua do Vale de Chaves, Estefanilha, 2910-761, Setúbal, Portugal

    José Cordeiro

  2. Department of Informatics, University of Piraeus, 80 Karaoli & Dimitriou St., 18534, Piraeus, Greece

    Maria Virvou

  3. IICREST, P.O. Box 104, 1618, Sofia, Bulgaria

    Boris Shishkov

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lamancha, B.P., Polo, M., Piattini, M. (2013). Systematic Review on Software Product Line Testing. In: Cordeiro, J., Virvou, M., Shishkov, B. (eds) Software and Data Technologies. ICSOFT 2010. Communications in Computer and Information Science, vol 170. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29578-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29578-2_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29577-5

  • Online ISBN: 978-3-642-29578-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation