Advertisement

An Open Framework for Managed Regression Testing

  • Naina Mittal
  • Ira Acharya
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2644)

Abstract

In the prevailing competitive environment, companies are facing tremendous market pressures to launch defect-free products in a timely manner. This challenge is compounded when a product runs into sustenance phase because complete regression runs need to be performed for each change/enhancement made in every build/release of the product-under-test. This paper discusses an architectural framework approach to address the above challenge, thereby aiming to make regression testing a simple, repeatable and automated exercise. The framework design encapsulates hierarchical test case management, multi-user support, product version maintenance, and automated test execution and result analysis to facilitate easy testing. The open architecture of the framework allows it to augment capabilities of some other testing tools by providing adapters to them, thus, eliminating the rigidity of use of a particular tool. The paper also draws a comparison of the architectural approach with other existing frameworks and presents a cost-benefit analysis of the suggested approach.

Keywords

Test automation managed testing test planning test execution test framework networking equipment regression testing black-box testing test scripts test bench hierarchical test case management test plan tree framework deployment test-cycle reduction testing tool collaboration 

References

  1. 1.
    Rex Black: Managing the Testing Process: Practical Tools and Techniques for Managing Hardware and Software Testing. Wiley John & Sons, IncorporatedGoogle Scholar
  2. 2.
    Edward Kit: Software Testing in the Real World (STRW). Addison-Wesley. (1995).Google Scholar
  3. 3.
    Wallace, D. and Fujii, R.: Software Verification and Validation: An Overview. IEEE Software. (May 1989). 10–17Google Scholar
  4. 4.
    Bret Pettichord: Seven Steps to Test Automation Success. STAR West. (November 1999).Google Scholar
  5. 5.
    Boris Beizer: Black-Box Testing: Techniques for Functional Testing of Software and Systems. John Wiley & Sons. (1995).Google Scholar
  6. 6.
    Agrawal, H., Horgan, J., Krauser, E. and London, S.: Incremental regression testing. In Proceedings of the Conference on Software Maintenance (September 1993). 348–357.Google Scholar
  7. 7.
    Chen, Y.-F., Rosenblum, D.S. and Vo, K.-P.: TestTube: A system for selective regression testing. In Proceedings of the 16th International Conference on Software Engineering (ICSE’ 94), Sorrento, Italy. (May 1994). 211–220.Google Scholar
  8. 8.
    Todd L. Graves, Mary Jean Harrold, Jung-Min Kim and Adam Porter, Gregg Rothermel: An Empirical Study of Regression Test Selection Techniques. ACM Transactions on Software Engineering and Methodology, Vol. 10, No. 2. (April 2001). 184–208.zbMATHCrossRefGoogle Scholar
  9. 9.
    John Bible and Gregg Rothermel: A Comparative Study of Coarse-and Fine-Grained Safe Regression Test-Selection Techniques. ACM Transactions on Software Engineering and Methodology, Vol. 10, No. 2. (April 2001). 149–183zbMATHCrossRefGoogle Scholar
  10. 10.
  11. 11.
    Expect Home Page. (http://expect.nist.gov/)
  12. 12.
  13. 13.
    mOSAic Design Document, Tata Consultancy Services.Google Scholar
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
    Hoffman, D. and Strooper, P.: Automated Module Testing in Prolog. IEEE Transactions on Software Engineering, Vol. 17, No. 9. (September 1991).Google Scholar
  19. 19.
    Chang Liu: Platform-Independent And Tool-Neutral Test Descriptions For Automated Software Testing. In Proceedings of the 22nd international conference on Software Engineering, Limerick, Ireland. (2000). 713–715Google Scholar
  20. 20.
    Usha Santhanam: Automating Software Module Testing for FAA Certification. In Proceedings of the annual conference on ACM SIGAda annual international conference (SIGAda 2001), Bloomington, MN. (2001)Google Scholar
  21. 21.
    Schot C.A., Sim M.N. and Kist P.M.: ANT — A Test Harness for the NELSIS CAD System. In Proceedings of the conference on European Design Automation, Congress Centrum Hamburg, Hamburg, Germany. (November 1992)Google Scholar

Copyright information

© IFIP 2003

Authors and Affiliations

  • Naina Mittal
    • 1
  • Ira Acharya
    • 1
  1. 1.Tata Consultancy ServicesNoidaIndia

Personalised recommendations