Abstract
Systems constructed from components, including distributed systems, consist of a number of elements that interact with each other. As the number of network elements or interchangeable components for each network element increases, the trade off that the system tester faces is the thoroughness of test configuration coverage, versus availability of limited resources (time and budget). An approach to resolving this trade off is to determine a minimal set of test configurations that test each pair-wise combination of components. This goal gives a well-defined, cost-effective level of test coverage, with a reduced number of system configurations. To select such a set of test configurations, we show how to apply the method of covering arrays, and improve on previous results.
The author gratefully acknowledges the support of: the IBM Centre for Advanced Studies, Nortel Networks Ltd., Mitel Corporation, ObjecTime Ltd., CITO, NSERC, and the University of Ottawa.
The updated original online version for this book can be found at DOI: 10.1007/978-0-387-35516-0_20
Chapter PDF
Similar content being viewed by others
References
R.C. Bose. On the application of the properties of Galois fields to the construction of hyper Graeco-Latin squares. Sankhya 3: 323–338 (1938).
R. Brownlie, J. Prowse, and M.S. Phadke. Robust Testing of AT&T PMX/StarMail using OATS. AT&T Technical Journal, 71(3): 41–47 (May/June 1992).
K. Burroughs, A. Jain, and R.L. Erickson. Improved Quality of Protocol Testing Through Techniques of Experimental Design. In Proceedings of Supercomm/ICC ‘84, 1994, pp. 745–752 1994.
D.M. Cohen, S.R. Dalai, M.L. Fredman, and G.C. Patton. The AETG System: An Approach to Testing Based on Combinatorial Design IEEE Transactions on Software Engineering, 23 (7): 437–444, (July 1997).
D.M. Cohen, S.R. Dalai, J. Pare&s, and G.C. Patton. The Combinatorial Approach to Automatic Test Generation. IEEE Software, 13 (5): 83–88, (September 1996).
I.S. Dunietz, W.K. Ehrlich, B.D. Szablak, C.L. Mallows, A. Iannino. Applying Design of Experiments to Software Testing. In Proceedings of ICSE `97, pages 205–215, Boston MA USA, (1997).
W.J. Gilbert. Modern Algebra with Applications. Wiley Interscience, New York NY USA, 1976.
Y. Lei, K.C. Tai. A test generation strategy for pairwise testing. In Proc. of the 3rd IEEE High-Assurance Systems Engineering Symposium, pages 254–161, Nov. 1998.
R. Mandl. Orthogonal Latin squares: An application of experiment design to compiler testing. Communications of the ACM, 28 (10): 1054–1058 (October 1985).
W.B. Perkinson. A Methodology for Designing and Executing ISDN Feature Tests Using Automated Test Systems. In Proceedings of IEEE GLOBECOMM ‘82, 1992.
C.R. Rao. Factorial Experiments Derivable from Combinatorial Arrangements of Arrays. Journal of the Royal Statistical Society, 9 (1): 128–139 (1947).
B. Stevens, Transversal Covers and Packings, Ph.D. thesis, University of Toronto, 1998.
B. Stevens, E. Mendelsohn. Efficient Software Testing Protocols. In Proceedings of CASCON `98, pages 279–293, Toronto ON Canada, December 1998.
A.W. Williams, R.L. Probert, A Practical Strategy for Testing pair-wise Coverage of Network Interfaces. In Proc. of the 7th International Conference on Software Reliability Engineering (ISSRE 96), pages 246–254, White Plains NY USA, October 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 IFIP International Federation for Information Processing
About this chapter
Cite this chapter
Williams, A.W. (2000). Determination of Test Configurations for Pair-Wise Interaction Coverage. In: Ural, H., Probert, R.L., v. Bochmann, G. (eds) Testing of Communicating Systems. IFIP Advances in Information and Communication Technology, vol 48. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-35516-0_4
Download citation
DOI: https://doi.org/10.1007/978-0-387-35516-0_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-1016-8
Online ISBN: 978-0-387-35516-0
eBook Packages: Springer Book Archive