Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

IPOG/IPOG-D: Efficient Test Generation for Multi-way Combinatorial Testing



Yu Lei, Raghu N. Kacker, D. Richard Kuhn, Vadim Okun, James F. Lawrence


We present two strategies for multi-way testing (i.e., t-way testing with t > 2). The first strategy generalizes an existing strategy, called In-Parameter-Order, from pairwise testing to multi-way testing. This strategy requires all t-way combinations to be explicitly enumerated. When the number of t-way combinations is large, however, explicit enumeration can be prohibitive both in terms of the space for storing these combinations and the time needed to enumerate them. To alleviate this problem, the second strategy combines the first strategy with a recursive construction procedure to reduce the number of t-way combinations that have to be enumerated. Both strategies are deterministic, i.e., they always produce the same test set for the same system configuration. We describe a t-way testing tool called FireEye and provide both analytic and experimental evaluation of the two strategies.
Software Testing Verification & Reliability


combinatorial testing, interaction testing, multi-way testing, software testing


Lei, Y. , Kacker, R. , Kuhn, D. , Okun, V. and Lawrence, J. (2007), IPOG/IPOG-D: Efficient Test Generation for Multi-way Combinatorial Testing, Software Testing Verification & Reliability, [online], (Accessed May 28, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created November 28, 2007, Updated October 12, 2021