NIST logo

Publication Citation: Automated Combinatorial Test Methods Beyond Pairwise Testing

NIST Authors in Bold

Author(s): David R. Kuhn; Raghu N. Kacker; Yu Lei;
Title: Automated Combinatorial Test Methods Beyond Pairwise Testing
Published: June 02, 2008
Abstract: Pairwise testing has become a popular approach to software quality assurance because it often provides effective error detection at low cost. However, pairwise (2-way) coverage is not sufficient for assurance of mission-critical software. Combinatorial testing beyond pairwise is rarely used because good algorithms have not been available for complex combinations such as 3- way, 4-way, or more. In addition, significantly more tests are required for combinations beyond pairwise testing, and testers must determine expected results for each set of inputs. This article introduces new tools for automating the production of complete test cases covering up to 6-way combinations.
Citation: Crosstalk (Hill AFB): the Journal of Defense Software Engineering
Keywords: combinatorial testing; formal methods; model checking; pairwise testing; software assurance; software testing
Research Areas: Software Testing Metrics