Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.


The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Combinatorial Testing for Cybersecurity and Reliability



David R. Kuhn, Raghu N. Kacker, Larry Feldman, Gregory A. Witte


This bulletin focuses on NIST's combinatorial testing work. Combinatorial testing is a proven method for more effective software testing at lower cost. The key insight underlying combinatorial testing's effectiveness resulted from a series of studies by NIST from 1999 to 2004. NIST research showed that most software bugs and failures are caused by one or two parameters, with progressively fewer by three or more.
ITL Bulletin - May 2016
Report Number
May 2016


algorithms, combinatorial testing, constraints, covering array, software testing, test suite
Created May 12, 2016, Updated February 19, 2017