Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Automated Combinatorial Testing for Software (ACTS)


Combinatorial testing is a proven method for more effective software testing at lower cost. Line Graph showing Cumulative percent of software failures. The key insight underlying combinatorial testing’s effectiveness resulted from a series of studies by NIST from 1999 to 2004. NIST research showed that most software bugs and failures are caused by one or two parameters, with progressively fewer by three or more. This finding, referred to as the interaction rule, has important implications for software testing because it means that testing parameter combinations can provide more efficient fault detection than conventional methods. New algorithms compressing combinations into a small number of tests have made this method practical for industrial use, making it possible to do better testing at lower cost.


For more information regarding the Automated Combinatorial Testing for Software (ACTS), please visit the Computer Security Resource Center (CSRC)..

Created June 16, 2009, Updated March 19, 2018