NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.
Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.
An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Evaluation of Fault Detection Effectiveness for Combinatorial and Exhaustive Selection of Discretized Test Inputs
Published
Author(s)
Carmelo Montanez-Rivera, David R. Kuhn, Mary C. Brady, Richard M. Rivello, Jenise Reyes Rodriguez, Michael K. Powers
Abstract
Testing components of web browsers and other graphical interface software can be extremely expensive because of the need for human review of screen appearance and interactive behavior. Combinatorial testing has been advocated as a method that provides strong fault detection with a small number of tests, although some authors have disputed its effectiveness. This paper compares the effectiveness of combinatorial test methods with exhaustive testing of discretized inputs for the Document Object Model Events standard. More than 36,000 tests all possible combinations of equivalence class values were reduced by more than a factor of 20 with an equivalent level of fault detection, suggesting that combinatorial testing is a cost-effective method of assurance for web-based interactive software.
Montanez-Rivera, C.
, Kuhn, D.
, Brady, M.
, Rivello, R.
, Reyes, J.
and Powers, M.
(2012),
Evaluation of Fault Detection Effectiveness for Combinatorial and Exhaustive Selection of Discretized Test Inputs, Software Quality Professional, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=909661
(Accessed October 9, 2025)