NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.
Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.
An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Ensuring Reliability Through Combinatorial Coverage Measures
Published
Author(s)
M S Raunak, D. Richard Kuhn, Raghu N. Kacker, Yu Lei
Abstract
A key question in software assurance is, "How much testing is enough?" Coverage criteria such as statement or branch coverage were developed to help answer this question, but we also need to measure whether tests are sufficiently representative of inputs that will be encountered in the real world. This article describes methods that provide quantitative measures of test input space coverage, to ensure that the system responds correctly and reliably to user interactions and the environmental conditions.
Raunak, M.
, Kuhn, D.
, Kacker, R.
and Lei, Y.
(2024),
Ensuring Reliability Through Combinatorial Coverage Measures, IEEE Reliability Magazine, [online], https://doi.org/10.1109/MRL.2024.3389629, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=957862
(Accessed October 9, 2025)