NIST logo

Publication Citation: Reliability of Conformance Tests

NIST Authors in Bold

Author(s): Robert C. Hagwood; Raghu N. Kacker; James H. Yen; D L. Banks; Lynne S. Rosenthal; Leonard J. Gallagher; Paul E. Black;
Title: Reliability of Conformance Tests
Published: August 21, 1998
Abstract: A conformance test is a software assurance test that is applied in order to determine if specification requirements of the software are being met. It is a time-dependent model, where the software object is subjected to an a priori known test suite. The reliability of the software is the proability that it will function properly for the values in the input space. Because the input space is usually very large, it is impossible to sample all input values, so in order to provide better sampling coverage, the input space is partitioned into homogeneous subspaces. Samples are drawn from each subspace for testing the software. The conformance tests based on these samples are required to pass all tests in the test suite. Based on these data, the classical statistical estimate of reliability is one. Such an estimate may be unrealistic if the sample sizes are not large. Even in such a scenario a nontrivial confidence interval is provided for the reliability.
Conference: COMPSAC
Proceedings: Proceedings of the COMPSAC 98 Software Conference
Location: Vienna, AU
Dates: August 21-24, 1998
Keywords: binomial;conformance;reliability;software;tests
Research Areas: