Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Confirming a Performance Threshold with a Binary Experimental Response

Published

Author(s)

Dennis D. Leber, Leticia S. Pibida, Alexander L. Enders

Abstract

Often, experimenters wish to confirm that a test artifact meets some predefined, fixed performance criterion or claim. For example: does the newly formulated pharmaceutical reduce the disease rate by 10 %; will the composite overwrapped pressure vessel fail prior to the completion of the 15-year space mission; or, can the radiation detection system detect the specified radiological source with at least 80 % probability? The answers to these questions are a simple yes or no, but because of the inherent uncertainty in the measurements used in the assessment, there is a risk of answering the question incorrectly. This chapter provides guidance on developing an experimental sample size and acceptance criterion to determine whether a test artifact satisfies a predefined and fixed performance criterion when the response variable observed is binary, such as a success or failure to detect. We provide a sample size and rejection criterion table to define a fixed sample test that will satisfy a variety of performance thresholds and levels of acceptable risk. We conclude with a general discussion of sequential sampling tests and provide important considerations and contrasts to their fixed sample counterparts.
Citation
Technical Note (NIST TN) - 2045
Report Number
2045

Keywords

hypothesis testing, sample size, sequential test, binary response, radiation detection
Created July 15, 2019