NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Comparing Instruments

Published

Author(s)

James H. Yen, Dennis D. Leber, Leticia S. Pibida

Abstract

This document details methods to compare instrument performance. Comparison methods for instruments outputting binary (0-1) responses as well as for instruments outputting continuous numeric responses are shown, first for two instruments and then for multiple instruments. Hypothesis tests and confidence intervals for instrument differences are demonstrated. Several nonparametric procedures are shown along with reasons why they might be needed. Finally, equivalence testing is demonstrated for those cases where testing for equivalence rather than for differences is indicated.
Citation
Technical Note (NIST TN) - 2106
Report Number
2106
NIST Pub Series
Technical Note (NIST TN)
Pub Type
NIST Pubs

Download Paper

DOI Link

Keywords

Analysis of variance (ANOVA), binomial test response, confidence interval, continuous test response, equivalence testing, hypothesis test, nonparametric tests, normal approximation, Student’s t test.
Mathematics and statistics

Citation

Yen, J. , Leber, D. and Pibida, L. (2020), Comparing Instruments, Technical Note (NIST TN), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.TN.2106 (Accessed October 15, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created September 29, 2020, Updated September 30, 2020
Was this page helpful?