U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Comparing Instruments

Published

Author(s)

James H. Yen, Dennis D. Leber, Leticia S. Pibida

Abstract

This document details methods to compare instrument performance. Comparison methods for instruments outputting binary (0-1) responses as well as for instruments outputting continuous numeric responses are shown, first for two instruments and then for multiple instruments. Hypothesis tests and confidence intervals for instrument differences are demonstrated. Several nonparametric procedures are shown along with reasons why they might be needed. Finally, equivalence testing is demonstrated for those cases where testing for equivalence rather than for differences is indicated.
Citation
Technical Note (NIST TN) - 2106
Report Number
2106
NIST Pub Series
Technical Note (NIST TN)
Pub Type
NIST Pubs

Download Paper

DOI Link

Keywords

Analysis of variance (ANOVA), binomial test response, confidence interval, continuous test response, equivalence testing, hypothesis test, nonparametric tests, normal approximation, Student’s t test.
Mathematics and statistics

Citation

Yen, J. , Leber, D. and Pibida, L. (2020), Comparing Instruments, Technical Note (NIST TN), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.TN.2106 (Accessed October 21, 2021)

Created September 29, 2020, Updated September 30, 2020