Skip to main content
U.S. flag

An official website of the United States government

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Comparing Instruments

Published

Author(s)

James H. Yen, Dennis D. Leber, Leticia S. Pibida

Abstract

This document details methods to compare instrument performance. Comparison methods for instruments outputting binary (0-1) responses as well as for instruments outputting continuous numeric responses are shown, first for two instruments and then for multiple instruments. Hypothesis tests and confidence intervals for instrument differences are demonstrated. Several nonparametric procedures are shown along with reasons why they might be needed. Finally, equivalence testing is demonstrated for those cases where testing for equivalence rather than for differences is indicated.
Citation
Technical Note (NIST TN) - 2106
Report Number
2106

Keywords

Analysis of variance (ANOVA), binomial test response, confidence interval, continuous test response, equivalence testing, hypothesis test, nonparametric tests, normal approximation, Student’s t test.
Created September 29, 2020, Updated September 30, 2020