Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

The Evaluation of the Scoring Systems: The fixed effects model under known variances



Hugo Gasca-Aragon, David L. Duewer


A number of scoring systems for proficiency testing and interlaboratory comparison are in use by the metrology community. The choice of scoring system for a given study is often based on the study coordinator's experience and anecdotal knowledge, perhaps attributable to a historical lack of detailed and formal explanation about the foundation of these systems. This has influenced the development of new scoring systems, some of them departing from the well-established hypothesis testing theory. Often different scoring systems give different results not because one may be better than the others but because, as they are documented, the user cannot control the confidence level of the test. We present a formal evaluation of seven of these systems under the fixed effects model assuming known variances. Under these sound assumptions the systems analyzed all have the same statistical properties. Furthermore, these systems are all members of a family of systems based on strictly increasing functions in which the statistical decision problem is invariant. Under the fixed effects model with known variances, no scoring system can provide greater statistical power than the members of this family of systems. We apply these results to the lead content of water example provided in International Standard ISO 13528:2005(E) "Statistical methods for use in proficiency testing by interlaboratory comparisons."
Accreditation and Quality Assurance


proficiency testing, scoring systems, UMP test, MSE, unbiased test, fixed effects model


Gasca-Aragon, H. and Duewer, D. (2016), The Evaluation of the Scoring Systems: The fixed effects model under known variances, Accreditation and Quality Assurance, [online], (Accessed July 17, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 13, 2016, Updated October 12, 2021