Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

TREC Video Retrieval Evaluation Website

Published

Author(s)

Paul D. Over

Abstract

This paper demonstrates that, for large-scale tests, the match and non-match similarity scores have no specific underlying distribution function. The forms of these distribution functions require a nonparametric approach for the analysis of the fingerprint similarity scores. In this paper, we present an analysis of the discrete distribution functions of the match and non-match similarity scores of the fingerprint data that clarifies the widely varying form of these distribution functions. This analysis demonstrates that a precise Receiver Operating Characteristic (ROC) curve based on the True Accept Rate (TAR) of the match similarity scores and the False Accept Rate (FAR) of the non-match similarity scores can be constructed without any assumption regarding operating thresholds or the form of the distribution functions. The area under such a ROC curve, assuming normality, is equivalent to the Mann-Whitney statistic directly formed from the match and non-match similarity scores. In addition, the Z statistic computed using the areas under ROC curves along with their variances is applied to test the significance of the difference between two ROC curves. Four examples than from NIST's extensive testing of commercial fingerprint systems are provided. The nonparametric approach presented in this article can also be employed in the analysis of other biometric data.
Citation
NISTIR

Citation

Over, P. (2000), TREC Video Retrieval Evaluation Website, NISTIR, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=150297, http://www.itl.nist.gov/iad/894.02/projects/trecvid/ (Accessed November 12, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created November 1, 2000, Updated February 19, 2017