Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Significance Test in Operational ROC Analysis

Published

Author(s)

Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker, Robert C. Hagwood

Abstract

To evaluate the performance of fingerprint-image matching algorithms on large datasets, a receiver operating characteristic (ROC) curve is applied. From the operational perspective, the true accept rate (TAR) of the genuine scores at a specified false accept rate (FAR) of the impostor scores and/or the equal error rate (EER) are often employed. Using the standard errors of these metrics computed using the nonparametric two-sample bootstrap based on our studies of bootstrap variability on large fingerprint datasets, the significance test is performed to determine whether the difference between the performance of one algorithm and a hypothesized value, or the difference between the performances of two algorithms where the correlation is taken into account is statistically significant. In the case that the alternative hypothesis is accepted, the sign of the difference is employed to determine which is better than the other. Examples are provided.
Proceedings Title
SPIE Biometrics 2010
Volume
7667
Conference Dates
April 5-9, 2010
Conference Location
Orlando, FL
Conference Title
Biometric Technology for Human Identification VII

Keywords

Receiver operating characteristic (ROC) curve, Fingerprint, Biometrics, Nonparametric bootstrap, Standard error, Confidence interval, Significance test, Comparison

Citation

, J. , Martin, A. , Kacker, R. and Hagwood, R. (2010), Significance Test in Operational ROC Analysis, SPIE Biometrics 2010, Orlando, FL, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=903768 (Accessed April 13, 2024)
Created April 5, 2010, Updated February 19, 2017