Skip to main content

NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Bootstrap Variability Studies in ROC Analysis on Large Datasets

Published

Author(s)

Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker

Abstract

The nonparametric two-sample bootstrap is employed to compute uncertainties of measures in receiver operating characteristic (ROC) analysis on large datasets in areas such as biometrics, and so on. In this framework, the bootstrap variability was empirically studied without a normality assumption, exhaustively in five scenarios involving both high- and low-accuracy matching algorithms. With a tolerance 0.02 of the coefficient of variation, it was found that 2000 bootstrap replications were appropriate for ROC analysis on large datasets in order to reduce the bootstrap variance and ensure the accuracy of the computation.
Citation
Communications in Statistics Part B-Simulation and Computation

Keywords

Bootstrap variability, Bootstrap replications, ROC analysis, Large datasets, Uncertainty, Biometrics

Citation

, J. , Martin, A. and Kacker, R. (2014), Bootstrap Variability Studies in ROC Analysis on Large Datasets, Communications in Statistics Part B-Simulation and Computation, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=915595 (Accessed October 16, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created March 19, 2014, Updated February 19, 2017
Was this page helpful?