NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.
Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.
An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Bootstrap Variability Studies in ROC Analysis on Large Datasets
Published
Author(s)
Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker
Abstract
The nonparametric two-sample bootstrap is employed to compute uncertainties of measures in receiver operating characteristic (ROC) analysis on large datasets in areas such as biometrics, and so on. In this framework, the bootstrap variability was empirically studied without a normality assumption, exhaustively in five scenarios involving both high- and low-accuracy matching algorithms. With a tolerance 0.02 of the coefficient of variation, it was found that 2000 bootstrap replications were appropriate for ROC analysis on large datasets in order to reduce the bootstrap variance and ensure the accuracy of the computation.
Citation
Communications in Statistics Part B-Simulation and Computation
, J.
, Martin, A.
and Kacker, R.
(2014),
Bootstrap Variability Studies in ROC Analysis on Large Datasets, Communications in Statistics Part B-Simulation and Computation, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=915595
(Accessed October 16, 2025)