Skip to main content

NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Validation of Nonparametric Two-sample Bootstrap in ROC Analysis on Large Datasets

Published

Author(s)

Jin Chu Wu, Alvin F. Martin, Raghu N. Kacker

Abstract

The nonparametric two-sample bootstrap is applied to computing uncertainties of measures in receiver operating characteristic (ROC) analysis on large datasets in areas such as biometrics, speaker recognition, etc. when the analytical method cannot be used. Its validation was studied by computing the standard errors of the area under ROC curve using the well-established analytical Mann–Whitney statistic method and also using the bootstrap. The analytical result is unique. The bootstrap results are expressed as a probability distribution due to its stochastic nature. The comparisons were carried out using relative errors and hypothesis testing. These match very well. This validation provides a sound foundation for such computations.
Citation
Communications in Statistics Part B-Simulation and Computation
Issue
45

Keywords

Biometrics, Bootstrap, Large datasets, ROC analysis, Speaker recognition, Uncertainty, Validation

Citation

, J. , Martin, A. and Kacker, R. (2016), Validation of Nonparametric Two-sample Bootstrap in ROC Analysis on Large Datasets, Communications in Statistics Part B-Simulation and Computation, [online], https://doi.org/10.1080/03610918.2015.1065327 (Accessed October 2, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created May 26, 2016, Updated November 10, 2018
Was this page helpful?