Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Analysis of the Second Phase of the 2013-2014 i-Vector Machine Learning Challenge



Desire Banse, G R. Doddington, Craig Greenberg, John M. Howard, Alvin F. Martin, Daniel Garcia-Romero, John J. Godfrey, Jaime Hernandez-Cordero, Lisa Mason, Alan McCree, Douglas A. Reynolds


In late 2013 and 2014, the National Institute of Standards and Technology (NIST) coordinated an i-vector challenge utilizing data from previous NIST Speaker Recognition Evaluations. Following the evaluation period, a second phase of the challenge was held, where speaker labels were made available for system development. The second phase included system submissions from 23 participants representing 13 different countries, of which 18 also participated in the first phase of the challenge. The top 10 systems participating in both of the challenge phases demonstrated an average relative improvement of approximately 26% between the first and second phases, which represents the value of having access to the speaker labels. The top five participants submitted a system that outperformed the oracle system from the first phase on the evaluation data.
Proceedings Title
Interspeech 2015
Conference Dates
September 6-10, 2015
Conference Location
Dresden, DE


i-vector challenge, speaker recognition evaluation, SRE


Banse, D. , Doddington, G. , Greenberg, C. , Howard, J. , Martin, A. , Garcia-Romero, D. , Godfrey, J. , Hernandez-Cordero, J. , Mason, L. , McCree, A. and Reynolds, D. (2015), Analysis of the Second Phase of the 2013-2014 i-Vector Machine Learning Challenge, Interspeech 2015, Dresden, DE (Accessed June 20, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created September 9, 2015, Updated October 12, 2021