Analysis of the Second Phase of the 2013-2014 i-Vector Machine Learning Challenge

Published

September 10, 2015

Author(s)

Desire Banse, G R. Doddington, Craig Greenberg, John M. Howard, Alvin F. Martin, Daniel Garcia-Romero, John J. Godfrey, Jaime Hernandez-Cordero, Lisa Mason, Alan McCree, Douglas A. Reynolds

Abstract

In late 2013 and 2014, the National Institute of Standards and Technology (NIST) coordinated an i-vector challenge utilizing data from previous NIST Speaker Recognition Evaluations. Following the evaluation period, a second phase of the challenge was held, where speaker labels were made available for system development. The second phase included system submissions from 23 participants representing 13 different countries, of which 18 also participated in the first phase of the challenge. The top 10 systems participating in both of the challenge phases demonstrated an average relative improvement of approximately 26% between the first and second phases, which represents the value of having access to the speaker labels. The top five participants submitted a system that outperformed the oracle system from the first phase on the evaluation data.

Proceedings Title

Interspeech 2015

Conference Dates

September 6-10, 2015

Conference Location

Dresden, DE

Pub Type

Conferences

Keywords

i-vector challenge, speaker recognition evaluation, SRE

Citation

Banse, D. , Doddington, G. , Greenberg, C. , Howard, J. , Martin, A. , Garcia-Romero, D. , Godfrey, J. , Hernandez-Cordero, J. , Mason, L. , McCree, A. and Reynolds, D. (2015), Analysis of the Second Phase of the 2013-2014 i-Vector Machine Learning Challenge, Interspeech 2015, Dresden, DE (Accessed October 8, 2025)