Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

NIST 2018 Speaker Recognition Evaluation

The 2018 speaker recognition evaluation (SRE18) is the next in an ongoing series of speaker recognition evaluations conducted by NIST since 1996. The objectives of the evaluation series are (1) to explore promising new ideas in speaker recognition, (2) to support the development of advanced technology incorporating these ideas, and (3) to measure and calibrate the performance of the current state of technology. The evaluations are intended to be of interest to all researchers working on the general problem of text-independent speaker recognition. To this end, the evaluation is designed to focus on core technology issues and to be simple and accessible to those wishing to participate.

SRE18 will be organized in a similar manner to SRE16, focusing on speaker detection over conversational telephone speech (CTS) collected outside North America. Again fixed and open training conditions will be offered to allow cross-system comparisons and to understand the effect of additional and unconstrained amounts of training data on system performance. There are, however, a few differences between SRE16 and SRE18. In particular, in addition to CTS recorded over a variety of handsets, voice over IP (VOIP) data, which is also collected outside North America, as well as audio from video (AfV) will be included as development and test material in SRE18.

Participation in SRE18 is open to all who find the evaluation of interest and are able to comply with the evaluation rules set forth in this plan. There is no cost to participate, but participating teams must be represented at the evaluation workshop to be held in Athens, Greece on December 16-17, 2018. More information about the evaluation and registration can be found in SRE18 plan:

SRE18 Evaluation Plan

Send comments to speaker_poc@nist.gov. A notice will go out to the mailing list and the web page will be updated when the evaluation plan becomes available.
Send email address to speaker_poc@nist.gov with request to be added to the mailing list to receive automatic updates.

Important Dates:

Milestone
Date
Evaluation plan published
April 2018
Registration period
May 31 - September 10, 2018
Training data available
May 31, 2018
Evaluation data available to participants
September 10, 2018
System output due to NIST
October 10, 2018
Preliminary results released
October 29, 2018
Post evaluation workshop co-located with SLT in Athens, Greece
December 16-17, 2018

 

Created April 13, 2018, Updated February 13, 2020