|
Speech Group Home
Benchmark Tests
Tools
Test Beds
Publications
Links
Contacts
|
2000 Speaker Recognition Evaluation
The 2000 NIST Speaker Recognition evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.
Evaluation Documentation
The Evaluation Plan was last modified 01/18/2000 and contains full documentation regarding the 2000 NIST Speaker Recognition Evaluation.
Supporting documentation for the evaluation test material, NIST Speech Discs r65_1_1 through r65_9_1.
Protocol for submitting system results
Download the 2000 NIST Speaker Evaluation answer keys.
Supporting Ahumada DevTest Documentation
MIT-LL has provided a table documenting handset label type and probability for the Ahumada developtment data Format per line:
< basefilename > MALE 1 < HS > Pr(HS)
HS := CARB|ELEC
Schedule
- 03/31/2000 - Deadline for signing up to participate in the evaluation
- 04/17/2000 - Evaluation data to arrive at participating sites
- 05/08/2000 - Evaluation results due at NIST
- 06/12/2000 - Deadline for registration and payment for the Speaker Recognition Evaluation Workshop
Also available General Information regarding the workshop administrivia
- 06/26/2000-06/27/2000 - Two day Speaker Recognition Evaluation Workshop at the Maritime Institute of Technology
Evaluation Data
The development and evaluation data used for this evaluation is provided free of charge. To obtain these data, participants are required to sign limited license agreements which restrict the use of the data for this evaluation:
Participants which are not members of the LDC must complete the LDC's License Agreement and return it to the LDC
Participants performing the optional one-speaker detection task using the Spanish Ahumada data must complete the Ahumada License Agreement (Word Document, Postscript, or PDF) and return it to:
Dr. Javier Ortega-Garcia
EUIT Telecomunicacion - UPM
Ctra. Valencia km. 7
28031 Madrid
SPAIN
Scoring Software
Modified scoring software for the tasks of tracking and segmentation is now available. This version-0 of the scoring software is designed to work with the development test sets. The official software will be a more versatile package, and will be released with the results.
The generic segmentation scoring script which was used to evaluate the segmentation tasks of this evaluation, is now available.
[ SRE Home ]
Page Created: Month Day, Year
Last Updated:
December 26, 2007
|