Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Human Assisted Speaker Recognition in NIST 2010 Speaker Recognition Evaluation



Alvin F. Martin, Craig S. Greenberg


The 2010 NIST Speaker Recognition Evaluation or SRE10 (see SLTC Newsletter, July 2010) included a pilot test of human assisted speaker recognition (HASR). This test, which was open to sites whether or not they participated in the main evaluation of fully automatic systems, involved utilizing human expertise in combination with automatic algorithms on a limited set of trials chosen to be particularly challenging. In this evaluation, with specially chosen difficult trials, there was no evidence of human expertise contributing to system performance. But this was only a pilot test on limited numbers of trials, with little overall statistical significance. The possible contributions of human expertise on less challenging trials were not investigated.
Speech and Language Processing Technical Committee Newsletter


human assisted speaker recognition, HASR, speaker recognition evaluation, NIST SRE


Martin, A. and Greenberg, C. (2010), Human Assisted Speaker Recognition in NIST 2010 Speaker Recognition Evaluation, Speech and Language Processing Technical Committee Newsletter, [online],, (Accessed July 17, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created June 30, 2010, Updated February 19, 2017