Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Insights From the Broadcast News Benchmark Tests



Walter S. Liggett Jr, W M. Fisher


The broadcast news benchmark tests have potential as a source of ideas for improving continuous speech recognition systems. This paper presents a data analysis method for uncovering such ideas and applies the method to the 1996 and 1997 DARPA CSR Hub-4 results. The method is based on a latent variables model instead of a more familiar regression model. The method identifies certain portions of the test material that result in wide performance differences among system. Such portions, because some systems could handle them and others could not, are worth thinking about in terms of what system features lead to the performance differences. Identification of specific system differences that are responsible for performance differences may lead to system improvements.
Proceedings Title
Conference Dates
February 8-11, 1998
Conference Title
DARPA Broadcast News Transcription and Understanding Workshop


benchmarking, evaluation, multivariate analysis, speech recognition, statistical analysis, system comparison, two-way tables


Liggett, W. and Fisher, W. (1998), Insights From the Broadcast News Benchmark Tests, Proceedings (Accessed July 15, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created June 8, 1998, Updated February 17, 2017