NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Applying Automated Metrics to Speech Translation Dialogs

Published

Author(s)

Sherri Condon, Jon Phillips, Christy Doran, John Aberdeen, Dan Parvaz, Beatrice Oshika, Gregory A. Sanders, Craig I. Schlenoff

Abstract

Over the past five years, the Defense Advanced Research Projects Agency (DARPA) has funded development of speech translation systems for tactical applications. A key component of the research program has been extensive system evaluation, with dual objectives of assessing progress overall and comparing among systems. This paper describes evaluation methods and measures, and presents results from the January 2007 evaluation of English-Iraqi Arabic systems. The results demonstrate the value of obtaining multiple perspectives from a variety of analyses. A companion report details the methods used to obtain BLEU, TER, and METEOR scores for the systems and discusses issues concerning the relation between development data and evaluation methods.
Proceedings Title
Proceedings of the 2008 LREC (Language Resources and Evaluation Conference)
Conference Dates
May 28-30, 2008
Conference Location
Morocco, US
Pub Type
Conferences

Download Paper

Local Download

Keywords

TRANSTAC, speech to speech translation, DARPA, Arabic
Manufacturing systems design and analysis

Citation

Condon, S. , Phillips, J. , Doran, C. , Aberdeen, J. , Parvaz, D. , Oshika, B. , Sanders, G. and Schlenoff, C. (2008), Applying Automated Metrics to Speech Translation Dialogs, Proceedings of the 2008 LREC (Language Resources and Evaluation Conference), Morocco, US, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=824596 (Accessed October 8, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created June 29, 2008, Updated October 12, 2021
Was this page helpful?