Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Translation Adequacy and Preference Evaluation Tool (TAP-ET)



Mark A. Przybocki, Kay Peterson, P. S. Bronsart


Evaluation of Machine Translation (MT) technology is often tied to the requirement for tedious manual judgments of translation quality. While automated MT metrology continues to be an active area of research, a well known and often accepted standard metric is the manual human assessment of adequacy and fluency. There are several software packages (RWTH, 2000) (LDC, 2005) that have been used to facilitate these judgments, but for the 2008 NIST Open MT Evaluation (NIST, 2008), NIST s Speech Group created an online software tool to accommodate the requirement for centralized data and distributed judges. This paper introduces the NIST TAP-ET application and reviews the reasoning underlying its design. Where available, analysis of data sets judged for Adequacy and Preference using the TAP-ET application will be presented. TAP-ET is freely available and ready to download, and contains a variety of customizable features.
Conference Dates
May 28-30, 2008
Conference Location
Conference Title
The sixth international conference on Language Resources and Evaluation, LREC 2008


Machine Translation Evaluation, Evaluation Software, Human Assessments, Human Judgments, Adequacy, Preference


Przybocki, M. , Peterson, K. and Bronsart, P. (2008), Translation Adequacy and Preference Evaluation Tool (TAP-ET), The sixth international conference on Language Resources and Evaluation, LREC 2008, Marrekech, -1, [online], (Accessed July 23, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created May 28, 2008, Updated February 19, 2017