Development of Domain-Specific Scenarios for Training and Evaluation of Two-Way, Free Form, Spoken Language Translation Devices

Published

June 1, 2011

Author(s)

Brian A. Weiss, Marnie Menzel

Abstract

To create effective and accurate two-way, free form, spoken language translation devices, the technologies must have appropriate training data. The goal of the Defense Advanced Research Projects Agency Spoken Language Communication and Translation System for Tactical Use (TRANSTAC) program is to demonstrate capabilities to rapidly develop and field this technology, so speakers of different languages can communicate in real-world tactical situations. A critical component is to generate data sets to train and evaluate the technologies. A novel approach was developed to collect these data, employing innovative data-collection and evaluation scenarios. This article describes the scenario methodology used for the TRANSTAC data collections and evaluations.

Citation

International Test and Evaluation Association (ITEA) Journal

Volume

(31)1

Pub Type

Journals

Download Paper

Local Download

Keywords

Communication in tactical situations, data collection, evaluation, Iraqi Arabic speakers, language translation systems, spoken language, U.S. military personnel

Citation

Weiss, B. and Menzel, M. (2011), Development of Domain-Specific Scenarios for Training and Evaluation of Two-Way, Free Form, Spoken Language Translation Devices, International Test and Evaluation Association (ITEA) Journal, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=908369 (Accessed May 2, 2026)

Additional citation formats