Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

OpenMT Challenge 2015

NIST Open Machine Translation 2015 Challenge

Inspired by the success of the NIST Speaker and Language i-Vector Challenge, the NIST OpenMT evaluation series is bringing to you the Machine Translation Challenge. The goal of the Challenge is to lower the entry bar to the evaluation to attract wider participation. The Challenge follows a similar protocol as the traditional OpenMT evaluation, but with a flexible schedule to allow maximum participation. The Challenge will be up for six months instead of just one week. A leaderboard will track the performance. Score feedback will be provided for 40% of the test set, and participants can submit up to 5 submissions per day.

The Challenge will use data from the OpenMT15 evaluation, which focuses on informal data genres (SMS/Chat and Conversational Telephone Speech) in Arabic-to-English and Chinese-to-English.

The challenge is described in detail in the evaluation plan. To register for the challenge, visit here.

Schedule (tentative)

  • Challenge opens: November 18, 2015
  • System description due one month after the first submission or May 18, 2016 whichever is first
  • Challenge closes: May 30, 2016

Contact

mt_poc@nist.gov

[ Main ]

Created September 11, 2015, Updated August 25, 2016