The goal of the OpenASR (Open Automatic Speech Recognition) Challenge is to assess the state of the art of ASR technologies for low-resource languages.
The OpenASR Challenge is an open challenge created out of the IARPA (Intelligence Advanced Research Projects Activity) MATERIAL (Machine Translation for English Retrieval of Information in Any Language) program that encompasses more tasks, including CLIR (cross-language information retrieval), domain classification, and summarization. For every year of MATERIAL, NIST supports a simplified, smaller scale evaluation open to all, focusing on a particular technology aspect of MATERIAL. CLIR technologies were the focus of the first open challenge in 2019, OpenCLIR. In 2020, the focus is on ASR. The capabilities tested in the open challenges are expected to ultimately support the MATERIAL task of effective triage and analysis of large volumes of data, in a variety of less-studied languages.
The first OpenASR Challenge associated with MATERIAL, OpenASR20, is scheduled to open for registration in July 2020, with an evaluation period in November 2020. It will feature ASR evaluation opportunities for ten low-resource languages.
It is being implemented as a track of NIST’s OpenSAT (Open Speech Analytic Technologies) evaluation series, using the OpenSAT web server for registration, data access, submission, and scoring purposes.
The evaluation plan posted in the Documentation section below describes the OpenASR20 in detail.
Registration for the OpenASR20 Challenge is now open! Please visit https://sat.nist.gov/openasr20 to register.
Please email email@example.com for any questions or comments regarding the OpenASR Challenge.