Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Open Keyword Search Evaluation

The objective of the Open Keyword Search Evaluation (OpenKWS) evaluation series is to support research in, and help advance the state of the art of, keyword search (KWS) technologies - technologies that locate a specified, potentially multi-word keyword in the specified language. The goal of the program is to reduce the difficulty of building high-performing KWS systems on a new language quickly with diminishing data resources and time.

The OpenKWS project is an extension of the 2006 Spoken Term Detection evaluation, which tested KWS systems on English, Mandarin, and Arabic recordings from Broadcast News, Conversational Telephone Speech (CTS), and conference meeting data. OpenKWS is a multi-year effort to test KWS systems on a new "Surprise" language each year. Participants will receive conversational telephone speech training, development, and testing resources each year for the language, but have a limited time to build their systems. At the conclusion of the evaluation, participants will be invited to an evaluation workshop held in the Washington DC Metro Area to discuss the results of the evaluation.

Past Surprise languages were Vietnamese, Tamil, and Swahili for 2013, 2014, and 2015 respectively. The next OpenKWS evaluation, OpenKWS16, takes place in the summer of 2016.

Contact

openkws-poc@nist.gov

 [ STD-2006 ] [ 2013 ] [ 2014 ] [ 2015 ] [ 2016 ]

Created January 18, 2013, Updated August 25, 2016