Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Open Speech Analytic Technologies Pilot Evaluation OpenSAT Pilot

Published

Author(s)

Frederick R. Byers, Jonathan G. Fiscus, Seyed Omid Sadjadi, Gregory A. Sanders, Mark A. Przybocki

Abstract

Open Speech Analytic Technologies Pilot Evaluation (OpenSAT) is a new speech analytic technology evaluation series organized by NIST that will begin with a pilot evaluation in the Spring of 2017. The pilot includes three tasks: Speech Activity Detection (SAD), Key Word Search (KWS), and Automatic Speech Recognition (ASR), and will evaluate these speech analytics technologies across three data domains: i) low-resourced languages, ii) speech from video, and iii) public safety communications. The data selected for the OpenSAT evaluation series will target domains expected to be challenging for the current state of technology to process with high accuracy. The objective of the pilot evaluation is to establish baseline performance levels for existing speech analytics technologies (tasks) when exposed to a variety of challenging data domains.
Citation
Multimodal Information Group

Citation

Byers, F. , Fiscus, J. , , S. , Sanders, G. and Przybocki, M. (2019), Open Speech Analytic Technologies Pilot Evaluation OpenSAT Pilot, Multimodal Information Group, [online], https://www.nist.gov/sites/default/files/documents/2018/07/05/nist_2017_pilot_opensat_eval_plan_final.pdf (Accessed April 25, 2024)
Created February 27, 2019, Updated August 21, 2019