Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Multimodal Information Group

We research and develop measurement and evaluation methods to advance and promote the use of technologies that provide more effective access to multimedia and multi-lingual information.

The group focuses on measurement and evaluation methods to facilitate the use of technologies that provide easier access to multimedia and multi-lingual information and that improve human-computer interface modalities. These technologies include recognizing and/or transforming information in speech, text, images, video, and other multimedia modalities, and the fusion of heterogeneous media content.  Focus areas include speech recognition, speaker recognition, language recognition, machine translation, image processing, image understanding, video processing, visual recognition, 2-D and 3D shape analysis, image quality assessment, and interoperable digital media access.

Projects and Programs

Data Science

The NIST Information Access Division (IAD) initiated a Data Science Research Program (DSRP) aimed to advance the measurement science for big data and data

Interdisciplinary Projects

Some of the Multimodal Information Group's project areas span across multiple research areas within the group or to other groups in IAD. These interdisciplinary

Speech Analytics

The Multimodal Information Group's speech analytics program has a long history of activities supporting the development of technologies that extract content

Machine Translation

The Multimodal Information Group's machine translation (MT) program includes several activities contributing to machine translation technology and metrology

Publications

A data science challenge for converting airborne remote sensing data into ecological information

Author(s)
Sergio Marconi, Sarah J. Graves, Dihong Gong, Shahriari Nia Morteza, Marion Le Bras, Bonnie J. Dorr, Peter C. Fontana, Justin Gearhart, Craig S. Greenberg, Dave J. Harris, Sugumar A. Kumar, Agarwal Nishant, Joshi Prarabdh, Sandeep U. Rege, Stephanie A. Bohlman, Ethan P. White, Daisy Z. Wang
In recent years ecology has reached the point where a data science competition could be very productive. Large amounts of open data are increasingly available

Open Speech Analytic Technologies Pilot Evaluation OpenSAT Pilot

Author(s)
Frederick R. Byers, Jonathan G. Fiscus, Seyed Omid Sadjadi, Gregory A. Sanders, Mark A. Przybocki
Open Speech Analytic Technologies Pilot Evaluation (OpenSAT) is a new speech analytic technology evaluation series organized by NIST that will begin with a

Contacts