Skip to main content

NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Eval-ware: Multimodal Interaction

Published

Author(s)

John S. Garofolo, Richard T. Rose, Rainer Stiefelhagen

Abstract

This paper is a review of multimodal programs, their evaluations, and online resources. For several years, research in unimodal recognition technologies has been evolving, and has been steadily driven by evaluations. As these technologies mature, new research challenges require fusing/integrating information across different modalities for tasks that are inherently multimodal. To address this, several multimodal evaluations have been established, described below. Web sites are provided where possible for each of the evaluations; while evaluation resources may not be available online, they are generally available through participation in the evaluations.
Citation
IEEE Society for Signal Processing (best of the web series) Journal

Keywords

Audio, Multimodal interaction, Speech recognition, Video

Citation

Garofolo, J. , Rose, R. and Stiefelhagen, R. (2007), Eval-ware: Multimodal Interaction, IEEE Society for Signal Processing (best of the web series) Journal, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=50894 (Accessed October 10, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created March 5, 2007, Updated January 27, 2020
Was this page helpful?