John S. Garofolo, Richard T. Rose, Rainer Stiefelhagen
This paper is a review of multimodal programs, their evaluations, and online resources. For several years, research in unimodal recognition technologies has been evolving, and has been steadily driven by evaluations. As these technologies mature, new research challenges require fusing/integrating information across different modalities for tasks that are inherently multimodal. To address this, several multimodal evaluations have been established, described below. Web sites are provided where possible for each of the evaluations; while evaluation resources may not be available online, they are generally available through participation in the evaluations.
IEEE Society for Signal Processing (best of the web series) Journal
Audio, Multimodal interaction, Speech recognition, Video
, Rose, R.
and Stiefelhagen, R.
Eval-ware: Multimodal Interaction, IEEE Society for Signal Processing (best of the web series) Journal, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=50894
(Accessed December 9, 2023)