TRECVID 2011 -- An Overview of the Goals, Tasks, Data, Evaluation Mechanisms, and Metrics

Published

May 8, 2012

Author(s)

Paul D. Over, George M. Awad, Jonathan G. Fiscus, Brian Antonishek, Martial Michel, Alan Smeaton, Wessel Kraaij, Georges Quenot

Abstract

The TREC Video Retrieval Evaluation (TRECVID) 2011 was a TREC-style video analysis and retrieval evaluation, the goal of which remains to promote progress in content-based exploitation of digital video via open, metrics-based evaluation. Over the last ten years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID is funded by the NIST and other US government agencies. Many organizations and individuals worldwide contribute significant time and effort. TRECVID 2011 represented a continuation of the six tasks from 2010 with some new data. 60 teams from various research organizations --- 25 from Asia, 18 from Europe, 12 from North America, 2 from South America, and 3 from Australia --- completed one or more of six tasks: item content-based copy detection, instance search, known-item search, semantic indexing, surveillance event detection, and multimedia event detection.

Citation

TRECVID Publications

Pub Weblink

http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html

Pub Type

Websites

Download Paper

Local Download

Keywords

evaluation, information retrieval, multimedia, TRECVID, video

Citation

Over, P. , Awad, G. , Fiscus, J. , Antonishek, B. , Michel, M. , Smeaton, A. , Kraaij, W. and Quenot, G. (2012), TRECVID 2011 -- An Overview of the Goals, Tasks, Data, Evaluation Mechanisms, and Metrics, TRECVID Publications, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=911055, http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html (Accessed October 8, 2025)