TRECVID 2010 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms, and Metrics

Published

April 15, 2011

Author(s)

Paul D. Over, George M. Awad, Jonathan G. Fiscus, Brian Antonishek, Martial Michel, Alan Smeaton, Wessel Kraaij, Georges Quenot

Abstract

The TREC Video Retrieval Evaluation (TRECVID) 2010 was a TREC-style video analysis and retrieval evaluation, the goal of which remains to promote progress in content-based exploitation of digital video via open, metrics-based evaluation. Over the last 10 years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID is funded by the National Institute of Standards and Technology (NIST) and other US government agencies. Many organizations and individuals worldwide also contribute significant time and effort. In 2010, TRECVID turned to new and different data and to some new tasks. 73 teams from various research organizations --- 27 from Europe, 32 from Asia, 12 from North America, 1 from Africa, and 1 from South America --- completed one or more of six tasks: content-based copy detection, instance search, known-item search, semantic indexing, surveillance event detection, and multimedia event detection.

Citation

trecvid.nist.gov

Pub Weblink

http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html

Pub Type

Websites

Download Paper

Local Download

Keywords

evaluation, information retrieval, multimedia, TRECVID, video analysis, video retrieval

Citation

Over, P. , Awad, G. , Fiscus, J. , Antonishek, B. , Michel, M. , Smeaton, A. , Kraaij, W. and Quenot, G. (2011), TRECVID 2010 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms, and Metrics, trecvid.nist.gov, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=908206, http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html (Accessed October 8, 2025)