This evaluation is intended to help promote technology development for event detection in video surveillance. The goal is to leverage machine learning techniques for detecting a pre-defined set of events. This evaluation task focuses on detecting events in airport surveillance video. We have a mailing list for announcements/discussion -- contact travis.rose@nist.gov and jonathan.fiscus@nist.gov to subscribe.

Evaluation Planning

As we write the evaluation plan, we will be asking for input from the research community. Planning telecons will be held during the following dates/times:

• Minutes of the Jan. 16, 2008 telecon
• Minutes of the Jan. 23, 2008 telecon
• Minutes of the Jan. 30, 2008 telecon
• Minutes of the Feb. 6, 2008 telecon
• Minutes of the Feb. 13, 2008 telecon
• Minutes of the Feb. 27, 2008 telecon
• Minutes of the March 19, 2008 telecon
• Minutes of the March 27, 2008 telecon

The evaluation plan is evolving and the following resources are available:

• Initial Discussion Documents:
  • The following slides outline several factors of the evaluation which we plan to discuss.
  • These slides outline some additional considerations of the evaluation protocol.
• Evaluation Plans:
  As the evaluation plan changes, two versions will be published: a normal text version and a comparison document. The comparison document will contrast the latest version with the previous version to focus the reader on recent changes.

  Normal Text Version	Comparisons Document
  Straw Man Proposal - V1
  Eval Plan - V2	V1 compared to V2
  Eval Plan - V3
  Eval Plan - V4

• Event Definitions:
  • The following table lists 20 candidate events and responses from the forum.
  • The following paper EventDet-ViPER-format-v3.pdf documents XML Schema Definition (XSD) proposed for a ViPER XML Representation of Events.
  • The following TrecVid08_XSD_v2.tar includes the XSD and a sample XML file.
  • An annotation guidelines document TRECVid08_Guidelines_v1.6.pdf is now available.

Data Resources

A TRECVid Event Detection microcorpus is now available. Please contact travis.rose@nist.gov and jonathan.fiscus@nist.gov for details.

Related

TRECVid Home Page