February 5, 2008 TRECVid Event Detection: Candidate Events Scale (applies to both the anticipated annotation accuracy and automatic detection accuracy): 5- Expect a high level of accuracy 4- Expect medium-to-high accuracy 3- Expect low-to-medium accuracy 2- Expect low accuracy 1- Expect zero (0) accuracy, but feasible next year 0- Expect zero (0) accuracy, not feasible for 2+ years NA- not an appropriate event | A2 A3 A4 A5 Aavg Ares T0 T1 T2 T3 T4 T5 Tavg Tres ----+---------------------------------------------------------------------- E01 | 1 13 4.9 14 1 2 4 6 4.2 13 E02 | 1 1 2 10 4.5 14 3 7 3 3.0 13 E03 | 1 1 6 6 4.2 14 1 6 6 3.4 13 E04 | 1 5 8 4.5 14 1 4 6 2 2.6 13 E05 | 1 3 10 4.6 14 2 2 8 1 3.6 13 E06 | 2 6 6 3.3 14 5 6 2 0.8 13 E07 | 1 5 6 4.4 12 4 5 3 2.9 12 E08 | 2 7 5 4.2 14 1 3 7 2 2.8 13 E09 | 1 7 6 4.4 14 1 2 7 3 2.9 13 E10 | 8 6 4.4 14 1 3 5 4 3.9 13 E11 | 4 9 4.7 13 5 7 1 2.7 13 E12 | 3 10 4.8 13 5 7 1 2.7 13 E13 | 1 2 3 7 4.2 13 3 6 3 3.0 12 E14 | 1 2 9 2 3.9 14 3 5 4 1 2.2 13 E15 | 1 3 10 3.6 14 3 6 3 1 2.2 13 E16 | 1 10 3 4.1 14 2 3 6 2 1.6 13 E17 | 4 5 4 1 3.1 14 6 3 2 1 1 1.2 13 E18 | 1 3 5 5 4.0 14 3 3 6 1 2.4 13 E19 | 1 7 5 4.3 13 6 6 2.5 12 E20 | 2 4 8 4.4 14 1 6 3 3 2.6 13 --------------------------------------------------------------------------- Legend: A* expected annotation accuracy Aavg average of expected level of accuracy Ares number of responses, annotation T* expected automatic detection accuracy Tavg average of expected level of accuracy Tres number of responses, automatic detection --------------------------------------------------------------------------- Comments: E10 Comments: "yellow" - asking for problems based on disagreements on colors - yellow, yellowgreen,... Maybe we given an examplet to systems? E13 Comments: "waiting in an area" - sitting? standing? pacing? If moving, then question of size of "area" will come up! E13 Comments: This is difficult to define. We would have to say specifically : Not standing/sitting in designated waiting area. But if someone was near the waiting area.. borderline. E13 Comment: Ill defined action, hard to estimate complexity E14 Comments: It can be hard to tell when people were already in a group together, and when they are forming a group. I would expect lower consistency on this, unless we can define so only the really obvious cases count (like ones that overlap with hugging event) E15 Comments: "group" - group = 2 or more people? E16 Comments: "hugs" = person puts one or both arms around someone? E17 Comments: "exchange" implies two objects - maybe you mean "gives an object to someone" E19 Comments: "does NOT use it" - is this true while I am standing waiting for the door to open or only when the door opens and I don't get in? E19 Comment: ill defined action, does the person go near the elevator, stand in front of it? Do we know where the elevator is. 0 if we don't know about the elevator, 3 if we do E20 Comments: This might be difficult to define. There may be doors that aren't E20 Comment: ill-defined, do we know what the normal flow of traffic is, is normal defined momentarily or by observation over long period or by a no-entrance sign? --------------------------------------------------------------------------- Suggested events: A person suddenly change his walking speed Counting (unique) people who pass by a designated area during a specific time duration A policemen appears (with or without a bicycle) Taxi/limo driver waiting for passengers Family/friends waiting for passengers People pushing trolleys People carrying wheeled luggage People carrying backpacks/briefcases Person using a laptop Person searching for items in a purse/briefcase Entering/exiting the scene Reading a book/newspaper Waving to another person -------- Event E1. Description: Door opening Event E2. Description: Child walking Event E3. Description: A person walking with large piece of luggage Event E4. Description: A person uses the ATM Event E5. Description: A person runs Event E6. Description: Person using cell phone Event E7. Description: Person reverses direction (turning around) Event E8. Description: Person drops an object Event E9. Description: Person picks up an object Event E10. Description: Person in yellow vest appears Event E11. Description: Someone sits down. Event E12. Description: Someone stands up. Event E13. Description: A person is "loitering", meaning they are waiting in an area for a certain amount of time (e.g., more than 1 minute) Event E14. Description: A meeting between two or more people occurs, forming a group for the first time Event E15. Description: A group splits up Event E16. Description: A person hugs someone Event E17. Description: A person exchanges an object with someone Event E18. Description: Someone points Event E19. Description: A person goes to the elevator and does NOT use it Event E20. Description: A person moves through a door opposite to the normal flow of traffic Event E21. Description: Any event not listed above that you would like included (please provide a description).