======================================================= TAC KBP 2015 COLD START SLOT FILLING EVALUATION RESULTS ======================================================= Team ID: IITD_2015 Organization: Indian Institute of Technology, Delhi ************************************************************* Run ID: IITD_20151 Did the run access the live Web during the evaluation window: No Run Number of most similar Cold Start KB Construction task submission: NA Did the run extract relations from the Cold Start source corpus: Yes Did the run generate meaningful confidence values: No Slot Filling Evaluation: Metric Hop GoldT Submit Correct Incorrect Inexact PIncorrect Dup Right Wrong Prec Recall F1 CSSF micro 0 4840 245 141 83 21 0 9 132 113 0.5388 0.0273 0.0519 CSSF micro 1 3954 52 15 25 0 12 0 15 37 0.2885 0.0038 0.0075 CSSF micro ALL 8794 297 156 108 21 12 9 147 150 0.4949 0.0167 0.0323 LDC-MEAN macro 0 0.0528 LDC-MEAN macro 1 0.0016 LDC-MEAN macro ALL 0.0344 LDC-MAX micro 0 1268 75 41 24 10 0 2 39 36 0.5200 0.0308 0.0581 LDC-MAX micro 1 900 8 3 5 0 0 0 3 5 0.3750 0.0033 0.0066 LDC-MAX micro ALL 2168 83 44 29 10 0 2 42 41 0.5060 0.0194 0.0373 LDC-MAX macro 0 0.0595 LDC-MAX macro 1 0.0016 LDC-MAX macro ALL 0.0388