================================================================ TAC 2020 EPIDEMIC QUESTION ANSWERING EVALUATION RESULTS (TASK A) ================================================================ Team ID: nlm_lhc_qa Organization(s): Lister Cell National Center for Biomedical Communications, National Library of Medicine Run: nlm_lhc_qa_1 Query Metric Score Median Maximum EQ101 NDNS-Exact 0.2775 0.4974 0.6811 EQ101 NDNS-Partial 0.2637 0.4186 0.5638 EQ101 NDNS-Relaxed 0.2637 0.4186 0.5638 EQ102 NDNS-Exact 0.0000 0.3410 0.5418 EQ102 NDNS-Partial 0.0000 0.3115 0.4950 EQ102 NDNS-Relaxed 0.0000 0.3115 0.4950 EQ103 NDNS-Exact 0.1348 0.2500 0.3667 EQ103 NDNS-Partial 0.1255 0.2078 0.3048 EQ103 NDNS-Relaxed 0.1255 0.2078 0.3048 EQ104 NDNS-Exact 0.3016 0.4219 0.6273 EQ104 NDNS-Partial 0.3205 0.4080 0.6397 EQ104 NDNS-Relaxed 0.2811 0.4080 0.5977 EQ105 NDNS-Exact 0.3519 0.2766 0.7001 EQ105 NDNS-Partial 0.4207 0.2784 0.6617 EQ105 NDNS-Relaxed 0.4207 0.2784 0.6617 EQ106 NDNS-Exact 0.2277 0.4169 0.6451 EQ106 NDNS-Partial 0.1871 0.3377 0.5332 EQ106 NDNS-Relaxed 0.1860 0.3377 0.5225 EQ107 NDNS-Exact 0.0409 0.1240 0.1839 EQ107 NDNS-Partial 0.0395 0.1144 0.1695 EQ107 NDNS-Relaxed 0.0395 0.1144 0.1695 EQ108 NDNS-Exact 0.1696 0.3949 0.6287 EQ108 NDNS-Partial 0.1626 0.3380 0.5382 EQ108 NDNS-Relaxed 0.1502 0.3380 0.5382 EQ109 NDNS-Exact 0.7500 0.6309 1.0000 EQ109 NDNS-Partial 1.0000 0.7500 1.0000 EQ109 NDNS-Relaxed 1.0000 0.7500 1.0000 EQ110 NDNS-Exact 0.3108 0.3887 0.5470 EQ110 NDNS-Partial 0.2892 0.3022 0.4270 EQ110 NDNS-Relaxed 0.2754 0.2992 0.4210 EQ111 NDNS-Exact 0.1739 0.4480 0.5874 EQ111 NDNS-Partial 0.1505 0.3620 0.5094 EQ111 NDNS-Relaxed 0.1490 0.3688 0.5236 EQ112 NDNS-Exact 0.1788 0.5012 0.5953 EQ112 NDNS-Partial 0.2968 0.4338 0.5153 EQ112 NDNS-Relaxed 0.2806 0.4338 0.5153 EQ113 NDNS-Exact 0.0586 0.3610 0.5062 EQ113 NDNS-Partial 0.0715 0.3511 0.4923 EQ113 NDNS-Relaxed 0.0715 0.3511 0.4923 EQ114 NDNS-Exact 0.0611 0.3145 0.6719 EQ114 NDNS-Partial 0.0590 0.3039 0.6492 EQ114 NDNS-Relaxed 0.0590 0.3039 0.6492 EQ115 NDNS-Exact 0.1359 0.1533 0.2688 EQ115 NDNS-Partial 0.1366 0.1461 0.2561 EQ115 NDNS-Relaxed 0.1370 0.1466 0.2570 EQ116 NDNS-Exact 0.0980 0.2327 0.3331 EQ116 NDNS-Partial 0.0936 0.2058 0.2946 EQ116 NDNS-Relaxed 0.0936 0.2058 0.2946 EQ117 NDNS-Exact 0.1500 0.3511 0.5322 EQ117 NDNS-Partial 0.1528 0.3715 0.6085 EQ117 NDNS-Relaxed 0.1498 0.3715 0.6085 EQ118 NDNS-Exact 0.1390 0.5646 0.6908 EQ118 NDNS-Partial 0.1213 0.4360 0.5335 EQ118 NDNS-Relaxed 0.1213 0.4360 0.5335 EQ119 NDNS-Exact 0.2408 0.2868 0.4027 EQ119 NDNS-Partial 0.2260 0.2263 0.3067 EQ119 NDNS-Relaxed 0.2221 0.2244 0.3067 EQ120 NDNS-Exact 0.2684 0.5027 0.7176 EQ120 NDNS-Partial 0.2852 0.4740 0.6767 EQ120 NDNS-Relaxed 0.2854 0.4798 0.6849 EQ121 NDNS-Exact 0.0787 0.3903 0.4689 EQ121 NDNS-Partial 0.0852 0.3819 0.4589 EQ121 NDNS-Relaxed 0.0852 0.3819 0.4589 EQ122 NDNS-Exact 0.2440 0.2465 0.3862 EQ122 NDNS-Partial 0.2189 0.2078 0.3409 EQ122 NDNS-Relaxed 0.2143 0.2092 0.3244 EQ123 NDNS-Exact 0.3660 0.5079 0.6317 EQ123 NDNS-Partial 0.3732 0.3934 0.4892 EQ123 NDNS-Relaxed 0.3663 0.3943 0.4904 EQ124 NDNS-Exact 0.0000 0.4694 0.6163 EQ124 NDNS-Partial 0.0000 0.4035 0.5298 EQ124 NDNS-Relaxed 0.0000 0.4035 0.5298 EQ125 NDNS-Exact 0.0799 0.3250 0.8570 EQ125 NDNS-Partial 0.0671 0.2731 0.7201 EQ125 NDNS-Relaxed 0.0671 0.2731 0.7201 EQ126 NDNS-Exact 0.3484 0.2966 0.6099 EQ126 NDNS-Partial 0.3017 0.2396 0.4927 EQ126 NDNS-Relaxed 0.3021 0.2408 0.4952 EQ127 NDNS-Exact 0.4100 0.4034 0.5870 EQ127 NDNS-Partial 0.4581 0.3684 0.5060 EQ127 NDNS-Relaxed 0.4543 0.3737 0.5160 EQ128 NDNS-Exact 0.2806 0.3416 0.4318 EQ128 NDNS-Partial 0.2611 0.2551 0.3393 EQ128 NDNS-Relaxed 0.2514 0.2555 0.3331 EQ129 NDNS-Exact 0.0849 0.1448 0.3360 EQ129 NDNS-Partial 0.0940 0.1205 0.2868 EQ129 NDNS-Relaxed 0.0894 0.1205 0.2868 EQ130 NDNS-Exact 0.3071 0.4404 0.6946 EQ130 NDNS-Partial 0.4250 0.4535 0.6946 EQ130 NDNS-Relaxed 0.4250 0.4535 0.6946 MEAN NDNS-Exact 0.2090 0.3802 0.4207 MEAN NDNS-Partial 0.2229 0.3377 0.3699 MEAN NDNS-Relaxed 0.2189 0.3387 0.3709 *******************************************************