TDT98 Score changes between v0.6 and v1.0
TDT98 Score changes between v0.6 and v1.0
Date: May 21, 1999
This table represents the changes in scores between TDT2eval_v0.6 and TDT3eval_v1.0. The results listed below are for the required tracking condition, processing the Newswire and ASR transcripts, with the 10 source file decision deferral period.
| System
| Story Weighted
| Topic Weighted
|
| Cdet
| P(Fa)
| P(Miss)
| Cdet
| P(Fa)
| P(Miss)
|
| v1.0 | v0.6 | v1.0 | v0.6 | v1.0 | v0.6 | v1.0 | v0.6 | v1.0 | v0.6 | v1.0 | v0.6
|
| BBN1 | 0.0040 | 0.0039 | 0.0021 | 0.0022 | 0.0941 | 0.0884 | 0.0047 | 0.0046 | 0.0021 | 0.0022 | 0.1295 | 0.1220 |
| CIDR1 | 0.0095 | 0.0093 | 0.0018 | 0.0018 | 0.3861 | 0.3780 | 0.0084 | 0.0083 | 0.0018 | 0.0018 | 0.3309 | 0.3257 |
| CIDR2 | 0.0077 | 0.0075 | 0.0014 | 0.0015 | 0.3164 | 0.3056 | 0.0077 | 0.0076 | 0.0014 | 0.0015 | 0.3139 | 0.3088 |
| CIDR3 | 0.0077 | 0.0075 | 0.0014 | 0.0014 | 0.3178 | 0.3064 | 0.0072 | 0.0071 | 0.0014 | 0.0014 | 0.2905 | 0.2861 |
| CIDR4 | 0.0114 | 0.0112 | 0.0014 | 0.0013 | 0.5045 | 0.4924 | 0.0077 | 0.0076 | 0.0014 | 0.0013 | 0.3201 | 0.3127 |
| CMU1 | 0.0075 | 0.0076 | 0.0004 | 0.0004 | 0.3526 | 0.3575 | 0.0057 | 0.0056 | 0.0004 | 0.0004 | 0.2644 | 0.2586 |
| Dragon1 | 0.0045 | 0.0044 | 0.0013 | 0.0013 | 0.1638 | 0.1563 | 0.0048 | 0.0048 | 0.0013 | 0.0013 | 0.1787 | 0.1736 |
| IBM1 | 0.0046 | 0.0045 | 0.0007 | 0.0008 | 0.1965 | 0.1822 | 0.0042 | 0.0041 | 0.0007 | 0.0008 | 0.1766 | 0.1629 |
| UIowa1 | 0.0129 | 0.0117 | 0.0009 | 0.0009 | 0.6028 | 0.5396 | 0.0095 | 0.0093 | 0.0009 | 0.0009 | 0.4311 | 0.4214 |
| UMass1 | 0.0040 | 0.0039 | 0.0022 | 0.0023 | 0.0913 | 0.0831 | 0.0064 | 0.0063 | 0.0023 | 0.0023 | 0.2091 | 0.2036 |
| UMass2 | 0.0073 | 0.0073 | 0.0020 | 0.0021 | 0.2690 | 0.2584 | 0.0055 | 0.0056 | 0.0020 | 0.0021 | 0.1758 | 0.1723 |
| UMass3 | 0.0067 | 0.0066 | 0.0008 | 0.0008 | 0.2962 | 0.2896 | 0.0077 | 0.0076 | 0.0008 | 0.0009 | 0.3416 | 0.3361 |
| UMass4 | 0.0040 | 0.0039 | 0.0022 | 0.0023 | 0.0913 | 0.0831 | 0.0064 | 0.0063 | 0.0023 | 0.0023 | 0.2091 | 0.2036 |
| UPenn1 | 0.0070 | 0.0069 | 0.0011 | 0.0011 | 0.2997 | 0.2919 | 0.0063 | 0.0062 | 0.0011 | 0.0011 | 0.2617 | 0.2577 |