The rows are the txt words. The columns are hyp words.
Resource summary:Txt: In Nigeria, by far the most populous country in sub-Saharan Africa, over 2.7 million people are infected with HIV.
Hyp: 2.7 percent of the people infected with HIV live in Africa. (don't know)
2.7 CD |
percent NN |
the DT |
people NNS |
infected VBN |
HIV NN |
live VB |
Africa NNP |
|
Nigeria:NNP | 20.50 | 10.12 | 20.50 | 9.33 | 14.83 | 10.40 | 14.59 | 7.69 |
far:RB | 18.88 | 12.71 | 20.00 | 13.10 | 17.92 | 15.50 | 20.00 | 15.50 |
the:DT | 20.50 | 20.50 | 0.00 | 20.00 | 20.00 | 20.50 | 18.57 | 20.50 |
most:RBS | 20.50 | 15.50 | 20.00 | 15.00 | 20.00 | 15.50 | 20.00 | 15.50 |
populous:JJ | 10.63 | 11.83 | 20.00 | 9.14 | 10.44 | 12.50 | 9.27 | 12.50 |
country:NN | 18.85 | 8.42 | 20.00 | 1.25 | 13.57 | 9.88 | 11.71 | 8.37 |
sub-Saharan_Africa:NN | 20.50 | 9.74 | 20.50 | 8.63 | 15.50 | 10.38 | 15.50 | 5.00 |
over:RB | 20.50 | 15.50 | 18.57 | 15.00 | 20.00 | 15.50 | 17.50 | 15.50 |
2.7:CD | 0.50 | 18.42 | 20.50 | 20.50 | 19.71 | 20.50 | 20.50 | 20.50 |
million:CD | 10.50 | 17.89 | 20.50 | 19.39 | 19.98 | 20.50 | 19.59 | 19.73 |
people:NNS | 20.50 | 7.81 | 20.00 | 0.00 | 11.11 | 9.58 | 10.83 | 8.46 |
are:VBP | 20.50 | 15.50 | 16.67 | 15.00 | 7.79 | 15.50 | 0.00 | 14.39 |
infected:VBN | 19.71 | 14.83 | 20.00 | 11.11 | 0.00 | 15.50 | 7.30 | 15.50 |
HIV:NN | 20.50 | 10.17 | 20.50 | 9.58 | 15.50 | 0.00 | 11.21 | 10.38 |
NO_WORD | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 10.00 | 10.00 | 10.00 |
Response: yes (INCORRECT)
Justification:
Features matched (wt val name just):
1.00 -3.06 Alignment.score
1.00 0.13 Alignment.isGood
-1.00 0.19 Alignment.isBad
-0.10 2.00 Alignment.nbWordNotAligned
0.10 5.00 Alignment.hypSpan
0.10 0.62 Alignment.txtSpan
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "Nigeria" modifying "infected" is dropped on aligned hypothesis word "infected"
-0.10 1.00 NullPunisher.article : the
-3.00 1.00 NullPunisher.entity : percent
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "sub-Saharan_Africa" <-prep_in-- "country" vs. hyp "Africa" <-prep_in-- "live", which aligned to text "are"
-2.00 1.00 Location.mismatch : Location mismatch: "Africa" is aligned to "sub-saharan_africa", but no known relationship.
Hand-tuned score (dot product of above): -10.3575
Threshold: -13.6364
Txt: Twenty years ago, on June 6, 1968, Sen. Robert F. Kennedy died at Good Samaritan Hospital in Los Angeles, 25 -LCB- hours after he was shot at the Ambassador Hotel by Sirhan Bishara Sirhan.
Hyp: Sirhan Bishara Sirhan killed Sen. Robert F. Kennedy (yes)
Sirhan_Bishara_Sirhan NNP |
killed VBD |
Sen. NNP |
Robert_F._Kennedy NNP |
|
Twenty:CD | 20.50 | 20.50 | 18.50 | 20.50 |
years:NNS | 10.50 | 13.64 | 6.79 | 8.61 |
ago:RB | 15.50 | 18.97 | 15.00 | 15.50 |
June:NNP | 10.50 | 15.50 | 7.97 | 9.25 |
6:CD | 20.50 | 20.50 | 20.50 | 20.50 |
1968:CD | 20.50 | 19.25 | 20.50 | 20.50 |
Sen.:NNP | 10.50 | 15.00 | 0.00 | 9.33 |
Robert_F._Kennedy:NNP | 10.00 | 15.50 | 9.33 | 0.00 |
died:VBD | 15.50 | 3.80 | 15.00 | 15.50 |
Good_Samaritan_Hospital:NNP | 9.14 | 15.50 | 10.50 | 10.50 |
Los_Angeles:NNP | 10.50 | 15.50 | 10.50 | 9.79 |
25:CD | 20.50 | 20.50 | 20.50 | 20.50 |
hours:NNS | 10.50 | 12.77 | 7.41 | 9.15 |
he:PRP | 12.50 | 13.82 | 10.82 | 2.50 |
was:VBD | 15.50 | 5.30 | 15.00 | 15.50 |
shot:VBN | 15.50 | 1.25 | 12.50 | 15.50 |
the:DT | 20.50 | 20.00 | 20.00 | 20.50 |
Ambassador_Hotel:NNP | 9.44 | 15.50 | 9.91 | 8.44 |
Sirhan_Bishara_Sirhan:NNP | 0.00 | 15.50 | 10.50 | 10.00 |
NO_WORD | 10.00 | 10.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -0.81 Alignment.score
1.00 0.60 Alignment.isGood
-1.00 0.02 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 4.00 Alignment.hypSpan
0.10 0.50 Alignment.txtSpan
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "Ambassador_Hotel" modifying "shot" is dropped on aligned hypothesis word "killed"
1.00 1.00 Factive.inPositiveEmbedding : embedded positive text
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "Robert_F._Kennedy" <-nsubj-- "died" vs. hyp "Robert_F._Kennedy" <-dobj-- "killed", which aligned to text "shot"
-3.00 1.00 Structure.parentsMismatch&Align.veryGood :
0.50 1.00 Adjunct.dropPosCxt&Align.veryGood :
Hand-tuned score (dot product of above): -2.7912
Threshold: -13.6364
Txt: The May 3 ferry sinking in the Meghna River that claimed the lives of at least 370 people is a reminder of the dangers inherent in this sort of travel.
Hyp: 100 or more people lost their lives in a ferry sinking. (yes)
100 CD |
or CC |
more JJR |
people NNS |
lost VBD |
their PRP$ |
lives NNS |
a DT |
ferry NN |
sinking NN |
|
The:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
May:MD | 20.50 | 10.50 | 19.07 | 20.50 | 20.50 | 20.50 | 20.50 | 10.50 | 20.50 | 20.50 |
3:CD | 10.45 | 20.50 | 12.50 | 20.50 | 18.83 | 20.50 | 20.50 | 20.50 | 20.50 | 20.49 |
ferry:NN | 19.06 | 20.00 | 10.89 | 8.72 | 15.00 | 10.00 | 9.32 | 20.00 | 0.00 | 9.87 |
sinking:VBG | 19.78 | 20.00 | 12.00 | 14.75 | 6.27 | 15.00 | 15.00 | 20.00 | 15.00 | 0.00 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
Meghna_River:NNP | 20.50 | 20.50 | 12.50 | 7.01 | 15.50 | 12.50 | 8.51 | 20.50 | 9.45 | 9.52 |
that:WDT | 20.50 | 10.00 | 20.00 | 20.00 | 17.50 | 16.67 | 20.00 | 10.00 | 20.00 | 20.00 |
claimed:VBD | 19.12 | 20.00 | 12.00 | 14.23 | 5.41 | 15.00 | 11.67 | 20.00 | 14.74 | 12.35 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
lives:NNS | 20.50 | 20.00 | 10.89 | 4.44 | 13.87 | 12.00 | 0.00 | 20.00 | 9.32 | 9.27 |
at:IN | 20.50 | 19.32 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 16.67 | 20.00 | 20.00 |
least:JJS | 12.50 | 20.00 | 10.00 | 11.09 | 6.44 | 15.00 | 10.00 | 20.00 | 10.00 | 12.00 |
370:CD | 5.00 | 20.50 | 12.50 | 20.37 | 20.50 | 20.50 | 20.50 | 20.50 | 19.16 | 20.50 |
people:NNS | 18.07 | 20.00 | 10.00 | 0.00 | 13.94 | 12.00 | 4.44 | 20.00 | 8.72 | 8.38 |
is:VBZ | 20.50 | 20.00 | 12.00 | 15.00 | 5.86 | 15.00 | 13.57 | 20.00 | 15.00 | 15.00 |
a:DT | 20.50 | 9.33 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 |
reminder:NN | 20.50 | 20.00 | 12.00 | 8.44 | 13.69 | 11.23 | 7.32 | 20.00 | 8.66 | 7.65 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
dangers:NNS | 20.50 | 20.00 | 12.00 | 7.62 | 15.00 | 12.00 | 7.26 | 20.00 | 8.94 | 8.57 |
inherent:VBN | 20.50 | 20.00 | 12.00 | 14.41 | 10.00 | 14.23 | 12.97 | 20.00 | 14.23 | 13.00 |
this:DT | 20.50 | 10.00 | 20.00 | 20.00 | 20.00 | 14.44 | 18.89 | 10.00 | 20.00 | 20.00 |
sort:NN | 20.50 | 16.67 | 7.00 | 5.99 | 10.00 | 12.00 | 7.94 | 20.00 | 8.89 | 8.64 |
travel:NN | 19.31 | 20.00 | 12.00 | 6.11 | 15.00 | 11.09 | 7.27 | 20.00 | 7.04 | 8.31 |
NO_WORD | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -4.94 Alignment.score
1.00 0.02 Alignment.isGood
-1.00 0.61 Alignment.isBad
-0.10 3.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.30 Alignment.txtSpan
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "Meghna_River" modifying "sinking" is dropped on aligned hypothesis word "sinking"
0.00 1.00 NegPolarity.txtNegWord : "least": tag "JJS" is in NegPolarityMarkers list
0.00 1.00 NegPolarity.txtNegRoot : "least": tag "JJS" is in NegPolarityMarkers list
-0.10 1.00 NullPunisher.functionWord : their
-1.00 1.00 NullPunisher.other : or
-0.10 1.00 NullPunisher.article : a
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "lives" <-dobj-- "claimed" vs. hyp "lives" <-dobj-- "lost", which aligned to text "least" args have different parents, different relations: text "people" <-prep_of-- "lives" vs. hyp "people" <-nsubj-- "lost", which aligned to text "least" args have different parents, different relations: text "sinking" <-partmod-- "ferry" vs. hyp "sinking" <-prep_in-- "lost", which aligned to text "least"
Hand-tuned score (dot product of above): -9.2007
Threshold: -13.6364
Txt: The Townsend Thoresen cross-Channel ferry Herald of Free Enterprise capsized outside the Belgian port of Zeebrugge on the 6th of March with the loss of 135 lives.
Hyp: 100 or more people lost their lives in a ferry sinking. (yes)
100 CD |
or CC |
more JJR |
people NNS |
lost VBD |
their PRP$ |
lives NNS |
a DT |
ferry NN |
sinking NN |
|
The:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
Townsend_Thoresen:JJ | 12.50 | 20.50 | 10.50 | 12.50 | 12.50 | 15.50 | 12.50 | 20.50 | 12.50 | 12.50 |
cross-Channel:JJ | 12.50 | 20.00 | 10.00 | 12.00 | 12.00 | 15.00 | 12.00 | 20.00 | 12.00 | 12.00 |
ferry:NN | 19.06 | 20.00 | 10.89 | 8.72 | 15.00 | 10.00 | 9.32 | 20.00 | 0.00 | 9.87 |
Herald_of_Free_Enterprise:NN | 20.50 | 20.50 | 12.50 | 8.88 | 15.50 | 12.50 | 9.77 | 20.50 | 9.64 | 10.27 |
capsized:VBD | 20.50 | 20.00 | 12.00 | 13.11 | 8.84 | 15.00 | 12.23 | 20.00 | 11.85 | 14.31 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
Belgian:JJ | 12.50 | 20.50 | 10.50 | 11.73 | 12.50 | 15.50 | 12.50 | 20.50 | 12.50 | 11.07 |
port:NN | 19.64 | 16.67 | 7.00 | 6.72 | 10.00 | 12.00 | 8.16 | 20.00 | 6.25 | 8.28 |
Zeebrugge:NNP | 20.50 | 20.50 | 12.50 | 9.83 | 15.50 | 12.50 | 10.50 | 20.50 | 10.50 | 10.50 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
6th:NN | 20.45 | 20.50 | 12.50 | 7.92 | 13.86 | 12.50 | 9.14 | 20.50 | 9.59 | 9.92 |
March:NNP | 20.50 | 20.50 | 9.17 | 7.80 | 15.50 | 12.50 | 9.06 | 20.50 | 8.50 | 9.88 |
with:IN | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 18.89 | 18.45 | 20.00 | 20.00 |
the:DT | 20.50 | 10.00 | 18.57 | 20.00 | 20.00 | 15.00 | 20.00 | 10.00 | 20.00 | 20.00 |
loss:NN | 19.68 | 20.00 | 9.50 | 6.53 | 2.50 | 12.00 | 6.67 | 20.00 | 9.28 | 8.18 |
135:CD | 4.12 | 20.50 | 12.50 | 19.25 | 19.20 | 20.50 | 20.28 | 20.50 | 18.15 | 20.50 |
lives:NNS | 20.50 | 20.00 | 10.89 | 4.44 | 13.87 | 12.00 | 0.00 | 20.00 | 9.32 | 9.27 |
NO_WORD | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.65 Alignment.score
1.00 0.00 Alignment.isGood
-1.00 0.90 Alignment.isBad
-0.10 3.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.30 Alignment.txtSpan
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "March" modifying "6th" is dropped on aligned hypothesis word "people"
-0.10 1.00 NullPunisher.article : a
-1.00 1.00 NullPunisher.other : or
-0.10 1.00 NullPunisher.functionWord : their
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "6th" <-prep_on-- "capsized" vs. hyp "people" <-nsubj-- "lost", which aligned to text "loss"
Hand-tuned score (dot product of above): -10.2155
Threshold: -13.6364
Txt: I ate cheese and bread.
Hyp: I ate bread. (yes)
I PRP |
ate VBD |
bread NN |
|
I:PRP | 0.00 | 15.00 | 12.00 |
ate:VBD | 15.00 | 0.00 | 12.30 |
cheese:NN | 12.00 | 13.17 | 0.99 |
bread:NN | 12.00 | 12.30 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -0.33 Alignment.score
1.00 0.70 Alignment.isGood
-1.00 0.02 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 1.00 Alignment.txtSpan
Hand-tuned score (dot product of above): 0.7602
Threshold: -13.6364
Txt: I ate cheese and carp.
Hyp: I ate carp. (yes)
I PRP |
ate VBD |
carp UH |
|
I:PRP | 0.00 | 15.00 | 17.60 |
ate:VBD | 15.00 | 0.00 | 18.57 |
cheese:NN | 12.00 | 13.17 | 17.76 |
carp:NNP | 12.00 | 13.57 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -0.67 Alignment.score
1.00 0.63 Alignment.isGood
-1.00 0.02 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.67 Alignment.txtSpan
-1.00 1.00 Structure.relMismatch : text "carp" is dobj of "ate" while hyp "carp" is dep of "ate" which aligned to text "ate"
Hand-tuned score (dot product of above): -0.6909
Threshold: -13.6364
Txt: I ate cheese and hummus.
Hyp: I ate hummus. (yes)
I PRP |
ate VBD |
hummus NNS |
|
I:PRP | 0.00 | 15.00 | 12.00 |
ate:VBD | 15.00 | 0.00 | 13.74 |
cheese:NN | 12.00 | 13.17 | 5.77 |
hummus:VBZ | 15.00 | 8.74 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -0.67 Alignment.score
1.00 0.63 Alignment.isGood
-1.00 0.02 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.67 Alignment.txtSpan
-1.00 1.00 Structure.relMismatch : text "hummus" is conj_and of "ate" while hyp "hummus" is dobj of "ate" which aligned to text "ate"
Hand-tuned score (dot product of above): -0.6909
Threshold: -13.6364
Txt: The cat napped.
Hyp: The cat slept. (yes)
The DT |
cat NN |
slept VBD |
|
The:DT | 0.00 | 20.00 | 20.00 |
cat:NN | 20.00 | 0.00 | 11.38 |
napped:VBD | 20.00 | 15.00 | 1.25 |
NO_WORD | 1.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -0.42 Alignment.score
1.00 0.69 Alignment.isGood
-1.00 0.02 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 1.00 Alignment.txtSpan
1.00 1.00 Hypernym.posWiden : Widening a term (from "nap" to "sleep") preserves truth in a positive context
Hand-tuned score (dot product of above): 1.6532
Threshold: -13.6364
Txt: I like Java.
Hyp: I like a programming language. (yes)
I PRP |
like VBP |
a DT |
programming_language NN |
|
I:PRP | 0.00 | 15.00 | 19.03 | 12.00 |
like:VBP | 15.00 | 0.00 | 20.00 | 13.10 |
Java:NNP | 12.50 | 15.50 | 20.50 | 3.00 |
NO_WORD | 10.00 | 10.00 | 1.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -1.00 Alignment.score
1.00 0.55 Alignment.isGood
-1.00 0.03 Alignment.isBad
-0.10 1.00 Alignment.nbWordNotAligned
0.10 2.00 Alignment.hypSpan
0.10 0.75 Alignment.txtSpan
-0.10 1.00 NullPunisher.article : a
Hand-tuned score (dot product of above): -0.4045
Threshold: -13.6364
Txt: Some elephants like mice.
Hyp: Some animals like mice. (yes)
Some DT |
animals NNS |
like VBP |
mice NNS |
|
Some:DT | 0.00 | 20.00 | 17.50 | 17.50 |
elephants:NNS | 20.00 | 4.49 | 12.27 | 5.77 |
like:VBP | 17.50 | 13.31 | 0.00 | 10.00 |
mice:NNS | 17.50 | 4.36 | 10.00 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -1.12 Alignment.score
1.00 0.52 Alignment.isGood
-1.00 0.03 Alignment.isBad
-0.10 0.00 Alignment.nbWordNotAligned
0.10 4.00 Alignment.hypSpan
0.10 1.00 Alignment.txtSpan
1.00 1.00 Hypernym.posWiden : Widening a term (from "elephant" to "animal") preserves truth in a positive context
1.00 1.00 Quant.contract : Valid quantifier weakening: If some X have a property, then some X have a property
Hand-tuned score (dot product of above): 1.8641
Threshold: -13.6364
Txt: Snakes don't like people.
Hyp: Some reptiles don't like people. (yes)
Some DT |
reptiles NNS |
do VBP |
n't RB |
like VB |
people NNS |
|
Snakes:NNS | 18.00 | 1.01 | 15.00 | 15.00 | 13.00 | 8.68 |
do:VBP | 20.00 | 15.00 | 0.00 | 14.33 | 4.59 | 10.08 |
n't:RB | 20.00 | 15.00 | 14.33 | 0.00 | 17.52 | 13.13 |
like:VB | 17.50 | 13.58 | 4.59 | 17.52 | 0.00 | 11.04 |
people:NNS | 18.00 | 7.14 | 10.08 | 13.13 | 11.04 | 0.00 |
NO_WORD | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 |
Response: yes (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -1.83 Alignment.score
1.00 0.35 Alignment.isGood
-1.00 0.07 Alignment.isBad
-0.10 1.00 Alignment.nbWordNotAligned
0.10 5.00 Alignment.hypSpan
0.10 0.83 Alignment.txtSpan
-1.00 1.00 Hypernym.negWiden : Widening a term (from "snake" to "reptile") does NOT preserve truth in a negative context
0.00 1.00 NegPolarity.hypNegWord : "like": has child with relation "neg"
0.00 1.00 NegPolarity.txtNegWord : "like": has child with relation "neg"
0.00 1.00 NegPolarity.hypNegRoot : "like": has child with relation "neg"
0.00 1.00 NegPolarity.txtNegRoot : "like": has child with relation "neg"
-1.00 1.00 NullPunisher.other : Some
0.00 1.00 NegPolarity.txtNegWord&NegPolarity.hypNegWord :
0.00 1.00 NegPolarity.txtNegRoot&NegPolarity.hypNegRoot :
Hand-tuned score (dot product of above): -3.0701
Threshold: -13.6364
Txt: A major US intelligence review has projected that Iran is about a decade away from manufacturing the key ingredient for a nuclear weapon.
Hyp: In January 2000, the Central Intelligence Agency concluded that Iran might now be able to make a nuclear weapon. (don't know)
January NNP |
2000 CD |
the DT |
Central_Intelligence_Agency NNP |
concluded VBD |
that IN |
Iran NNP |
might MD |
now RB |
be VB |
able JJ |
to TO |
make VB |
a DT |
nuclear_weapon NN |
|
A:DT | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 0.00 | 20.00 |
major:JJ | 10.83 | 11.51 | 20.00 | 12.50 | 11.42 | 20.00 | 12.50 | 18.00 | 12.00 | 12.00 | 8.89 | 20.00 | 8.67 | 20.00 | 11.95 |
US_intelligence:NNP | 8.54 | 20.50 | 20.50 | 7.17 | 13.13 | 20.50 | 4.53 | 20.50 | 15.50 | 15.50 | 12.42 | 20.50 | 15.50 | 20.50 | 6.22 |
review:NN | 9.50 | 19.76 | 20.00 | 9.87 | 9.28 | 20.00 | 9.92 | 20.00 | 15.00 | 15.00 | 12.00 | 20.00 | 15.00 | 20.00 | 10.00 |
has:VBZ | 15.50 | 20.50 | 20.00 | 15.50 | 6.36 | 15.71 | 14.07 | 20.00 | 20.00 | 3.06 | 12.00 | 20.00 | 0.00 | 20.00 | 15.00 |
projected:VBN | 15.50 | 17.45 | 20.00 | 15.50 | 7.78 | 20.00 | 15.50 | 20.00 | 20.00 | 6.90 | 12.00 | 20.00 | 2.50 | 20.00 | 15.00 |
that:IN | 20.50 | 20.50 | 15.71 | 20.50 | 20.00 | 0.00 | 18.00 | 18.89 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
Iran:NNP | 9.79 | 20.50 | 20.50 | 10.09 | 15.50 | 18.00 | 0.00 | 19.39 | 15.50 | 15.50 | 12.50 | 20.50 | 15.50 | 20.50 | 10.50 |
is:VBZ | 15.50 | 20.50 | 20.00 | 15.50 | 5.55 | 20.00 | 15.50 | 20.00 | 20.00 | 0.00 | 12.00 | 20.00 | 4.07 | 20.00 | 15.00 |
about:RB | 15.50 | 20.50 | 18.39 | 15.50 | 20.00 | 18.89 | 15.50 | 18.00 | 10.00 | 20.00 | 8.67 | 20.00 | 20.00 | 20.00 | 15.00 |
a:DT | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 0.00 | 20.00 |
decade:NN | 6.76 | 20.50 | 20.00 | 9.66 | 13.00 | 20.00 | 9.72 | 20.00 | 15.00 | 15.00 | 12.00 | 20.00 | 13.00 | 20.00 | 9.85 |
away:RB | 12.77 | 20.50 | 20.00 | 15.50 | 20.00 | 17.50 | 13.00 | 20.00 | 10.00 | 20.00 | 7.40 | 20.00 | 18.40 | 20.00 | 14.02 |
from:IN | 20.50 | 20.50 | 20.00 | 20.50 | 20.00 | 10.00 | 18.00 | 20.00 | 18.57 | 20.00 | 20.00 | 17.78 | 20.00 | 18.58 | 20.00 |
manufacturing:VBG | 13.50 | 20.50 | 20.00 | 15.50 | 8.56 | 20.00 | 15.50 | 20.00 | 20.00 | 6.53 | 12.00 | 20.00 | 1.25 | 20.00 | 14.63 |
the:DT | 20.50 | 20.50 | 0.00 | 20.50 | 20.00 | 15.71 | 20.50 | 10.00 | 20.00 | 18.00 | 18.57 | 8.00 | 18.57 | 10.00 | 20.00 |
key:JJ | 12.50 | 12.50 | 20.00 | 12.50 | 10.38 | 20.00 | 12.50 | 20.00 | 12.00 | 10.00 | 9.80 | 20.00 | 10.57 | 20.00 | 10.42 |
ingredient:NN | 9.46 | 20.50 | 20.00 | 9.84 | 13.42 | 20.00 | 9.54 | 20.00 | 15.00 | 15.00 | 11.86 | 20.00 | 13.96 | 20.00 | 6.77 |
a:DT | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 0.00 | 20.00 |
nuclear_weapon:NN | 10.50 | 20.32 | 20.00 | 10.50 | 13.95 | 20.00 | 10.50 | 20.00 | 15.00 | 15.00 | 11.91 | 20.00 | 14.40 | 20.00 | 0.00 |
NO_WORD | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 9.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 |
Response: yes (INCORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.36 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.86 Alignment.isBad
-0.10 7.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.27 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "now" modifying "able"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "about" modifying "decade" is dropped on aligned hypothesis word "January"
-3.00 1.00 Date.dateHeadMismatch : January vs. decade
-0.05 1.00 NullPunisher.aux : might
-3.00 1.00 NullPunisher.entity : 2000
-1.00 1.00 NullPunisher.other : now
-0.10 1.00 NullPunisher.functionWord : to
-0.10 1.00 NullPunisher.article : the
-0.05 1.00 NullPunisher.aux : be
-0.10 1.00 NullPunisher.functionWord : that
1.00 1.00 Quant.contract : Valid quantifier weakening: If a X have a property, then a X have a property
-2.00 1.00 RootEntailment.poorlyAlignedRoot : "concluded" aligned badly to "that"
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "US_intelligence" <-nsubj-- "projected vs. hyp "Central_Intelligence_Agency" <-nsubj-- "concluded", which aligned to text "that" args have different parents, different relations: text "decade" <-dep-- "away" vs. hyp "January" <-prep_in-- "concluded", which aligned to text "that" args have different parents, different relations: text "away" <-dep-- "is" vs. hyp "able" <-ccomp-- "concluded", which aligned to text "that"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
4.00 1.00 Location.match&OK.Root.poorlyOrUnAligned :
Hand-tuned score (dot product of above): -13.4881
Threshold: -13.6364
Txt: A major US intelligence review has projected that Iran is about a decade away from manufacturing the key ingredient for a nuclear weapon.
Hyp: On 10 November 2004 the Wall Street Journal reported that European officials believed Iran was five or six years away from possessing nuclear weapon. (don't know)
10 CD |
November NNP |
2004 CD |
the DT |
Wall_Street_Journal NNP |
reported VBD |
that IN |
European JJ |
officials NNS |
believed VBD |
Iran NNP |
was VBD |
five CD |
six CD |
years NNS |
away RB |
from IN |
possessing VBG |
nuclear_weapon NN |
|
A:DT | 20.50 | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.50 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
major:JJ | 11.76 | 12.50 | 12.50 | 20.00 | 12.50 | 11.23 | 20.00 | 8.69 | 10.59 | 11.14 | 12.50 | 12.00 | 10.46 | 10.44 | 9.64 | 10.89 | 18.89 | 11.58 | 11.95 |
US:NNP | 20.50 | 8.23 | 20.50 | 20.50 | 10.50 | 15.50 | 20.50 | 12.50 | 6.54 | 15.50 | 4.53 | 13.50 | 20.50 | 20.50 | 7.60 | 15.50 | 20.50 | 15.50 | 10.50 |
intelligence:NN | 20.50 | 9.01 | 20.50 | 20.00 | 10.50 | 14.13 | 20.00 | 12.50 | 6.34 | 12.33 | 9.74 | 15.00 | 20.50 | 20.50 | 8.02 | 15.00 | 20.00 | 12.69 | 5.72 |
review:NN | 20.50 | 9.07 | 20.20 | 20.00 | 10.50 | 12.14 | 20.00 | 12.50 | 6.96 | 12.14 | 9.92 | 15.00 | 18.50 | 19.54 | 8.35 | 15.00 | 20.00 | 13.52 | 10.00 |
has:VBZ | 20.50 | 15.50 | 20.50 | 20.00 | 15.50 | 6.09 | 15.71 | 12.50 | 15.00 | 5.53 | 14.07 | 3.06 | 20.50 | 20.50 | 12.50 | 18.57 | 20.00 | 0.00 | 15.00 |
projected:VBN | 17.97 | 12.56 | 19.64 | 20.00 | 15.50 | 5.88 | 20.00 | 10.74 | 14.34 | 7.06 | 15.50 | 6.90 | 18.45 | 19.20 | 13.93 | 20.00 | 20.00 | 8.42 | 15.00 |
that:IN | 20.50 | 20.50 | 20.50 | 15.71 | 20.50 | 20.00 | 0.00 | 20.50 | 20.00 | 20.00 | 18.00 | 18.57 | 20.50 | 20.50 | 18.89 | 17.50 | 10.00 | 20.00 | 20.00 |
Iran:NNP | 20.50 | 9.62 | 20.50 | 20.50 | 10.50 | 15.50 | 18.00 | 10.83 | 8.58 | 15.50 | 0.00 | 14.07 | 20.50 | 20.50 | 9.25 | 13.00 | 18.00 | 15.50 | 10.50 |
is:VBZ | 20.50 | 15.50 | 20.50 | 20.00 | 15.50 | 5.25 | 20.00 | 12.50 | 15.00 | 4.62 | 15.50 | 0.00 | 20.50 | 18.50 | 15.00 | 20.00 | 20.00 | 7.49 | 15.00 |
about:RB | 20.50 | 15.50 | 20.50 | 18.39 | 15.50 | 19.23 | 18.89 | 12.50 | 15.00 | 20.00 | 15.50 | 20.00 | 20.50 | 20.50 | 15.00 | 8.89 | 18.89 | 20.00 | 15.00 |
a:DT | 20.50 | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.50 | 20.50 | 20.00 | 20.00 | 18.58 | 20.00 | 20.00 |
decade:NN | 19.96 | 6.55 | 20.50 | 20.00 | 10.50 | 13.57 | 20.00 | 12.50 | 7.83 | 11.98 | 9.72 | 15.00 | 17.93 | 19.13 | 5.13 | 14.22 | 20.00 | 13.13 | 9.85 |
away:RB | 19.52 | 15.50 | 20.50 | 20.00 | 15.50 | 20.00 | 17.50 | 12.50 | 15.00 | 19.59 | 13.00 | 15.71 | 19.18 | 18.56 | 13.89 | 0.00 | 20.00 | 20.00 | 14.02 |
from:IN | 20.50 | 20.50 | 20.50 | 20.00 | 20.50 | 20.00 | 10.00 | 20.50 | 20.00 | 20.00 | 18.00 | 20.00 | 18.00 | 20.50 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 |
manufacturing:VBG | 20.50 | 15.50 | 20.50 | 20.00 | 14.88 | 7.90 | 20.00 | 12.50 | 14.77 | 8.09 | 15.50 | 6.53 | 20.50 | 20.50 | 14.15 | 20.00 | 20.00 | 8.70 | 14.63 |
the:DT | 20.50 | 20.50 | 20.50 | 0.00 | 20.50 | 20.00 | 15.71 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 19.07 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
key:JJ | 12.50 | 12.50 | 12.50 | 20.00 | 12.50 | 12.00 | 20.00 | 9.41 | 11.45 | 10.56 | 12.50 | 12.00 | 12.44 | 12.50 | 11.50 | 10.57 | 20.00 | 12.00 | 10.42 |
ingredient:NN | 19.87 | 8.28 | 19.83 | 20.00 | 10.50 | 15.00 | 20.00 | 11.39 | 7.50 | 13.89 | 9.54 | 15.00 | 20.22 | 20.14 | 8.29 | 15.00 | 20.00 | 13.00 | 6.77 |
a:DT | 20.50 | 20.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.50 | 20.50 | 20.00 | 20.00 | 18.58 | 20.00 | 20.00 |
nuclear_weapon:NN | 20.50 | 10.50 | 20.50 | 20.00 | 9.59 | 15.00 | 20.00 | 10.68 | 7.93 | 11.61 | 10.50 | 15.00 | 20.50 | 20.50 | 10.00 | 14.02 | 20.00 | 12.10 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.63 Alignment.score
1.00 0.00 Alignment.isGood
-1.00 0.89 Alignment.isBad
-0.10 10.00 Alignment.nbWordNotAligned
0.10 5.00 Alignment.hypSpan
0.10 0.21 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "six" modifying "five"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "nuclear_weapon" modifying "manufacturing" is dropped on aligned hypothesis word "possessing"
-2.00 1.00 Date.hypDateIns : hypothesis date insertion: 10
-0.10 1.00 NullPunisher.functionWord : that
-3.00 1.00 NullPunisher.entity : 10
-3.00 1.00 NullPunisher.entity : six
-1.00 1.00 NullPunisher.other : believed
-3.00 1.00 NullPunisher.entity : five
-3.00 1.00 NullPunisher.entity : Wall_Street_Journal
-0.05 1.00 NullPunisher.aux : was
-3.00 1.00 NullPunisher.entity : European
-0.10 1.00 NullPunisher.article : the
-3.00 1.00 NullPunisher.entity : 2004
-3.00 1.00 Structure.argsMismatch : believed (verbal compl of the root) not aligned
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -30.7436
Threshold: -13.6364
Txt: On 10 November 2004 the Wall Street Journal reported that European officials believed Iran was five or six years away from possessing nuclear weapon.
Hyp: Iran does not currently have nuclear weapons, and would appear to be about two years away from acquiring nuclear weapons. (don't know)
Iran NNP |
does VBZ |
not RB |
currently RB |
have VB |
nuclear_weapons NNS |
would MD |
appear VB |
to TO |
be VB |
about RB |
two CD |
years NNS |
away RB |
from IN |
acquiring VBG |
nuclear_weapons NNS |
|
10:CD | 20.50 | 20.50 | 20.50 | 19.18 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 5.03 | 20.13 | 19.52 | 20.50 | 20.50 | 20.50 |
November:NNP | 9.62 | 15.50 | 15.50 | 14.91 | 15.50 | 10.50 | 20.50 | 14.07 | 20.50 | 15.50 | 15.50 | 20.50 | 5.82 | 15.50 | 20.50 | 15.50 | 10.50 |
2004:CD | 20.50 | 19.80 | 20.50 | 18.26 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 10.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 |
the:DT | 20.50 | 18.57 | 20.00 | 20.00 | 18.57 | 20.00 | 10.00 | 20.00 | 8.00 | 18.00 | 18.39 | 17.17 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
Wall_Street_Journal:NNP | 10.50 | 15.50 | 15.50 | 15.50 | 15.50 | 9.32 | 20.50 | 15.50 | 20.50 | 15.50 | 15.50 | 20.50 | 10.50 | 15.50 | 20.50 | 15.50 | 9.32 |
reported:VBD | 15.50 | 6.80 | 20.00 | 19.41 | 6.09 | 15.00 | 19.23 | 6.80 | 20.00 | 5.25 | 19.23 | 20.50 | 14.23 | 20.00 | 20.00 | 5.93 | 15.00 |
that:IN | 18.00 | 20.00 | 18.57 | 20.00 | 17.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 18.89 | 19.07 | 18.89 | 17.50 | 10.00 | 20.00 | 20.00 |
European:JJ | 10.83 | 12.50 | 12.50 | 10.74 | 12.50 | 11.20 | 20.50 | 9.64 | 20.50 | 12.50 | 12.50 | 12.50 | 12.50 | 12.50 | 20.50 | 11.91 | 11.20 |
officials:NNS | 8.58 | 14.95 | 15.00 | 13.84 | 15.00 | 7.04 | 20.00 | 13.20 | 20.00 | 15.00 | 15.00 | 20.50 | 7.01 | 15.00 | 20.00 | 13.89 | 7.04 |
believed:VBD | 15.50 | 6.30 | 20.00 | 19.34 | 5.53 | 13.18 | 20.00 | 6.30 | 20.00 | 4.62 | 20.00 | 19.56 | 14.04 | 19.59 | 20.00 | 5.35 | 13.18 |
Iran:NNP | 0.00 | 15.50 | 15.50 | 15.50 | 15.50 | 10.50 | 20.50 | 15.50 | 20.50 | 15.50 | 15.50 | 20.50 | 9.25 | 13.00 | 18.00 | 14.73 | 10.50 |
was:VBD | 14.07 | 4.07 | 20.00 | 20.00 | 3.06 | 15.00 | 20.00 | 2.49 | 20.00 | 0.00 | 20.00 | 20.50 | 12.50 | 15.71 | 20.00 | 2.83 | 15.00 |
five:CD | 20.50 | 20.50 | 20.50 | 20.50 | 15.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 0.98 | 16.85 | 19.18 | 18.00 | 20.50 | 20.50 |
six:CD | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.31 | 20.50 | 20.43 | 20.50 | 20.50 | 20.50 | 1.77 | 17.35 | 18.56 | 20.50 | 20.46 | 20.31 |
years:NNS | 9.25 | 13.89 | 15.00 | 12.39 | 13.89 | 10.00 | 20.00 | 12.27 | 20.00 | 15.00 | 15.00 | 17.67 | 0.00 | 13.89 | 20.00 | 14.75 | 10.00 |
away:RB | 13.00 | 20.00 | 10.00 | 10.00 | 20.00 | 15.00 | 20.00 | 18.00 | 20.00 | 20.00 | 8.89 | 18.54 | 13.89 | 0.00 | 20.00 | 20.00 | 15.00 |
from:IN | 18.00 | 20.00 | 18.57 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 17.78 | 20.00 | 18.89 | 19.07 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 |
possessing:VBG | 15.50 | 8.51 | 20.00 | 19.33 | 0.00 | 13.67 | 20.00 | 8.51 | 20.00 | 7.49 | 20.00 | 18.66 | 12.12 | 20.00 | 20.00 | 7.37 | 13.67 |
nuclear_weapon:NN | 10.50 | 14.99 | 15.00 | 14.51 | 15.00 | 0.00 | 20.00 | 13.43 | 20.00 | 15.00 | 15.00 | 20.50 | 10.00 | 14.02 | 20.00 | 15.00 | 0.00 |
NO_WORD | 10.00 | 1.00 | 9.00 | 9.00 | 10.00 | 10.00 | 10.00 | 10.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.39 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.87 Alignment.isBad
-0.10 5.00 Alignment.nbWordNotAligned
0.10 6.00 Alignment.hypSpan
0.10 0.29 Alignment.txtSpan
-6.00 1.00 Adjunct.diffPol : It is not okay that hypothesis and text have different polarity
1.00 1.00 Factive.inPositiveEmbedding : embedded positive text
0.00 1.00 NegPolarity.hypNegWord : "have": has child with relation "neg"
0.00 1.00 NegPolarity.hypNegRoot : "have": has child with relation "neg"
-0.05 1.00 NullPunisher.aux : does
-1.00 1.00 NullPunisher.other : about
-1.00 1.00 NullPunisher.other : currently
-0.05 1.00 NullPunisher.aux : would
-1.00 1.00 NullPunisher.other : not
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "Iran" <-nsubj-- "years" vs. hyp "Iran" <-nsubj-- "have", which aligned to text "possessing" args have different parents, different relations: text "officials" <-nsubj-- "believed" vs. hyp "nuclear_weapons" <-dobj-- "have", which aligned to text "possessing"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -16.2252
Threshold: -13.6364
Txt: Iran does not currently have nuclear weapons, and would appear to be about two years away from acquiring nuclear weapons.
Hyp: On 10 November 2004 the Wall Street Journal reported that European officials believed Iran was five or six years away from possessing nuclear weapon. (don't know)
10 CD |
November NNP |
2004 CD |
the DT |
Wall_Street_Journal NNP |
reported VBD |
that IN |
European JJ |
officials NNS |
believed VBD |
Iran NNP |
was VBD |
five CD |
six CD |
years NNS |
away RB |
from IN |
possessing VBG |
nuclear_weapon NN |
|
Iran:NNP | 20.50 | 9.62 | 20.50 | 20.50 | 10.50 | 15.50 | 18.00 | 10.83 | 8.58 | 15.50 | 0.00 | 14.07 | 20.50 | 20.50 | 9.25 | 13.00 | 18.00 | 15.50 | 10.50 |
does:VBZ | 20.50 | 15.50 | 19.80 | 18.57 | 15.50 | 6.80 | 20.00 | 12.50 | 14.95 | 6.30 | 15.50 | 4.00 | 20.50 | 20.50 | 13.89 | 20.00 | 20.00 | 8.51 | 14.99 |
not:RB | 20.50 | 15.50 | 20.50 | 20.00 | 15.50 | 20.00 | 18.57 | 12.50 | 15.00 | 20.00 | 15.50 | 20.00 | 20.50 | 20.50 | 15.00 | 10.00 | 18.57 | 20.00 | 15.00 |
currently:RB | 19.18 | 14.91 | 18.26 | 20.00 | 15.50 | 19.41 | 20.00 | 10.74 | 13.84 | 19.34 | 15.50 | 20.00 | 20.50 | 20.50 | 12.39 | 10.00 | 20.00 | 19.33 | 14.51 |
have:VB | 20.50 | 15.50 | 20.50 | 18.57 | 15.50 | 6.09 | 17.50 | 12.50 | 15.00 | 5.53 | 15.50 | 3.06 | 15.50 | 20.50 | 13.89 | 20.00 | 20.00 | 0.00 | 15.00 |
nuclear_weapons:NNS | 20.50 | 10.50 | 20.50 | 20.00 | 9.32 | 15.00 | 20.00 | 11.20 | 7.04 | 13.18 | 10.50 | 15.00 | 20.50 | 20.31 | 10.00 | 15.00 | 20.00 | 13.67 | 0.00 |
would:MD | 20.50 | 20.50 | 20.50 | 10.00 | 20.50 | 19.23 | 20.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.50 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
appear:VB | 20.50 | 14.07 | 20.50 | 20.00 | 15.50 | 6.80 | 20.00 | 9.64 | 13.20 | 6.30 | 15.50 | 1.25 | 20.50 | 20.43 | 12.27 | 18.00 | 20.00 | 8.51 | 13.43 |
to:TO | 20.50 | 20.50 | 20.50 | 8.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.50 | 20.00 | 20.50 | 20.50 | 20.00 | 20.00 | 17.78 | 20.00 | 20.00 |
be:VB | 20.50 | 15.50 | 20.50 | 18.00 | 15.50 | 5.25 | 20.00 | 12.50 | 15.00 | 4.62 | 15.50 | 0.00 | 20.50 | 20.50 | 15.00 | 20.00 | 20.00 | 7.49 | 15.00 |
about:RB | 20.50 | 15.50 | 20.50 | 18.39 | 15.50 | 19.23 | 18.89 | 12.50 | 15.00 | 20.00 | 15.50 | 20.00 | 20.50 | 20.50 | 15.00 | 8.89 | 18.89 | 20.00 | 15.00 |
two:CD | 5.03 | 20.50 | 10.50 | 17.17 | 20.50 | 20.50 | 19.07 | 12.50 | 20.50 | 19.56 | 20.50 | 20.50 | 0.98 | 1.77 | 17.67 | 18.54 | 19.07 | 18.66 | 20.50 |
years:NNS | 20.13 | 5.82 | 20.50 | 20.00 | 10.50 | 14.23 | 18.89 | 12.50 | 7.01 | 14.04 | 9.25 | 12.50 | 16.85 | 17.35 | 0.00 | 13.89 | 20.00 | 12.12 | 10.00 |
away:RB | 19.52 | 15.50 | 20.50 | 20.00 | 15.50 | 20.00 | 17.50 | 12.50 | 15.00 | 19.59 | 13.00 | 15.71 | 19.18 | 18.56 | 13.89 | 0.00 | 20.00 | 20.00 | 14.02 |
from:IN | 20.50 | 20.50 | 20.50 | 20.00 | 20.50 | 20.00 | 10.00 | 20.50 | 20.00 | 20.00 | 18.00 | 20.00 | 18.00 | 20.50 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 |
acquiring:VBG | 20.50 | 15.50 | 20.50 | 20.00 | 15.50 | 5.93 | 20.00 | 11.91 | 13.89 | 5.35 | 14.73 | 2.83 | 20.50 | 20.46 | 14.75 | 20.00 | 20.00 | 7.37 | 15.00 |
nuclear_weapons:NNS | 20.50 | 10.50 | 20.50 | 20.00 | 9.32 | 15.00 | 20.00 | 11.20 | 7.04 | 13.18 | 10.50 | 15.00 | 20.50 | 20.31 | 10.00 | 15.00 | 20.00 | 13.67 | 0.00 |
NO_WORD | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -5.39 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.71 Alignment.isBad
-0.10 8.00 Alignment.nbWordNotAligned
0.10 6.00 Alignment.hypSpan
0.10 0.37 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "five" modifying "years"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "currently" modifying "have" is dropped on aligned hypothesis word "possessing"
-2.00 1.00 Date.hypDateIns : hypothesis date insertion: 10
1.00 1.00 Hypernym.posWiden : Widening a term (from "appear" to "be") preserves truth in a positive context
0.00 1.00 NegPolarity.txtNegWord : "have": has child with relation "neg"
-3.00 1.00 NullPunisher.entity : five
-3.00 1.00 NullPunisher.entity : European
-3.00 1.00 NullPunisher.entity : 2004
-3.00 1.00 NullPunisher.entity : November
-3.00 1.00 NullPunisher.entity : 10
-0.10 1.00 NullPunisher.article : the
-3.00 1.00 NullPunisher.entity : Wall_Street_Journal
-0.10 1.00 NullPunisher.functionWord : that
-6.00 1.00 Numeric.mismatch : NUMBER mismatch: '6.0' vs '~2.0'
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "be" <-xcomp-- "appear" vs. hyp "believed" <-ccomp-- "reported", which aligned to text "does"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -31.9516
Threshold: -13.6364
Txt: Iranian Foreign Minister Kamal Kharazi, denied his country has "any program to produce weapons of mass destruction."
Hyp: "According to experts, the document is unequivocal proof that Iran's nuclear project is involved in weapons production". (don't know)
According VBG |
to TO |
experts NNS |
the DT |
document NN |
is VBZ |
unequivocal JJ |
proof NN |
that IN |
Iran NNP |
nuclear JJ |
project NN |
is VBZ |
involved VBN |
weapons NNS |
production NN |
|
Iranian:NNP | 15.50 | 20.50 | 8.42 | 20.50 | 8.87 | 15.50 | 12.50 | 10.08 | 20.50 | 3.50 | 11.07 | 9.07 | 15.50 | 14.83 | 9.07 | 8.74 |
Foreign_Minister:NNP | 15.00 | 20.00 | 10.00 | 20.00 | 10.00 | 15.00 | 12.00 | 10.00 | 20.00 | 10.50 | 12.00 | 10.00 | 15.00 | 15.00 | 10.00 | 10.00 |
Kamal_Kharazi:NNP | 15.50 | 20.50 | 10.50 | 20.50 | 10.50 | 15.50 | 12.50 | 10.50 | 20.50 | 10.50 | 12.50 | 10.50 | 15.50 | 15.50 | 10.50 | 10.50 |
denied:VBD | 8.11 | 20.00 | 14.23 | 20.00 | 11.92 | 6.49 | 10.18 | 11.48 | 20.00 | 15.50 | 11.23 | 14.23 | 6.49 | 5.27 | 14.23 | 15.00 |
his:PRP$ | 15.00 | 20.00 | 12.00 | 20.00 | 12.00 | 9.00 | 15.00 | 12.00 | 18.57 | 12.50 | 15.00 | 12.00 | 9.00 | 15.00 | 12.00 | 12.00 |
country:NN | 13.75 | 20.00 | 6.80 | 20.00 | 5.71 | 15.00 | 11.53 | 8.14 | 20.00 | 8.35 | 10.33 | 6.44 | 15.00 | 14.30 | 7.43 | 7.65 |
has:VBZ | 5.60 | 20.00 | 15.00 | 20.00 | 15.00 | 3.06 | 12.00 | 15.00 | 15.71 | 14.07 | 12.00 | 15.00 | 3.06 | 6.45 | 15.00 | 15.00 |
any:DT | 20.00 | 10.00 | 20.00 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 19.07 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
program:NN | 15.00 | 20.00 | 6.37 | 20.00 | 1.25 | 15.00 | 12.00 | 6.53 | 20.00 | 8.88 | 10.21 | 5.25 | 15.00 | 14.33 | 7.06 | 6.71 |
to:TO | 20.00 | 0.00 | 20.00 | 8.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
produce:VB | 5.78 | 20.00 | 12.58 | 20.00 | 13.00 | 3.29 | 12.00 | 11.67 | 20.00 | 15.50 | 8.57 | 9.29 | 3.29 | 6.60 | 13.58 | 2.50 |
weapons_of_mass_destruction:NP | 20.00 | 10.00 | 16.26 | 10.00 | 17.48 | 20.00 | 17.96 | 16.88 | 20.00 | 20.50 | 14.83 | 17.74 | 20.00 | 19.04 | 15.00 | 18.24 |
NO_WORD | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 10.00 | 9.00 | 10.00 | 1.00 | 10.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.58 Alignment.score
1.00 0.00 Alignment.isGood
-1.00 0.89 Alignment.isBad
-0.10 7.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.38 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "nuclear" modifying "project"
-1.00 1.00 NullPunisher.other : nuclear
-0.05 1.00 NullPunisher.aux : is
-1.00 1.00 NullPunisher.other : experts
-1.00 1.00 NullPunisher.other : unequivocal
-0.10 1.00 NullPunisher.article : the
-0.10 1.00 NullPunisher.functionWord : that
-0.05 1.00 NullPunisher.aux : is
-2.00 1.00 RootEntailment.poorlyAlignedRoot : "proof" aligned badly to "Kamal_Kharazi"
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "country" <-nsubj-- "has" vs. hyp "document" <-nsubj-- "proof", which aligned to text "Kamal_Kharazi" args have different parents, different relations: text "has" <-ccomp-- "denied" vs. hyp "According" <-prep-- "proof", which aligned to text "Kamal_Kharazi"
Hand-tuned score (dot product of above): -17.1307
Threshold: -13.6364
Txt: Iranian Foreign Minister Kamal Kharazi, denied his country has "any program to produce weapons of mass destruction."
Hyp: A major US intelligence review has projected that Iran is about a decade away from manufacturing the key ingredient for a nuclear weapon. (don't know)
A DT |
major JJ |
US NNP |
intelligence NN |
review NN |
has VBZ |
projected VBN |
that IN |
Iran NNP |
is VBZ |
about RB |
a DT |
decade NN |
away RB |
from IN |
manufacturing VBG |
the DT |
key JJ |
ingredient NN |
a DT |
nuclear_weapon NN |
|
Iranian:NNP | 20.50 | 12.50 | 9.06 | 9.97 | 8.19 | 15.50 | 15.50 | 20.50 | 3.50 | 15.50 | 15.50 | 20.50 | 9.95 | 14.59 | 20.50 | 15.50 | 20.50 | 12.50 | 7.56 | 20.50 | 10.50 |
Foreign_Minister:NNP | 20.00 | 12.00 | 10.50 | 9.29 | 10.00 | 15.00 | 15.00 | 20.00 | 10.50 | 15.00 | 15.00 | 20.00 | 10.00 | 15.00 | 20.00 | 15.00 | 20.00 | 12.00 | 10.00 | 20.00 | 10.00 |
Kamal_Kharazi:NNP | 20.50 | 12.50 | 10.50 | 10.10 | 10.50 | 15.50 | 15.50 | 20.50 | 10.50 | 15.50 | 15.50 | 20.50 | 10.50 | 15.50 | 20.50 | 13.96 | 20.50 | 12.50 | 10.50 | 20.50 | 9.39 |
denied:VBD | 20.00 | 11.57 | 15.50 | 14.82 | 10.00 | 2.50 | 8.00 | 20.00 | 15.50 | 6.49 | 20.00 | 20.00 | 11.67 | 20.00 | 20.00 | 9.03 | 20.00 | 11.36 | 13.75 | 20.00 | 13.57 |
his:PRP$ | 20.00 | 15.00 | 10.50 | 12.00 | 12.00 | 8.33 | 15.00 | 18.57 | 12.50 | 9.00 | 20.00 | 20.00 | 12.00 | 20.00 | 20.00 | 15.00 | 20.00 | 15.00 | 12.00 | 20.00 | 12.00 |
country:NN | 20.00 | 10.10 | 7.42 | 7.88 | 8.22 | 15.00 | 13.75 | 20.00 | 8.35 | 15.00 | 13.33 | 20.00 | 7.32 | 13.84 | 20.00 | 15.00 | 20.00 | 11.40 | 8.16 | 20.00 | 10.00 |
has:VBZ | 20.00 | 12.00 | 13.50 | 15.00 | 15.00 | 0.00 | 7.55 | 15.71 | 14.07 | 3.06 | 20.00 | 20.00 | 15.00 | 18.57 | 20.00 | 7.23 | 20.00 | 12.00 | 15.00 | 20.00 | 15.00 |
any:DT | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 19.07 | 20.00 | 20.00 | 10.00 | 20.00 | 15.71 | 20.00 | 20.00 | 10.00 | 16.67 | 20.00 | 10.00 | 20.00 |
program:NN | 20.00 | 12.00 | 7.01 | 6.15 | 6.64 | 15.00 | 12.35 | 20.00 | 8.88 | 15.00 | 15.00 | 20.00 | 7.50 | 14.76 | 17.27 | 15.00 | 20.00 | 12.00 | 7.85 | 20.00 | 9.59 |
to:TO | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 10.00 | 20.00 | 20.00 | 17.78 | 20.00 | 8.00 | 20.00 | 20.00 | 10.00 | 20.00 |
produce:VB | 20.00 | 10.08 | 15.50 | 15.00 | 13.16 | 4.34 | 5.00 | 20.00 | 15.50 | 3.29 | 18.33 | 20.00 | 13.99 | 20.00 | 19.09 | 5.86 | 20.00 | 11.11 | 11.45 | 20.00 | 14.32 |
weapons_of_mass_destruction:NP | 9.24 | 19.78 | 20.50 | 16.00 | 17.58 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 9.24 | 17.59 | 20.00 | 20.00 | 18.71 | 10.00 | 19.91 | 18.05 | 9.24 | 16.20 |
NO_WORD | 1.00 | 9.00 | 10.00 | 10.00 | 10.00 | 1.00 | 10.00 | 1.00 | 10.00 | 10.00 | 9.00 | 1.00 | 10.00 | 9.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 1.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.78 Alignment.score
1.00 0.00 Alignment.isGood
-1.00 0.91 Alignment.isBad
-0.10 16.00 Alignment.nbWordNotAligned
0.10 1.00 Alignment.hypSpan
0.10 0.10 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "nuclear_weapon" modifying "manufacturing"
0.50 1.00 Factive.unknownPassage : Hyp aligned with txt under non-factive verb (unknown): denied
-0.10 1.00 NullPunisher.article : A
-1.00 1.00 NullPunisher.other : nuclear_weapon
-0.10 1.00 NullPunisher.article : a
-1.00 1.00 NullPunisher.other : key
-1.00 1.00 NullPunisher.other : review
-0.10 1.00 NullPunisher.article : a
-0.10 1.00 NullPunisher.functionWord : that
-0.10 1.00 NullPunisher.article : the
-3.00 1.00 NullPunisher.entity : US
-1.00 1.00 NullPunisher.other : away
-0.05 1.00 NullPunisher.aux : is
-1.00 1.00 NullPunisher.other : ingredient
-1.00 1.00 NullPunisher.other : about
-1.00 1.00 NullPunisher.other : major
-1.00 1.00 NullPunisher.other : from
-0.05 1.00 NullPunisher.aux : has
1.00 1.00 Quant.contract : Valid quantifier weakening: If any X have a property, then a X have a property
-3.00 1.00 Structure.argsMismatch : is (verbal compl of the root) not aligned
Hand-tuned score (dot product of above): -23.2690
Threshold: -13.6364
Txt: "According to experts, the document is unequivocal proof that Iran's nuclear project is involved in weapons production."
Hyp: Iran does not currently have nuclear weapons, and would appear to be about two years away from acquiring nuclear weapons. (don't know)
Iran NNP |
does VBZ |
not RB |
currently RB |
have VB |
nuclear_weapons NNS |
would MD |
appear VB |
to TO |
be VB |
about RB |
two CD |
years NNS |
away RB |
from IN |
acquiring VBG |
nuclear_weapons NNS |
|
According:VBG | 15.50 | 6.36 | 20.00 | 18.89 | 5.60 | 15.00 | 20.00 | 6.36 | 20.00 | 2.50 | 20.00 | 20.50 | 15.00 | 20.00 | 20.00 | 4.44 | 15.00 |
to:TO | 20.50 | 17.95 | 18.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 0.00 | 20.00 | 20.00 | 14.50 | 20.00 | 20.00 | 17.78 | 20.00 | 20.00 |
experts:NNS | 8.56 | 13.05 | 15.00 | 13.75 | 15.00 | 7.77 | 20.00 | 12.69 | 20.00 | 15.00 | 15.00 | 19.60 | 6.98 | 14.58 | 20.00 | 13.83 | 7.77 |
the:DT | 20.50 | 18.57 | 20.00 | 20.00 | 18.57 | 20.00 | 10.00 | 20.00 | 8.00 | 18.00 | 18.39 | 17.17 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 |
document:NN | 8.44 | 13.33 | 15.00 | 12.06 | 15.00 | 8.40 | 19.23 | 12.23 | 20.00 | 15.00 | 14.23 | 20.20 | 5.93 | 15.00 | 20.00 | 13.24 | 8.40 |
is:VBZ | 15.50 | 4.07 | 20.00 | 20.00 | 3.06 | 15.00 | 20.00 | 2.49 | 20.00 | 0.00 | 20.00 | 20.50 | 15.00 | 20.00 | 20.00 | 2.83 | 15.00 |
unequivocal:JJ | 12.50 | 9.36 | 12.00 | 11.28 | 12.00 | 10.11 | 20.00 | 11.73 | 20.00 | 12.00 | 12.00 | 12.50 | 11.79 | 12.00 | 20.00 | 10.00 | 10.11 |
proof:RB | 14.39 | 15.38 | 10.00 | 10.00 | 20.00 | 14.28 | 20.00 | 14.78 | 20.00 | 20.00 | 8.00 | 19.82 | 15.00 | 10.00 | 16.67 | 20.00 | 14.28 |
that:IN | 18.00 | 20.00 | 18.57 | 20.00 | 17.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 18.89 | 19.07 | 18.89 | 17.50 | 10.00 | 20.00 | 20.00 |
Iran:NNP | 0.00 | 15.50 | 15.50 | 15.50 | 15.50 | 10.50 | 20.50 | 15.50 | 20.50 | 15.50 | 15.50 | 20.50 | 9.25 | 13.00 | 18.00 | 14.73 | 10.50 |
nuclear:JJ | 12.50 | 10.23 | 12.00 | 10.75 | 12.00 | 7.00 | 20.00 | 8.15 | 20.00 | 12.00 | 12.00 | 12.24 | 10.22 | 12.00 | 20.00 | 11.47 | 7.00 |
project:NN | 8.90 | 14.09 | 15.00 | 13.75 | 15.00 | 8.84 | 20.00 | 14.23 | 20.00 | 15.00 | 13.33 | 20.50 | 6.64 | 15.00 | 19.09 | 14.07 | 8.84 |
is:VBZ | 15.50 | 4.07 | 20.00 | 20.00 | 3.06 | 15.00 | 20.00 | 2.49 | 20.00 | 0.00 | 20.00 | 20.50 | 15.00 | 20.00 | 20.00 | 2.83 | 15.00 |
involved:VBN | 15.50 | 7.11 | 20.00 | 19.14 | 1.25 | 12.44 | 19.23 | 7.11 | 20.00 | 5.64 | 20.00 | 18.82 | 14.31 | 19.57 | 20.00 | 6.29 | 12.44 |
weapons:NNS | 9.03 | 14.09 | 15.00 | 15.00 | 15.00 | 0.00 | 20.00 | 14.23 | 20.00 | 15.00 | 13.33 | 20.25 | 6.67 | 15.00 | 20.00 | 14.67 | 0.00 |
production:NN | 9.61 | 14.97 | 15.00 | 14.47 | 15.00 | 8.87 | 20.00 | 13.94 | 20.00 | 15.00 | 14.33 | 20.50 | 7.81 | 15.00 | 20.00 | 13.42 | 8.87 |
NO_WORD | 10.00 | 1.00 | 9.00 | 9.00 | 10.00 | 10.00 | 10.00 | 10.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 9.00 | 10.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.81 Alignment.score
1.00 0.00 Alignment.isGood
-1.00 0.91 Alignment.isBad
-0.10 8.00 Alignment.nbWordNotAligned
0.10 3.00 Alignment.hypSpan
0.10 0.29 Alignment.txtSpan
-6.00 1.00 Adjunct.diffPol : It is not okay that hypothesis and text have different polarity
0.00 1.00 NegPolarity.hypNegWord : "have": has child with relation "neg"
0.00 1.00 NegPolarity.hypNegRoot : "have": has child with relation "neg"
-0.05 1.00 NullPunisher.aux : does
-3.00 1.00 NullPunisher.entity : two
-1.00 1.00 NullPunisher.other : currently
-1.00 1.00 NullPunisher.other : from
-0.05 1.00 NullPunisher.aux : would
-1.00 1.00 NullPunisher.other : away
-1.00 1.00 NullPunisher.other : not
-1.00 1.00 NullPunisher.other : about
-3.00 1.00 Structure.argsMismatch : args have different parents but same relations: text "Iran" <-poss-- "project" vs. hyp "Iran" <-nsubj-- "have", which aligned to text "is" args have different parents, different relations: text "weapons" <-prep_in-- "involved" vs. hyp "nuclear_weapons" <-dobj-- "have", which aligned to text "is" args have different parents, different relations: text "According" <-prep-- "unequivocal" vs. hyp "appear" <-conj_and-- "have", which aligned to text "is"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -23.2900
Threshold: -13.6364
Txt: Iranian Foreign Minister Kamal Kharazi, denied his country has "any program to produce weapons of mass destruction."
Hyp: In January 2000, the Central Intelligence Agency concluded that Iran might now be able to make a nuclear weapon. (don't know)
January NNP |
2000 CD |
the DT |
Central_Intelligence_Agency NNP |
concluded VBD |
that IN |
Iran NNP |
might MD |
now RB |
be VB |
able JJ |
to TO |
make VB |
a DT |
nuclear_weapon NN |
|
Iranian:NNP | 7.64 | 20.50 | 20.50 | 10.24 | 15.50 | 20.50 | 3.50 | 20.50 | 15.50 | 15.50 | 12.50 | 20.50 | 15.50 | 20.50 | 10.50 |
Foreign_Minister:NNP | 10.50 | 20.50 | 20.00 | 10.50 | 15.00 | 20.00 | 10.50 | 20.00 | 15.00 | 15.00 | 12.00 | 20.00 | 15.00 | 20.00 | 10.00 |
Kamal_Kharazi:NNP | 10.50 | 20.50 | 20.50 | 10.25 | 15.50 | 20.50 | 10.50 | 20.50 | 15.50 | 15.50 | 12.50 | 20.50 | 15.50 | 20.50 | 9.39 |
denied:VBD | 14.73 | 20.50 | 20.00 | 15.50 | 5.22 | 20.00 | 15.50 | 20.00 | 20.00 | 6.49 | 11.70 | 20.00 | 7.76 | 20.00 | 13.57 |
his:PRP$ | 12.50 | 20.50 | 20.00 | 12.50 | 15.00 | 18.57 | 12.50 | 20.00 | 20.00 | 15.00 | 15.00 | 20.00 | 15.00 | 20.00 | 12.00 |
country:NN | 7.64 | 19.76 | 20.00 | 6.50 | 13.75 | 20.00 | 8.35 | 20.00 | 15.00 | 15.00 | 11.05 | 20.00 | 13.96 | 20.00 | 10.00 |
has:VBZ | 15.50 | 20.50 | 20.00 | 15.50 | 6.36 | 15.71 | 14.07 | 20.00 | 20.00 | 3.06 | 12.00 | 20.00 | 0.00 | 20.00 | 15.00 |
any:DT | 18.50 | 20.50 | 10.00 | 20.50 | 20.00 | 20.00 | 19.07 | 10.00 | 20.00 | 20.00 | 18.57 | 10.00 | 18.57 | 10.00 | 20.00 |
program:NN | 8.15 | 17.36 | 20.00 | 8.79 | 14.35 | 20.00 | 8.88 | 20.00 | 15.00 | 15.00 | 9.83 | 20.00 | 13.54 | 20.00 | 9.59 |
to:TO | 20.50 | 20.50 | 8.00 | 20.50 | 20.00 | 20.00 | 20.50 | 10.00 | 18.00 | 20.00 | 20.00 | 0.00 | 20.00 | 10.00 | 20.00 |
produce:VB | 15.50 | 16.91 | 20.00 | 15.50 | 6.51 | 20.00 | 15.50 | 20.00 | 20.00 | 3.29 | 10.09 | 20.00 | 0.00 | 20.00 | 14.32 |
weapons_of_mass_destruction:NP | 20.50 | 20.50 | 10.00 | 19.76 | 16.42 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 9.24 | 16.20 |
NO_WORD | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 9.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.08 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.83 Alignment.isBad
-0.10 8.00 Alignment.nbWordNotAligned
0.10 4.00 Alignment.hypSpan
0.10 0.20 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "now" modifying "able"
-3.00 1.00 Date.dateHeadMismatch : January vs. country
-3.00 1.00 NullPunisher.entity : Central_Intelligence_Agency
-1.00 1.00 NullPunisher.other : nuclear_weapon
-3.00 1.00 NullPunisher.entity : 2000
-0.05 1.00 NullPunisher.aux : might
-0.10 1.00 NullPunisher.article : a
-1.00 1.00 NullPunisher.other : now
-0.10 1.00 NullPunisher.article : the
-0.10 1.00 NullPunisher.functionWord : that
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "country" <-nsubj-- "has" vs. hyp "January" <-prep_in-- "concluded", which aligned to text "denied" args have different parents, different relations: text "program" <-dobj-- "has" vs. hyp "able" <-ccomp-- "concluded", which aligned to text "denied"
Hand-tuned score (dot product of above): -21.6354
Threshold: -13.6364
Txt: In January 2000, the Central Intelligence Agency concluded that Iran might now be able to make a nuclear weapon.
Hyp: A major US intelligence review has projected that Iran is about a decade away from manufacturing the key ingredient for a nuclear weapon. (don't know)
A DT |
major JJ |
US_intelligence NNP |
review NN |
has VBZ |
projected VBN |
that IN |
Iran NNP |
is VBZ |
about RB |
a DT |
decade NN |
away RB |
from IN |
manufacturing VBG |
the DT |
key JJ |
ingredient NN |
a DT |
nuclear_weapon NN |
|
January:NNP | 20.50 | 10.83 | 8.54 | 9.50 | 15.50 | 15.50 | 20.50 | 9.79 | 15.50 | 15.50 | 20.50 | 6.76 | 12.77 | 20.50 | 13.50 | 20.50 | 12.50 | 9.46 | 20.50 | 10.50 |
2000:CD | 20.50 | 11.51 | 20.50 | 19.76 | 20.50 | 17.45 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 12.50 | 20.50 | 20.50 | 20.32 |
the:DT | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 15.71 | 20.50 | 20.00 | 18.39 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 | 10.00 | 20.00 |
Central_Intelligence_Agency:NNP | 20.50 | 12.50 | 7.17 | 9.87 | 15.50 | 15.50 | 20.50 | 10.09 | 15.50 | 15.50 | 20.50 | 9.66 | 15.50 | 20.50 | 15.50 | 20.50 | 12.50 | 9.84 | 20.50 | 10.50 |
concluded:VBD | 20.00 | 11.42 | 13.13 | 9.28 | 6.36 | 7.78 | 20.00 | 15.50 | 5.55 | 20.00 | 20.00 | 13.00 | 20.00 | 20.00 | 8.56 | 20.00 | 10.38 | 13.42 | 20.00 | 13.95 |
that:IN | 20.00 | 20.00 | 20.50 | 20.00 | 15.71 | 20.00 | 0.00 | 18.00 | 20.00 | 18.89 | 20.00 | 20.00 | 17.50 | 10.00 | 20.00 | 15.71 | 20.00 | 20.00 | 20.00 | 20.00 |
Iran:NNP | 20.50 | 12.50 | 4.53 | 9.92 | 14.07 | 15.50 | 18.00 | 0.00 | 15.50 | 15.50 | 20.50 | 9.72 | 13.00 | 18.00 | 15.50 | 20.50 | 12.50 | 9.54 | 20.50 | 10.50 |
might:MD | 10.00 | 18.00 | 20.50 | 20.00 | 20.00 | 20.00 | 18.89 | 19.39 | 20.00 | 18.00 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 20.00 | 10.00 | 20.00 |
now:RB | 20.00 | 12.00 | 15.50 | 15.00 | 20.00 | 20.00 | 20.00 | 15.50 | 20.00 | 10.00 | 20.00 | 15.00 | 10.00 | 18.57 | 20.00 | 20.00 | 12.00 | 15.00 | 20.00 | 15.00 |
be:VB | 20.00 | 12.00 | 15.50 | 15.00 | 3.06 | 6.90 | 20.00 | 15.50 | 0.00 | 20.00 | 20.00 | 15.00 | 20.00 | 20.00 | 6.53 | 18.00 | 10.00 | 15.00 | 20.00 | 15.00 |
able:JJ | 20.00 | 8.89 | 12.42 | 12.00 | 12.00 | 12.00 | 20.00 | 12.50 | 12.00 | 8.67 | 20.00 | 12.00 | 7.40 | 20.00 | 12.00 | 18.57 | 9.80 | 11.86 | 20.00 | 11.91 |
to:TO | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 10.00 | 20.00 | 20.00 | 17.78 | 20.00 | 8.00 | 20.00 | 20.00 | 10.00 | 20.00 |
make:VB | 20.00 | 8.67 | 15.50 | 15.00 | 0.00 | 8.07 | 20.00 | 15.50 | 1.00 | 20.00 | 20.00 | 13.00 | 18.40 | 20.00 | 7.79 | 18.57 | 10.57 | 13.96 | 20.00 | 14.40 |
a:DT | 0.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 | 18.58 | 20.00 | 10.00 | 20.00 | 20.00 | 0.00 | 20.00 |
nuclear_weapon:NN | 20.00 | 11.95 | 6.22 | 10.00 | 15.00 | 15.00 | 20.00 | 10.50 | 15.00 | 15.00 | 20.00 | 9.85 | 14.02 | 20.00 | 14.63 | 20.00 | 10.42 | 6.77 | 20.00 | 0.00 |
NO_WORD | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 1.00 | 10.00 | 10.00 | 9.00 | 1.00 | 10.00 | 9.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 1.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -6.05 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.82 Alignment.isBad
-0.10 13.00 Alignment.nbWordNotAligned
0.10 2.00 Alignment.hypSpan
0.10 0.20 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "nuclear_weapon" modifying "manufacturing"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "now" modifying "able" is dropped on aligned hypothesis word "away"
-1.00 1.00 NullPunisher.other : manufacturing
-1.00 1.00 NullPunisher.other : major
-1.00 1.00 NullPunisher.other : from
-0.05 1.00 NullPunisher.aux : has
-1.00 1.00 NullPunisher.other : about
-0.10 1.00 NullPunisher.functionWord : that
-0.10 1.00 NullPunisher.article : A
-1.00 1.00 NullPunisher.other : review
-1.00 1.00 NullPunisher.other : nuclear_weapon
-0.10 1.00 NullPunisher.article : a
-1.00 1.00 NullPunisher.other : key
-0.10 1.00 NullPunisher.article : a
-0.10 1.00 NullPunisher.article : the
1.00 1.00 Quant.contract : Valid quantifier weakening: If a X have a property, then the X have a property
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "make" <-xcomp-- "able" vs. hyp "is" <-ccomp-- "projected", which aligned to text "be"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -14.9973
Threshold: -13.6364
Txt: Iran does not currently have nuclear weapons, and would appear to be about two years away from acquiring nuclear weapons.
Hyp: The Jerusalem post reported the Israeli government estimated that Iran would be able to build an atomic bomb as soon as the year 2008. (don't know)
The DT |
Jerusalem NNP |
post NN |
reported VBD |
the DT |
Israeli JJ |
government NN |
estimated VBD |
that IN |
Iran NNP |
would MD |
be VB |
able JJ |
to TO |
build VB |
an DT |
atomic_bomb NN |
as RB |
soon RB |
as IN |
the DT |
year NN |
2008 CD |
|
Iran:NNP | 20.50 | 7.50 | 7.97 | 15.50 | 20.50 | 9.77 | 8.86 | 15.50 | 18.00 | 0.00 | 20.50 | 15.50 | 12.50 | 20.50 | 15.50 | 17.17 | 10.50 | 15.50 | 13.00 | 20.50 | 20.50 | 8.00 | 20.50 |
does:VBZ | 18.57 | 15.50 | 12.50 | 6.80 | 18.57 | 12.50 | 14.21 | 5.95 | 20.00 | 15.50 | 18.89 | 4.07 | 11.08 | 17.95 | 6.17 | 17.89 | 15.00 | 20.00 | 17.50 | 17.84 | 18.57 | 15.00 | 20.50 |
not:RB | 20.00 | 15.50 | 10.71 | 20.00 | 20.00 | 12.50 | 15.00 | 20.00 | 18.57 | 15.50 | 20.00 | 20.00 | 12.00 | 18.00 | 20.00 | 20.00 | 15.00 | 10.00 | 8.57 | 20.00 | 20.00 | 15.00 | 20.50 |
currently:RB | 20.00 | 14.39 | 14.07 | 19.41 | 20.00 | 10.00 | 13.42 | 16.51 | 20.00 | 15.50 | 20.00 | 20.00 | 9.91 | 20.00 | 19.19 | 20.00 | 15.00 | 10.00 | 9.25 | 20.00 | 20.00 | 14.08 | 18.84 |
have:VB | 18.57 | 15.50 | 15.00 | 6.09 | 18.57 | 12.50 | 15.00 | 5.15 | 17.50 | 15.50 | 18.69 | 3.06 | 9.50 | 20.00 | 5.39 | 20.00 | 15.00 | 20.00 | 20.00 | 20.00 | 18.57 | 15.00 | 20.50 |
nuclear_weapons:NNS | 20.00 | 10.50 | 10.00 | 15.00 | 20.00 | 12.50 | 7.83 | 15.00 | 20.00 | 10.50 | 20.00 | 15.00 | 10.97 | 20.00 | 13.29 | 20.00 | 4.53 | 15.00 | 15.00 | 20.00 | 20.00 | 10.00 | 20.50 |
would:MD | 10.00 | 20.50 | 18.89 | 19.23 | 10.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.50 | 0.00 | 18.78 | 18.89 | 10.00 | 16.00 | 10.00 | 20.00 | 20.00 | 18.89 | 20.00 | 10.00 | 20.00 | 20.50 |
appear:VB | 20.00 | 15.50 | 14.52 | 6.80 | 20.00 | 11.73 | 15.00 | 5.95 | 20.00 | 15.50 | 20.00 | 1.25 | 10.00 | 20.00 | 6.17 | 20.00 | 15.00 | 20.00 | 19.35 | 20.00 | 20.00 | 10.00 | 20.50 |
to:TO | 8.00 | 20.50 | 20.00 | 20.00 | 8.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 0.00 | 20.00 | 8.20 | 20.00 | 17.32 | 20.00 | 20.00 | 8.00 | 20.00 | 20.50 |
be:VB | 18.00 | 15.50 | 15.00 | 5.25 | 18.00 | 12.50 | 15.00 | 4.19 | 20.00 | 15.50 | 18.78 | 0.00 | 8.67 | 20.00 | 4.46 | 20.00 | 15.00 | 20.00 | 20.00 | 20.00 | 18.00 | 15.00 | 20.50 |
about:RB | 20.00 | 15.50 | 11.67 | 19.23 | 18.39 | 12.50 | 15.00 | 20.00 | 18.89 | 15.50 | 18.00 | 20.00 | 8.67 | 20.00 | 20.00 | 18.13 | 15.00 | 10.00 | 8.89 | 20.00 | 18.39 | 15.00 | 20.50 |
two:CD | 17.17 | 20.50 | 20.38 | 20.50 | 17.17 | 12.50 | 20.43 | 20.50 | 19.07 | 20.50 | 20.50 | 20.50 | 11.95 | 14.50 | 20.07 | 20.50 | 20.19 | 20.50 | 19.07 | 20.50 | 17.17 | 20.27 | 10.50 |
years:NNS | 20.00 | 9.72 | 8.25 | 14.23 | 20.00 | 12.50 | 6.57 | 14.26 | 18.89 | 9.25 | 20.00 | 15.00 | 12.00 | 20.00 | 12.68 | 20.00 | 10.00 | 13.57 | 15.00 | 18.57 | 20.00 | 0.00 | 20.32 |
away:RB | 20.00 | 15.50 | 13.25 | 20.00 | 20.00 | 12.50 | 13.57 | 20.00 | 17.50 | 13.00 | 20.00 | 20.00 | 7.40 | 20.00 | 18.32 | 20.00 | 12.49 | 10.00 | 7.44 | 20.00 | 20.00 | 12.50 | 20.50 |
from:IN | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 10.00 | 18.00 | 20.00 | 20.00 | 20.00 | 17.78 | 20.00 | 18.09 | 20.00 | 20.00 | 17.50 | 10.00 | 20.00 | 20.00 | 20.50 |
acquiring:VBG | 20.00 | 14.39 | 15.00 | 5.93 | 20.00 | 12.50 | 14.47 | 4.96 | 20.00 | 14.73 | 20.00 | 2.83 | 10.24 | 20.00 | 5.21 | 20.00 | 14.00 | 20.00 | 19.30 | 20.00 | 20.00 | 15.00 | 20.50 |
nuclear_weapons:NNS | 20.00 | 10.50 | 10.00 | 15.00 | 20.00 | 12.50 | 7.83 | 15.00 | 20.00 | 10.50 | 20.00 | 15.00 | 10.97 | 20.00 | 13.29 | 20.00 | 4.53 | 15.00 | 15.00 | 20.00 | 20.00 | 10.00 | 20.50 |
NO_WORD | 1.00 | 10.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 9.00 | 9.00 | 10.00 | 1.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -5.72 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.77 Alignment.isBad
-0.10 16.00 Alignment.nbWordNotAligned
0.10 2.00 Alignment.hypSpan
0.10 0.09 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "soon" modifying "build"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "two" modifying "years" is dropped on aligned hypothesis word "year"
-2.00 1.00 Date.hypDateIns : hypothesis date insertion: 2008
-1.00 1.00 Hypernym.posNarrow : Narrowing a term (from "nuclear_weapons" to "atomic_bomb") does NOT preserve truth in a positive context
-0.05 1.00 NullPunisher.aux : be
-0.10 1.00 NullPunisher.functionWord : that
-0.10 1.00 NullPunisher.article : the
-0.10 1.00 NullPunisher.article : The
-1.00 1.00 NullPunisher.other : estimated
-3.00 1.00 NullPunisher.entity : Israeli
-3.00 1.00 NullPunisher.entity : Jerusalem
-3.00 1.00 NullPunisher.entity : 2008
-0.10 1.00 NullPunisher.functionWord : as
-0.10 1.00 NullPunisher.functionWord : as
-1.00 1.00 NullPunisher.other : soon
-0.10 1.00 NullPunisher.article : an
-1.00 1.00 NullPunisher.other : able
-1.00 1.00 NullPunisher.other : post
-1.00 1.00 NullPunisher.other : reported
-0.10 1.00 NullPunisher.article : the
-2.00 1.00 RootEntailment.unalignedRoot : "reported" not aligned to anything
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
4.00 1.00 Location.match&OK.Root.poorlyOrUnAligned :
Hand-tuned score (dot product of above): -22.1227
Threshold: -13.6364
Txt: In January 2000, the Central Intelligence Agency concluded that Iran might now be able to make a nuclear weapon.
Hyp: A major US intelligence review has projected that Iran is about a decade away from manufacturing the key ingredient for a nuclear weapon. (don't know)
A DT |
major JJ |
US_intelligence NNP |
review NN |
has VBZ |
projected VBN |
that IN |
Iran NNP |
is VBZ |
about RB |
a DT |
decade NN |
away RB |
from IN |
manufacturing VBG |
the DT |
key JJ |
ingredient NN |
a DT |
nuclear_weapon NN |
|
January:NNP | 20.50 | 10.83 | 8.54 | 9.50 | 15.50 | 15.50 | 20.50 | 9.79 | 15.50 | 15.50 | 20.50 | 6.76 | 12.77 | 20.50 | 13.50 | 20.50 | 12.50 | 9.46 | 20.50 | 10.50 |
2000:CD | 20.50 | 11.51 | 20.50 | 19.76 | 20.50 | 17.45 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 12.50 | 20.50 | 20.50 | 20.32 |
the:DT | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 15.71 | 20.50 | 20.00 | 18.39 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 | 10.00 | 20.00 |
Central_Intelligence_Agency:NNP | 20.50 | 12.50 | 7.17 | 9.87 | 15.50 | 15.50 | 20.50 | 10.09 | 15.50 | 15.50 | 20.50 | 9.66 | 15.50 | 20.50 | 15.50 | 20.50 | 12.50 | 9.84 | 20.50 | 10.50 |
concluded:VBD | 20.00 | 11.42 | 13.13 | 9.28 | 6.36 | 7.78 | 20.00 | 15.50 | 5.55 | 20.00 | 20.00 | 13.00 | 20.00 | 20.00 | 8.56 | 20.00 | 10.38 | 13.42 | 20.00 | 13.95 |
that:IN | 20.00 | 20.00 | 20.50 | 20.00 | 15.71 | 20.00 | 0.00 | 18.00 | 20.00 | 18.89 | 20.00 | 20.00 | 17.50 | 10.00 | 20.00 | 15.71 | 20.00 | 20.00 | 20.00 | 20.00 |
Iran:NNP | 20.50 | 12.50 | 4.53 | 9.92 | 14.07 | 15.50 | 18.00 | 0.00 | 15.50 | 15.50 | 20.50 | 9.72 | 13.00 | 18.00 | 15.50 | 20.50 | 12.50 | 9.54 | 20.50 | 10.50 |
might:MD | 10.00 | 18.00 | 20.50 | 20.00 | 20.00 | 20.00 | 18.89 | 19.39 | 20.00 | 18.00 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 20.00 | 10.00 | 20.00 |
now:RB | 20.00 | 12.00 | 15.50 | 15.00 | 20.00 | 20.00 | 20.00 | 15.50 | 20.00 | 10.00 | 20.00 | 15.00 | 10.00 | 18.57 | 20.00 | 20.00 | 12.00 | 15.00 | 20.00 | 15.00 |
be:VB | 20.00 | 12.00 | 15.50 | 15.00 | 3.06 | 6.90 | 20.00 | 15.50 | 0.00 | 20.00 | 20.00 | 15.00 | 20.00 | 20.00 | 6.53 | 18.00 | 10.00 | 15.00 | 20.00 | 15.00 |
able:JJ | 20.00 | 8.89 | 12.42 | 12.00 | 12.00 | 12.00 | 20.00 | 12.50 | 12.00 | 8.67 | 20.00 | 12.00 | 7.40 | 20.00 | 12.00 | 18.57 | 9.80 | 11.86 | 20.00 | 11.91 |
to:TO | 10.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 10.00 | 20.00 | 20.00 | 17.78 | 20.00 | 8.00 | 20.00 | 20.00 | 10.00 | 20.00 |
make:VB | 20.00 | 8.67 | 15.50 | 15.00 | 0.00 | 8.07 | 20.00 | 15.50 | 1.00 | 20.00 | 20.00 | 13.00 | 18.40 | 20.00 | 7.79 | 18.57 | 10.57 | 13.96 | 20.00 | 14.40 |
a:DT | 0.00 | 20.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.00 | 20.50 | 20.00 | 20.00 | 0.00 | 20.00 | 20.00 | 18.58 | 20.00 | 10.00 | 20.00 | 20.00 | 0.00 | 20.00 |
nuclear_weapon:NN | 20.00 | 11.95 | 6.22 | 10.00 | 15.00 | 15.00 | 20.00 | 10.50 | 15.00 | 15.00 | 20.00 | 9.85 | 14.02 | 20.00 | 14.63 | 20.00 | 10.42 | 6.77 | 20.00 | 0.00 |
NO_WORD | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 1.00 | 10.00 | 10.00 | 9.00 | 1.00 | 10.00 | 9.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 1.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -5.96 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.81 Alignment.isBad
-0.10 10.00 Alignment.nbWordNotAligned
0.10 4.00 Alignment.hypSpan
0.10 0.35 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "key" modifying "ingredient"
0.50 1.00 Adjunct.dropPosCxt : It is okay that text word "January" modifying "concluded" is dropped on aligned hypothesis word "projected"
-1.00 1.00 NullPunisher.other : from
-1.00 1.00 NullPunisher.other : ingredient
-1.00 1.00 NullPunisher.other : key
-1.00 1.00 NullPunisher.other : about
-0.10 1.00 NullPunisher.article : a
-1.00 1.00 NullPunisher.other : major
-3.00 1.00 NullPunisher.entity : US_intelligence
-1.00 1.00 NullPunisher.other : decade
-0.05 1.00 NullPunisher.aux : has
-0.10 1.00 NullPunisher.article : A
1.00 1.00 Quant.contract : Valid quantifier weakening: If the X have a property, then a X have a property
1.00 1.00 Quant.contract : Valid quantifier weakening: If a X have a property, then a X have a property
-2.00 1.00 Structure.parentsMismatch : args have different parents, different relations: text "make" <-xcomp-- "able" vs. hyp "is" <-ccomp-- "projected", which aligned to text "concluded"
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -15.0768
Threshold: -13.6364
Txt: In January 2000, the Central Intelligence Agency concluded that Iran might now be able to make a nuclear weapon.
Hyp: The Jerusalem post reported the Israeli government estimated that Iran would be able to build an atomic bomb as soon as the year 2008. (don't know)
The DT |
Jerusalem NNP |
post NN |
reported VBD |
the DT |
Israeli JJ |
government NN |
estimated VBD |
that IN |
Iran NNP |
would MD |
be VB |
able JJ |
to TO |
build VB |
an DT |
atomic_bomb NN |
as RB |
soon RB |
as IN |
the DT |
year NN |
2008 CD |
|
January:NNP | 20.50 | 8.00 | 9.42 | 15.50 | 20.50 | 12.50 | 8.12 | 15.50 | 20.50 | 9.79 | 20.50 | 15.50 | 12.50 | 20.50 | 15.50 | 20.50 | 10.50 | 15.50 | 15.50 | 20.50 | 20.50 | 5.95 | 20.00 |
2000:CD | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 12.50 | 20.50 | 17.50 | 20.50 | 20.50 | 20.50 | 20.50 | 11.56 | 20.50 | 18.45 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 20.50 | 19.61 | 2.50 |
the:DT | 0.00 | 20.50 | 20.00 | 20.00 | 0.00 | 20.50 | 20.00 | 20.00 | 15.71 | 20.50 | 10.00 | 18.00 | 18.57 | 8.00 | 20.00 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 0.00 | 20.00 | 20.50 |
Central_Intelligence_Agency:NNP | 20.50 | 10.31 | 9.81 | 15.50 | 20.50 | 12.50 | 7.35 | 15.50 | 20.50 | 10.09 | 20.50 | 15.50 | 12.50 | 20.50 | 15.50 | 20.50 | 10.50 | 15.50 | 15.50 | 20.50 | 20.50 | 8.99 | 20.50 |
concluded:VBD | 20.00 | 14.39 | 14.56 | 6.66 | 20.00 | 12.50 | 13.42 | 5.56 | 20.00 | 15.50 | 18.57 | 5.55 | 12.00 | 20.00 | 7.29 | 20.00 | 13.32 | 20.00 | 18.32 | 20.00 | 20.00 | 14.64 | 20.50 |
that:IN | 15.71 | 20.50 | 17.50 | 20.00 | 15.71 | 20.50 | 20.00 | 19.23 | 0.00 | 18.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 20.00 | 10.00 | 15.71 | 17.50 | 20.50 |
Iran:NNP | 20.50 | 7.50 | 7.97 | 15.50 | 20.50 | 9.77 | 8.86 | 15.50 | 18.00 | 0.00 | 20.50 | 15.50 | 12.50 | 20.50 | 15.50 | 17.17 | 10.50 | 15.50 | 13.00 | 20.50 | 20.50 | 8.00 | 20.50 |
might:MD | 10.00 | 20.50 | 18.89 | 20.00 | 10.00 | 20.50 | 20.00 | 20.00 | 18.89 | 19.39 | 10.00 | 20.00 | 20.00 | 10.00 | 20.00 | 10.00 | 20.00 | 20.00 | 20.00 | 20.00 | 10.00 | 20.00 | 20.50 |
now:RB | 20.00 | 15.50 | 13.57 | 20.00 | 20.00 | 12.50 | 15.00 | 20.00 | 20.00 | 15.50 | 20.00 | 20.00 | 12.00 | 18.00 | 20.00 | 20.00 | 15.00 | 10.00 | 8.57 | 20.00 | 20.00 | 15.00 | 20.50 |
be:VB | 18.00 | 15.50 | 15.00 | 5.25 | 18.00 | 12.50 | 15.00 | 4.19 | 20.00 | 15.50 | 18.78 | 0.00 | 8.67 | 20.00 | 4.46 | 20.00 | 15.00 | 20.00 | 20.00 | 20.00 | 18.00 | 15.00 | 20.50 |
able:JJ | 18.57 | 12.50 | 11.60 | 12.00 | 18.57 | 9.59 | 11.41 | 11.86 | 20.00 | 12.50 | 18.89 | 8.67 | 0.00 | 20.00 | 10.49 | 20.00 | 12.00 | 12.00 | 9.94 | 20.00 | 18.57 | 12.00 | 12.17 |
to:TO | 8.00 | 20.50 | 20.00 | 20.00 | 8.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 0.00 | 20.00 | 8.20 | 20.00 | 17.32 | 20.00 | 20.00 | 8.00 | 20.00 | 20.50 |
make:VB | 18.57 | 15.50 | 15.00 | 6.80 | 18.57 | 12.50 | 14.24 | 1.25 | 20.00 | 15.50 | 20.00 | 1.00 | 5.49 | 20.00 | 0.00 | 20.00 | 15.00 | 20.00 | 18.49 | 20.00 | 18.57 | 15.00 | 20.27 |
a:DT | 10.00 | 20.50 | 20.00 | 20.00 | 10.00 | 20.50 | 20.00 | 20.00 | 20.00 | 20.50 | 10.00 | 20.00 | 20.00 | 10.00 | 20.00 | 0.50 | 20.00 | 16.67 | 20.00 | 16.67 | 10.00 | 20.00 | 20.50 |
nuclear_weapon:NN | 20.00 | 10.07 | 9.44 | 15.00 | 20.00 | 12.50 | 8.51 | 14.84 | 20.00 | 10.50 | 20.00 | 15.00 | 11.91 | 20.00 | 14.95 | 20.00 | 4.66 | 15.00 | 15.00 | 20.00 | 20.00 | 10.00 | 20.50 |
NO_WORD | 1.00 | 10.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 10.00 | 1.00 | 9.00 | 10.00 | 10.00 | 1.00 | 10.00 | 9.00 | 9.00 | 10.00 | 1.00 | 10.00 | 10.00 |
Response: dontknow (CORRECT)
Justification:
Features matched (wt val name just):
1.00 -5.97 Alignment.score
1.00 0.01 Alignment.isGood
-1.00 0.81 Alignment.isBad
-0.10 9.00 Alignment.nbWordNotAligned
0.10 11.00 Alignment.hypSpan
0.10 0.52 Alignment.txtSpan
-1.00 1.00 Adjunct.addPosCxt : It is not okay that the hypothesis added the word "soon" modifying "build"
-3.00 1.00 Date.dateHeadMismatch : 2008 vs. 2000
1.00 1.00 Factive.inPositiveEmbedding : embedded positive text
-1.00 1.00 Hypernym.posNarrow : Narrowing a term (from "nuclear_weapon" to "atomic_bomb") does NOT preserve truth in a positive context
-1.00 1.00 NullPunisher.other : post
-1.00 1.00 NullPunisher.other : soon
-3.00 1.00 NullPunisher.entity : Israeli
-0.10 1.00 NullPunisher.article : The
-0.10 1.00 NullPunisher.functionWord : as
-1.00 1.00 NullPunisher.other : year
-0.10 1.00 NullPunisher.article : the
-0.10 1.00 NullPunisher.article : the
-0.10 1.00 NullPunisher.functionWord : as
1.00 1.00 Quant.contract : Valid quantifier weakening: If a X have a property, then a X have a property
2.00 1.00 Location.match : Locations match between txt and hyp; both have lemma "Iran"
Hand-tuned score (dot product of above): -14.0256
Threshold: -13.6364
Hand-set weights Accuracy: 21/23 = 0.9130
Word similarity table built on Thu May 24 08:03:41 PDT 2007 using command:
java edu.stanford.nlp.rte.WordSimilarityGenerator -info /u/nlp/rte/data/byformat/align/simple/chris-rte.align.xml -output /u/nlp/rte/data/byformat/wordsim/simple/chris-rte.wordsim.html -alignmentWeights manual -saveCache