3 ms·
The example figure has a weird entry for the summary task. The input is: "summarize: state authorities dispatched emergency crews tuesday to survey the damage
by vbarrielle 7y ago
The example figure has a weird entry for the summary task. The input is:
"summarize: state authorities dispatched emergency crews tuesday to survey the damage after an onslaught of severe weather in mississippi..."
And the output is:
"six people hospitalized after a storm in attala county."
That's quite a bad summary, no mention of "six" people in the original text, no mention of hospitalization. And "attala" county is too specific, a precision not present in the original text.
If that's the result of their model, that's not good. If it's coming from the training set, it's an even bigger problem. I guess it's the result of the model, because some issues can be explained by correlations ("emergency" correlates with "hospital", "mississipi" correlates with "attala").
I'm wondering why they chose this example for the flagship figure of their paper.
- mritun 7y agoThe “...” at the end of the phrase is the give away that they couldn’t fit the whole article in the picture. Checkout the complete paper.
- deleted 7y ago[deleted]
- vbarrielle 7y agoI missed that ellipsis cue, thanks for pointing it out. The complete excerpt is not in the complete paper though, but it's probably in their released data.
- Tepix 7y agoI agree that it's a bad example. I suppose the ellipsis at the end indicates an omission of a whole section.