3 ms·

'perplexity'?

• esafak 3y ago
  https://en.wikipedia.org/wiki/Perplexity https://en.wikipedia.org/wiki/Perplexity
• IanCal 3y ago
  The wiki link is good. In the context here it's easy to picture it as how weird a sentence would sound to a native speaker. Low perplexity means what was generated would be unsurprising if you saw it in the dataset.
  • _a_a_a_ 3y ago
    I'll check the wiki link, but how is perplexity different from the measure of Surprise, in terms of Shannon's stuff?