3 ms·
Let's not undersell it. Yes, you can identify inconsistencies in the unicorn example (if you are reading it more carefully than many people, HNers included, rea
by gwern 8y ago
Let's not undersell it. Yes, you can identify inconsistencies in the unicorn example (if you are reading it more carefully than many people, HNers included, read most things), and some of the other examples, like the LoTR one, are more blatantly inconsistent than that. But on the other hand, look at the anti-recycling example: is there a single inconsistency in it? (On Twitter, someone insisted to me that the anti-recycling example proved GPT-2 was merely memorizing human input and spitting it back out - specifically, copying from Reddit, because they found a post of it on Reddit, until I pointed out to them that the timestamp was after OA's announcement.)
When it comes to attacks, it's not the average-case which matters.