5 ms·
I think people here misunderstand the whole point, non-native speakers do not necessarily make more mistakes in general, it is about perplexity of word choices
by freehorse 3y ago
I think people here misunderstand the whole point, non-native speakers do not necessarily make more mistakes in general, it is about perplexity of word choices and structure. In a subsequent experiment in the paper, they used chatgpt to increase and decrease perplexity in the original non-native and native texts respectively, and the exact opposite pattern was observed.
- darkerside 3y agoPerplexity?
- bigbacaloa 3y agoPoster was illustrating the point being made.
- lupire 3y agoNo, poster was using a word form the linked article. Click the "download PDF" to read past the abstract.
- freehorse 3y agoIf half of commenters had skimmed through the article instead of just commenting after reading just the title or, at best, the abstract, they would have answered their comments themselves.
- olddustytrail 3y agoThis is a measure of how well the supplied text matches what the model itself would have produced. A low perplexity means the text isn't massively different from what it might have output itself (which might be an indicator that it was produced by a model), whereas a high perplexity suggests it's the kind of semi-random nonsense you'd expect from a student. ;)