2 ms·
isn’t it interesting how often this rhetorical construction is overused by AI?
by mrtesthah 9mo ago
isn’t it interesting how often this rhetorical construction is overused by AI?
- bangaladore 9mo agoVery much so. It feels like it can't have been that common in the original training corpus. Probably more common now given that we are training slop generators with slop.
- TeMPOraL 9mo agoPartly because it's a good construct. Most people's writing is garbage compared to what LLMs output by default. But the other part of it is, each conversation you have, and each piece of AI output you read online, is written by LLM instance that has no memory of prior conversations, so it doesn't know that, from human perspective, it used this construct 20 times in the last hour. Human writers avoid repeating the same phrases in quick succession, even across different writings (e.g. I might not reuse some phrase in email to person A, because I just used it in email to unrelated person B, and it feels like bad style). Perhaps that's why reading LLM output feels like reading high school essays. Those essays all look alike because they're all written independently and each is a self-contained piece where the author tries to show off their mastery of language. After reading 20 of them in a row, one too gets tired of seeing the same few constructs being used in nearly every one of them.
- mrtesthah 9mo ago>But the other part of it is, each conversation you have, and each piece of AI output you read online, is written by LLM instance that has no memory of prior conversations, so it doesn't know that, from human perspective, it used this construct 20 times in the last hour. In theory we should be able to use these properties to detect LLM-generated output better if we can explore how they originate in the “default” trained feature space.