3 ms·
Maybe it learn it from content farms, not RL. Before LLM, the majority of the web was content farms... but those are instantly recognizable and we seldom fall
by j16sdiz 2mo ago
Maybe it learn it from content farms, not RL.
Before LLM, the majority of the web was content farms... but those are instantly recognizable and we seldom fall into them. Now LLM mixed the content farm style writing with _some_ real content. It take time and effort to tell they are slop, causing much fatigue.
- mvanveen 2mo agoI have no data to back up this claim but one hypothesis I have is it's gotten particularly acutely bad esp with newer gen models because of increased training on reasoning and chain-of-thought. To borrow a programming lang analogy the failure mode I see a lot is it invents its own jargon that is effectively like a compiler intermediate representation of the high level natural language you actually want a human to look at and then inserts it directly into what the human has to read. It needs to stop doing that but it doesn't seem to do a good job at differentiating from what is or isn't chain of thought slop. I'm sure the jargon is useful during its reasoning but it's very unhelpful and not very nice to deliver it to a human.