4 ms·

A lot of that sense was probably based on side channels like proper grammar, writing style, etc. That’s all gone now :(

deleted 2mo ago
[deleted]
Kerrick 2mo ago
No, the sense had nothing to do with the content and everything to do with the context. Perfect grammar and writing style were never enough to get me to trust an anonymous forum post or unknown bloggers post for certain topics like health advice. Sloppy grammar and writing style were never a deterrent for me believing them for other kinds of topics like where to check on the HVAC system to find the sticker. I think the line could more accurately be described as the level of risk if it's wrong.
Buttons840 2mo ago
We have other signals now. Before we would find an intriguing post on the internet from years ago, and you have to verify it with additional research--it's easy to skip that additional research. With a LLM when you're skeptical you can interogate it. One thing we know for sure is LLMs are quick to admit mistakes were made when interrogated, comically so. A LLM might not always recognize its own mistake, but at least it is available for easy interogation, unlike the forum posts of old. Manual research from reputable sources remains an option.
- rogerrogerr 2mo ago
  You can't interrogate the context of an LLM when you only have its output.
eddd-ddde 2mo ago
For what reason would grammar influence whether something is true or not...
- giaour 2mo ago
  You could tell from tone and polish how much effort someone had put into writing an answer. That was a pretty good signal for some topics on forum sites like Stack Overflow. There were always nuts and cranks who would happily spend an hour writing well-formed prose about nonsense or something obviously wrong, but the eloquent ones were few and far between. Now every crank is equally eloquent and can spit out 1,500 words of passable prose in seconds.
rcxdude 2mo ago
I dunno, I've read a lot of very well presented nonsense and some very useful insights that were barely readable. I think it's probably useful that people are being trained out of this bias (though of course that's in large part because LLMs do tend to exploit this bias).

deleted 2mo ago

[deleted]

No, the sense had nothing to do with the content and everything to do with the context. Perfect grammar and writing style were never enough to get me to trust an anonymous forum post or unknown bloggers post for certain topics like health advice. Sloppy grammar and writing style were never a deterrent for me believing them for other kinds of topics like where to check on the HVAC system to find the sticker. I think the line could more accurately be described as the level of risk if it's wrong.

Buttons840 2mo ago

We have other signals now. Before we would find an intriguing post on the internet from years ago, and you have to verify it with additional research--it's easy to skip that additional research. With a LLM when you're skeptical you can interogate it. One thing we know for sure is LLMs are quick to admit mistakes were made when interrogated, comically so. A LLM might not always recognize its own mistake, but at least it is available for easy interogation, unlike the forum posts of old. Manual research from reputable sources remains an option.

rogerrogerr 2mo ago
You can't interrogate the context of an LLM when you only have its output.

eddd-ddde 2mo ago

For what reason would grammar influence whether something is true or not...

giaour 2mo ago
You could tell from tone and polish how much effort someone had put into writing an answer. That was a pretty good signal for some topics on forum sites like Stack Overflow. There were always nuts and cranks who would happily spend an hour writing well-formed prose about nonsense or something obviously wrong, but the eloquent ones were few and far between. Now every crank is equally eloquent and can spit out 1,500 words of passable prose in seconds.

rcxdude 2mo ago

I dunno, I've read a lot of very well presented nonsense and some very useful insights that were barely readable. I think it's probably useful that people are being trained out of this bias (though of course that's in large part because LLMs do tend to exploit this bias).