3 ms·
This is a tell of LLMs but it's not universal. I use ChatGPT extensively and I don't often get obvious nonsense any more. I'd figure out that it's an LLM beca
by treis 1mo ago
This is a tell of LLMs but it's not universal. I use ChatGPT extensively and I don't often get obvious nonsense any more.
I'd figure out that it's an LLM because it's effectively superhuman. Taking that away I'm not so sure I'd be able to tell
- jurgenburgen 1mo agoThe ultimate tell is still the sycophancy. You agree with the suggestion output by the LLM but if it detects even a slight pushback it will completely reverse the previous suggestion. Only way to make it more obvious would be to have the LLM grovel and beg. If these things have consciousness then we are committing sadism on a massive scale.
- treis 1mo agoIt feels like it's getting better at that too. It will push back against obvious nonsense a lot stronger. But you are right that it holds opinions quite a bit less strenuously than humans.