4 ms·
> LLMs seem to operate on the principle of "will this pass for a correct answer" My new thing: Testing LLM critique against humans. The results are sobering.
by jstummbillig 3y ago
> LLMs seem to operate on the principle of "will this pass for a correct answer"
My new thing: Testing LLM critique against humans.
The results are sobering.
- trimethylpurine 3y agoWhen an LLM fails, it needs you to tell it that it failed, and it needs you to tell it to try again. Conversely, we experience a desire to be thought of as just, and that drives us to seek information on our own. While it mimics the language, it doesn't mimic that honesty because it doesn't need to be honest. That said, it's impressive that the LLM fools you enough to be sobered by the comparison.
- jstummbillig 3y agoWell, now I am mostly sad about the great density of human talent I have apparently missed out on. In my experience, there is a wild amount of finding absolutely nothing wrong with what is clearly going wrong and me having to prompt some variation of "so... what were you planning to do about that thing?" for something to happen.
- trimethylpurine 3y agoAnd are you an LLM or are you the only human that feels this way? You've proven my point by replying to my comment.