3 ms·
You can't ask something to check its own work without external reward/penalty. It'll cheat.
by pishpash 5mo ago
You can't ask something to check its own work without external reward/penalty. It'll cheat.
- khasan222 5mo agoWeirdly, and i fully think this is just some cognitive bias I don't have the knowledge to name, the ai seems very happy to please me. Like when it gets something done in one shot, it seems very happy to do so.
- daveguy 5mo agoIt's because expressing emotion tests well in RLHF (reinforcement learning, human feedback), which is the layer on top of the next-token-predictor LLM. As a bonus, it helps manipulate operator reactions to incorrect output, and improve engagement (aka token use). The "thought process" of an LLM only exists as inference response to next token prediction prompts. It's the illusion of emotion.