4 ms·
Remember, LLMs are purely language AIs. They can and will lie because "an answer " has been weighted high enough that it'll do anything to satisfy that requirem
by sonicanatidae 3y ago
Remember, LLMs are purely language AIs. They can and will lie because "an answer " has been weighted high enough that it'll do anything to satisfy that requirement. The purpose of them is to create natural sounding language in response to what it parses the input to be. That's it.
It's similar with what I call "action AIs", where an AI tries to learn to walk, or race a car, optimally, through a track. It will often repeat mistakes, because short term it gains a higher score and takes time to learn that short term gains, in some cases, harm long term gains.
People are using a hammer to install screws. Technically it works, but that's not the droid they were really looking for.
- JumpCrisscross 3y agoWhich puts pathological liars into a new light, at least for me. They’re compulsively story completing.