4 ms·
It's pretty easy to craft a prompt that will force the LLM to reply with something like > The `foobar` is also incorrect. It should be a valid frobozz, but it
by otabdeveloper4 1y ago
It's pretty easy to craft a prompt that will force the LLM to reply with something like
> The `foobar` is also incorrect. It should be a valid frobozz, but it currently points to `ABC`, which is not a valid frobozz format. It should be something like `ABC`.
Where the two `ABC`s are the exact same string of tokens.
Obviously nonsense to any human, but a valid LLM output for any LLM.
This is just one example. Once you start using LLMs as tools instead of virtual pets you'll find lots more similar.
- Zambyte 1y agoPeople say nonsense all the time. LLMs also don't have this issue all the time. They are also often right instead of saying things like this. If this reply was meant to be a demonstration of LLMs not having human level understanding and reasoning, I'm not convinced.
- croes 1y agoNot people, some people. But a LLM is sometimes the genius and sometimes the idiot. That doesn’t happen often if you always talk to the same person
- otabdeveloper4 1y ago"Doing 'A' is wrong, to fix it you need to do 'A'" is not an idiotic statement. It's complete non-sense that no human has ever uttered. But for LLMs these kinds of illogical statements are common. LLMs don't think; what they do cannot be in good faith called "thinking" by any definition.