3 ms·

ChatGPT (4?) seems to have gone the other way and became too disagreeable. I asked it to mark my daughter's homework, and it would say things like "This answer

by muzani 3y ago

ChatGPT (4?) seems to have gone the other way and became too disagreeable. I asked it to mark my daughter's homework, and it would say things like "This answer is incorrect. 50-28 is not 22. The correct answer is 22." And no matter how I tried to convince it, it would argue that 22 is indeed not 22.

7734128 3y ago
Of course 22 isn't the same as 22. The first one is an integer and the second is a string.
- TeMPOraL 3y ago
  And/or "22" is an integer, "22." is a float.
gryn 3y ago
Maybe it's just using a different type of math with no axiom of extentionality. Did your daughter provide a proof of equivalence between 55-28 and 22 ? It's against its sensibilities to just assume your axioms. /s ( I have no clue what I'm talking about)
PeterisP 3y ago
For all you know, since it works not on text but on a sequence of token IDs, perhaps these two are actually different things, one is a token representing "22" (which exists in ChatGPT vocabulary) and the other is two separate tokens each representing "2".
- muzani 3y ago
  I figured it had something to do with tokens, but this is an interesting insight I didn't think of. What's funny is if you feed the conversation back into a new chat, it understands that it's obviously wrong, but it will be insistent when it's the same conversation.
drcwpl 3y ago
Were there any negations in the prompt? E.G. "Not" GPT has a terrible issue with negations - if you say for example create an illsutration of a hacker wearing a hoodie, without glasses." it will create with glasses - negations are the bain of LLMs
- bonton89 3y ago
  I had a good laugh with my wife because after asking it to generate an image of lich it seemed to be created generic undead as most of the images had elf like ears you might see on a vampire. So I asked it to generate the same images but with NO elf ears and all the next set of images had HUGE elf ears. I later had the same problem trying to get it to remove errant light sabers it was adding to mecha it generated, whereupon it generated something very close to general general grievous. It was hard not to feel like I was being intentionally trolled.
- muzani 3y ago
  Negations were not used here. It was mostly just a screenshots. There's actually a game to trick Gandalf (AI) into telling a lie, and the fastest way was to use this number thing - it's quite easy to replicate back in the day. Also I'd say numbers are the bane of LLMs lol. A sibling comment put it in an interesting way in that it might tokenize one as twenty two and the second number as two two.

by muzani 3y ago

7734128 3y ago

Of course 22 isn't the same as 22. The first one is an integer and the second is a string.

TeMPOraL 3y ago
And/or "22" is an integer, "22." is a float.

gryn 3y ago

Maybe it's just using a different type of math with no axiom of extentionality. Did your daughter provide a proof of equivalence between 55-28 and 22 ? It's against its sensibilities to just assume your axioms. /s ( I have no clue what I'm talking about)

PeterisP 3y ago

For all you know, since it works not on text but on a sequence of token IDs, perhaps these two are actually different things, one is a token representing "22" (which exists in ChatGPT vocabulary) and the other is two separate tokens each representing "2".

muzani 3y ago
I figured it had something to do with tokens, but this is an interesting insight I didn't think of. What's funny is if you feed the conversation back into a new chat, it understands that it's obviously wrong, but it will be insistent when it's the same conversation.

drcwpl 3y ago

Were there any negations in the prompt? E.G. "Not" GPT has a terrible issue with negations - if you say for example create an illsutration of a hacker wearing a hoodie, without glasses." it will create with glasses - negations are the bain of LLMs

bonton89 3y ago
I had a good laugh with my wife because after asking it to generate an image of lich it seemed to be created generic undead as most of the images had elf like ears you might see on a vampire. So I asked it to generate the same images but with NO elf ears and all the next set of images had HUGE elf ears. I later had the same problem trying to get it to remove errant light sabers it was adding to mecha it generated, whereupon it generated something very close to general general grievous. It was hard not to feel like I was being intentionally trolled.
muzani 3y ago
Negations were not used here. It was mostly just a screenshots. There's actually a game to trick Gandalf (AI) into telling a lie, and the fastest way was to use this number thing - it's quite easy to replicate back in the day. Also I'd say numbers are the bane of LLMs lol. A sibling comment put it in an interesting way in that it might tokenize one as twenty two and the second number as two two.