3 ms·

I find the thing incredibly smart and yet utterly useless at times. I just spent 20 minutes getting the current iteration of ChatGPT to agree with me that a ce

I find the thing incredibly smart and yet utterly useless at times. I just spent 20 minutes getting the current iteration of ChatGPT to agree with me that a certain sentence is palindromic. Even when you make it print the unaccented characters one by one, spaces excluded, backwards and forwards, it still insists "Élu par cette crapule" isn't palindromic. I understand how tokenization makes this difficult but come on... this doesn't feel like a difficult task for something that supposedly passes the LSATs and whatnot. * French for "Elected by this piece of shit"

ShannonLimiter 4y ago
Just ask it to figure it out step-by-step and to remove accents: GPT-4: Figure this out step by step and check your work: Remove the accents and tell me if this a palindrome: Élu par cette crapule GPT-3.5 (Needs to know that removing spaces and lowercasing is okay): Figure this out step by step and check your work: Lowercase it and remove the accents and spaces and tell me if this a palindrome: Élu par cette crapule
- deleted 4y ago
  [deleted]
sbierwagen 4y ago
LLMs using BPEs are generally going to be bad at string reversal tasks, since they can't see individual letters: https://news.ycombinator.com/item?id=35297183 https://news.ycombinator.com/item?id=35297183