4 ms·
AGI seems like a stretch when none of the LLM’s right now can solve the prompt: “ Write a sentence that has an odd number of words, with the third word being "
by sashank_1509 2y ago
AGI seems like a stretch when none of the LLM’s right now can solve the prompt:
“
Write a sentence that has an odd number of words, with the third word being "keyboard", the last word being "anyway", the next-to-last word being a number, and the first word being a palindrome
“
Do we have to add these examples to the dataset now, so that they can solve this? Then maybe we find another prompt and add that too, as a human I’ve never seen such a question before, why do I seem to be able to do it so easily? We are creating some form of intelligence that will have a massive economic impact, but I doubt we are creating human like intelligence that has the ability of being far better than humans along every dimension, which is what super intelligence is
- npinsker 2y agogpt-4o produced a correct sentence first try for me
- plaidfuji 2y agoInteresting, gpt-4o took seven tries to do this, and I had to give it very specific feedback about what it was doing wrong. Here was the answer: Level says keyboard broke down today, needing repair within five anyway.
- gwern 2y agoGPT-4o still uses BPEs.
- sashank_1509 2y agoI would prefer if it can give the number 5 instead of five. Also I don’t like to tell it what exactly it got wrong, just that it got it wrong. Saying things like think step by step, focus on rules etc is all fair game, while saying “keyboard is the second word, not third”, imo is not. I tried quite a bit when I saw this example on twitter and could never get it to work.
- croemer 2y agoIs this correct? First try ChatGPT4: "Anna uses keyboard swiftly without missing five anyway." Prompt exactly yours: https://chatgpt.com/share/ff3169cb-0d45-4cdb-bf18-bc552ad697ec https://chatgpt.com/share/ff3169cb-0d45-4cdb-bf18-bc552ad697... Woop, I forgot about the odd number of words.
- luyu_wu 2y agoWhy is this a goalpost for just about anything? This seems completely uncorrelated, and I'm sure many fully grown adults would fail under similar timing conditions too.