4 ms·
That answer has so many errors it’s embarrassing. It’s egregiously wrong. Even the statement of the rules it’s going to follow has errors. By the time it gets
by latexr 3y ago
That answer has so many errors it’s embarrassing. It’s egregiously wrong. Even the statement of the rules it’s going to follow has errors.
By the time it gets to 10 it states it as 11 and remains wrong until it self-corrects by 29, but then thinks there are three numbers between 32 and 34 and the errors keep going. It doesn’t even correctly substitute Fizz and Buzz in the most basic places. It’s a mess that even a child learning the game for the first time would avoid, or at least stop and reevaluate.
- harperlee 3y agoI would say, based on experience, that kids aged 3 or 4 would be similarly nonsensical, changing number ordering, improvising without any consideration for self-consistency, and heavily focused in the present irrespective of what has just happened.
- jfoster 3y agoIt's also clearly demonstrating more intelligence than we would generally expect from other animals.
- latexr 3y agoBy that logic, autocorrect and Markov chains would be considered intelligent. As the quote goes: “If you judge a fish by its ability to climb a tree…”
- latexr 3y ago> I would say, based on experience, that kids aged 3 or 4 would be similarly nonsensical Is that how OpenAI positions ChatGPT? As useful as a four year old knowledge worker? Because that is not useful for the tasks people are giving it. If the best defence that can be mustered to outright wrong answers is that a baby would make similar errors, there’s no point in even discussing OP’s AGI question. A good faith argument would recognise that when comparing to a child, we’re considering at a minimum the age and mental capacity to count and understand what a “multiple of” is.
- famouswaffles 3y ago4 handles this just fine. This is one of the most frustrating parts of these discussions. Making sweeping claims on the abilities of LLMs and the evaluator isn't even bothered to use the current state of the art.
- d--b 3y agoWhatever, man. Just did it with "Bing with GPT-4", not sure what that uses, and I refuse to pay OpenAI to do this so... Anyways, results are : Sure, let’s play Fizz Buzz with 3 and 7. Here are the first 15 numbers: 1, 2, Fizz, 4, 5, Fizz, 7, 8, Fizz, 10, 11, Fizz, 13, Buzz, Fizz In this game: Numbers divisible by 3 are replaced by “Fizz” Numbers divisible by 7 are replaced by “Buzz” Numbers divisible by both become “FizzBuzz” Would you like to continue or change the rules? It's better but still wrong. I tried with 2 and 7, it was wrong too.
- famouswaffles 3y agohttps://sl.bing.net/hafEGFSHcT6 https://sl.bing.net/hafEGFSHcT6
- latexr 3y agoIt’s also worrisome that someone who is making a specific point about the output of an LLM didn’t spend a couple of seconds to verify if their results aligned with their beliefs. If they didn’t do it in this situation, I have zero trust they do any kind of verification for other uses. The worse part is that is probably going to be the norm.