4 ms·

I'm enjoying trying some of these out on ChatGPT. The prediction for multiplying two 5-digit numbers is correct for ChatGPT - the middle digits are wrong (non-

I'm enjoying trying some of these out on ChatGPT. The prediction for multiplying two 5-digit numbers is correct for ChatGPT - the middle digits are wrong (non-deterministically). The example "Question: How many times does the word "all" occur in the following sentence: All the lice and all the mice were all very nice to all the mice and all the lice." results in answers of 5 or 6, about 50/50 split.

dane-pgp 4y ago
> multiplying two 5-digit numbers To be fair, 99% of humans can't do that unaided (that is, without a calculator, or some way of visually laying out the intermediate steps) either. In fact, I'd say that 90% of humans can't do the necessary long multiplication steps even with a pencil and paper, and maybe 20% of humans couldn't do it even with a calculator (due to being too young; or having a disability; or growing up in a environment where they are not taught how to use a calculator or even the concept of multiplication at all). I just think it's ironic if people are suggesting that their threshold for finding an AI "impressive" requires it to already be effectively super-human. It's like they're retreating from the bailey of long AI timelines to the motte of: "Sure, I can't think of anything a human can do that an AI can't, but that's not really significant, because humans aren't particularly intelligent". Perhaps a more relevant test would be to ask ChatGPT something like: "If a human wanted to calculate the product of the two numbers 12345 and 56789, and they had a calculator with them, what sequence of buttons would they press, in order, to find the result?".