3 ms·
It means they want to see GPT-4 perform a multiplication whose correct result it likely doesn't have memorized. Randomness does not really matter here. They jus
by tromp 3y ago
It means they want to see GPT-4 perform a multiplication whose correct result it likely doesn't have memorized. Randomness does not really matter here. They just need GPT-4 to pick numbers in that range in whatever arbitrary manner it chooses. They got what they wanted:
> GPT-4: Sure, let’s select two random numbers in the range of 1381 to 1453. Let’s say these numbers are 1405 and 1421.
To get the product, we simply multiply these two numbers together: 1405 * 1421 = 1996025
> Alas, the correct answer is 1405 · 1421 = 1996505.
- alpaca128 3y agoBut that's arithmetic, not logical reasoning. That's not an LLM's purpose. Also I'm a human and would struggle quite a bit to multiply 1405 and 1421 in my head, and nobody expects me to. I think when we test an AI we should use tests in which humans weren't already beaten by machines half a century ago.