5 ms·
Would an average human be able to do that on a strict time limit (which LLMs effectively have as they do a fixed amount of computation per token)?
by circuit10 3y ago
Would an average human be able to do that on a strict time limit (which LLMs effectively have as they do a fixed amount of computation per token)?
- appplication 3y agoThe mark for reasoning in a computer program is not whether or not a human can do so on the same time limit. A calculator doesn’t reason but solves 658236 x 37854285 faster than anything human could. You could give an LLM days per token and it wouldn’t change its capabilities regarding reasoning.
- circuit10 3y agoI'm not saying that this is proof that it can reason, but rather that the fact that it can't isn't proof that it can't on its own