2 ms·
> Now I guess you can pick up the goal post and move it. The central problem with math is that you have an infinite amount of space within which to move these
by bob1029 2y ago
> Now I guess you can pick up the goal post and move it.
The central problem with math is that you have an infinite amount of space within which to move these goalposts.
How many variants on this trial before we find a mistake?
What is an acceptable error rate?
- jimhefferon 2y agoAt this moment, the error rate seems to be that of a beginning graduate student. Or at least, that's what Terry Tao thinks. That's pretty good.
- lupire 2y agoThat is not at all what Tao said. https://mathstodon.xyz/@tao/113132502735585408 https://mathstodon.xyz/@tao/113132502735585408 "Here the results were better than previous models, but still slightly disappointing: the new model could work its way to a correct (and well-written) solution if provided a lot of hints and prodding, but did not generate the key conceptual ideas on its own, and did make some non-trivial mistakes. The experience seemed roughly on par with trying to advise a mediocre, but not completely incompetent, (static simulation of a) graduate student. "
- buneskamin 2y agoYea it does seem pretty clear that it's mainly Terrance's contributions to the context window that is bringing the model to the right answer
- naasking 2y ago> How many variants on this trial before we find a mistake? How many variants would it take for a human to make a mistake? It's certainly not "infinity", so is this an indication that humans don't reason?