3 ms·
Because if NN is smart enough, it should be able to do arithmetic flawlessly. Basic arithmetic doesn't even require that much intelligence, it's mostly attentio
by bufferoverflow 3y ago
Because if NN is smart enough, it should be able to do arithmetic flawlessly. Basic arithmetic doesn't even require that much intelligence, it's mostly attention to detail.
- janalsncm 3y agoWell it’s obviously not smart enough so the question is what do you do about it? Train another net that’s 1000x as big for 99% accuracy or hand it off to the lowly calculator which will get it right 100% of the time? And 1000x is just a guess. We have no scaling laws about this kind of thing. It could be a million. It could be 10.
- bufferoverflow 3y agoI agree with you that we don't know if will take 10x or 1 million. We don't know if current LLM will scale at all. It might not be the way to AGI. But while we can delegate the math to the calculator, it's essentially sweeping the problem under the rug. It actually tells you your neural net is not very smart. We know for a fact that it was exposed to tons of math during training, and it still can't do even the most basic addition reliably, let alone multiplication or division. What we want is an actually smart network, not a dumb search engine that knows a billion factoids and quotes, and that hallucinates randomly.