3 ms·
Law of diminishing returns. We’re talking about less than a 10% performance gain, for a shitload of data, time, and money investment.
by diogolsq 1y ago
Law of diminishing returns.
We’re talking about less than a 10% performance gain, for a shitload of data, time, and money investment.
- illiac786 1y agoYeah I think that throwing more and more compute at the same training data produces smaller and smaller gains. Maybe quantum compute would be significant enough of a computing leap to meaningfully move the needle again.
- stoneyhrm1 1y agoWhat exactly is being moved? It's trained on human data, you can't make code more perfect than what is written out there by a human.
- illiac786 1y agoSome think it’s possible, I don’t, we agree actually.
- gwd 1y agoI'm not sure what "10% performance gain" is supposed to mean here; but moving from "It does a decent job 95% of the time but screws it up 5%" to "It does a decent job 98% of the time and screws it up 2%" to "It does a decent job 99.5% of the time and only screws it up 0.5%" are major qualitative improvements.