8 ms·
So at what point do the linear increases in capability not justify the exponential compute and data requirements, or when do we run out of resources to throw at
by lispisok 2y ago
So at what point do the linear increases in capability not justify the exponential compute and data requirements, or when do we run out of resources to throw at it?
- famouswaffles 2y agoI never said I thought increase in ability was linear either. We're encroaching on phenomena that's genuinely hard to describe/put a number on but GPT-3 is worlds apart of 2 and it feels like 4 is easily ten times better than the OG 3. I can say Improvement lags behind compute somewhat but that’s really it. That said, it's ultimately up to the people footing the bill isn't it ?