3 ms·
> Does anyone have the stomach for $100M training costs, say? No, but the point of such law is that it will get exponentially cheaper as well (also count in th
by albertzeyer 5y ago
> Does anyone have the stomach for $100M training costs, say?
No, but the point of such law is that it will get exponentially cheaper as well (also count in the inflation of money over time).
So, maybe next year we can train some 10x bigger model in just the same amount of money.