2 ms·
Small models can't do impressive language corner cases. And the benefits of the models that can scale linearly while their cost grows geometrically. Also claim
by namaria 2y ago
Small models can't do impressive language corner cases. And the benefits of the models that can scale linearly while their cost grows geometrically.
Also claiming training costs are 'one off' when there's so much resources being poured into training new and bigger models is disingenuous.
- mensetmanusman 2y agoThe resources pouring in still pale in comparison to capital expenditures in the semi conductor industry.
- namaria 2y agoThe inflation in semi conductor capital expenditure is the problem caused by the AI hype.
- mensetmanusman 2y agoNah, tsmc spending tens of billion annually on capital before OpenAI.