3 ms·
Local models becoming thousands of dollars instead of millions to run is a story the public genuinely seems to be unaware of. If the order of magnitude falls ag
by 1970-01-01 5mo ago
Local models becoming thousands of dollars instead of millions to run is a story the public genuinely seems to be unaware of. If the order of magnitude falls again, the markets are cooked. The cheap chips barrier is even artificial and unsustainable. The next big story in local AI adoption will be big players doing chip hoarding-as-a-strategy.
- wombat-man 5mo agoI think this is part of why capex is so high for the big players. Yes data centers are expensive to build but it's also about outbidding for the labor and materials needed to build those. They'd rather build compute they don't need and then lease it then let competitors have their own machines.
- iceflinger 5mo agoI'm fully convinced now that this is the real reason for the OpenAI RAM wafer deals.