3 ms·
Microsoft, Google, Amazon, Meta are all building or using their in-house chips already and are working hard to replace Nvidia as much as they can, especially on
by synergy20 3y ago
Microsoft, Google, Amazon, Meta are all building or using their in-house chips already and are working hard to replace Nvidia as much as they can, especially on the inferential side. OpenAI is basically doing similar things, nothing magic other than Altman wants to use his own chip design.
Further, on the hardware side, you have Nvidia, AMD, Intel that are competing fiercely.
OpenAI is already under attack from Meta and Google and who know how many LLM companies, while it's the first runner for now, that might change fast.
In the worst scenario, its LLM will become just one of a few in 2024, and its chip design will be a few years away if anything and might just turns out to be nothing, just look at Musk's Dojo AI chip, which started years ago and still he is buying Nvidia.
Keep acing at your LLM, and leverage Azure's platform for now, then also use some AWS to be safer. Forget about making your chip, it's too far away, and it's too crowded there and too late, you don't need to do everything to be successful, at least, no rush for that now.
- hackernewds 3y agoMost of the companies trying to make their own chips will most likely fail. There are 15 year lead times at foundries and the equipment makers. TSM and ASML still retain almost global monopolies at what they do for a reason - it's highly highly specialized
- chipgap98 3y agoTotally agree with this. The current AI wave is creating a lot of financial incentive to find ways to speed this up though. Interested to see if there ends up being a way around the TSMC / ASML bottleneck.
- LamaOfRuin 3y agoIntel, considering their new partnership with an also-ran Taiwanese contract fab company, has a plausible play for competing with TSMC for leading edge manufacturing in the next few years. Beyond all the existing scaling up started based on pandemic shortages, that's the only thing I've heard of that has a chance of making a dent within 5-10 years. Of course, all that already started scaling up might already be more than enough if you're not a true believer.
- ac29 3y ago> There are 15 year lead times at foundries and the equipment makers. This is a wild claim, can you explain? You are suggesting that a chip who's design is manufacturing ready today cant be built until 2039?
- metadat 3y ago> Microsoft, Google, Amazon, Meta are all building or using their in-house chips already and are working hard to replace Nvidia as much as they can, Is this true for FB? They just spent billions on 500,000 H100s (disclosed in their earnings report a week or two ago).
- ororroro 3y agoYes. https://www.reuters.com/technology/meta-deploy-in-house-custom-chips-this-year-power-ai-drive-memo-2024-02-01/ https://www.reuters.com/technology/meta-deploy-in-house-cust...
- deleted 3y ago[deleted]