3 ms·
I hate the AI writing but this is probably right. - There are a number of competitors for hardware, from Microsoft, Meta, Google, and Amazon. Those are mostly
by Schiendelman 6mo ago
I hate the AI writing but this is probably right.
- There are a number of competitors for hardware, from Microsoft, Meta, Google, and Amazon. Those are mostly serving internal needs today, but Amazon and Google tend to productize their internal products. Other players are also selling chips - the author mentions Broadcom.
- Both Google and Apple are doing their best to shift inference costs to the consumer. While this seems expensive right now, it will last at most a couple of years. Once RAM production catches up, this will take pressure off cloud inference.
NVIDIA will probably hit 8T before it shrinks. But it's in a hypercompetitive market now in a way it wasn't when LLMs weren't yet driving demand for its hardware.