2 ms·
nvidia is the shovel seller
by whimsicalism 3y ago
nvidia is the shovel seller
- wing-_-nuts 3y agoquibble, but nvidia is the shovel maker. LLMs require a lot of vram but the underlying hardware requirements are actually fairly simple. There are already efforts in place to create inference specific ASICs. That'll absolutely eat into Nvidia's profit margins.
- skadamat 3y agoYeah computation has more layers and sellers, it's not a perfect analogy but good enough I feel