4 ms·
quibble, but nvidia is the shovel maker. LLMs require a lot of vram but the underlying hardware requirements are actually fairly simple. There are already eff
by wing-_-nuts 3y ago
quibble, but nvidia is the shovel maker. LLMs require a lot of vram but the underlying hardware requirements are actually fairly simple. There are already efforts in place to create inference specific ASICs.
That'll absolutely eat into Nvidia's profit margins.
- skadamat 3y agoYeah computation has more layers and sellers, it's not a perfect analogy but good enough I feel