3 ms·
... which also has a much lower power cap
by anthonix1 2y ago
... which also has a much lower power cap
- skirmish 2y agoNot that much lower, 295W vs 355W, and for LLM inference VRAM bandwidth is the main bottleneck. But the price is ridiculous.