2 ms·
Ignoring the DDR5 completely the 4c-26 is still 256 GB of 1.092 TB/s memory in a single card. Looking to the "starter" 1c26-032 it still has a 400G connection o
by zamadatix 2y ago
Ignoring the DDR5 completely the 4c-26 is still 256 GB of 1.092 TB/s memory in a single card. Looking to the "starter" 1c26-032 it still has a 400G connection on top of 32 lanes of PCIe Gen 5, so I'm not sure if the card overall will really be cost competitive for "local but slow" LLM use. Prices will say all though.
The actual RT performance will be really interesting for rendering use cases too.