2 ms·
There is no chance the 4090 TI is going to ship with 96GB of VRAM. And besides, it has no NVLink, so it's a stranded asset. It would appear the poster misread
by doctorpangloss 3y ago
There is no chance the 4090 TI is going to ship with 96GB of VRAM. And besides, it has no NVLink, so it's a stranded asset.
It would appear the poster misread reports about the L2 cache (96MB) for the VRAM (24GB).
- cjbprime 3y agoThe lack of nvlink doesn't matter much for LLMs, which can work on distinct layers of the model on completely independent GPUs.