3 ms·
About 4090 it is bad metric because that given model wont fit on 4090 Grrr Nvidia.
by sabareesh 2y ago
About 4090 it is bad metric because that given model wont fit on 4090 Grrr Nvidia.
- UncleOxidant 2y agosure. But that's kind of the point. A 4090 with 24GB is going to cost more than one of these strix halo mini PCs with 64GB to 128GB. You're going to be able to run larger models on it without thrashing around between VRAM and DRAM. Will it run as fast as a model that could fit entirely on that 4090? No way, but it will be able to run larger models at fairly decent speed for home use.