4 ms·
5090: 32GB RAM (newegg & amazon lowest price seems to be +300 more) 4090: 24GB RAM Thor & Spark: 128GB RAM (probably at least 96GB usable by the GPU if they b
by canucker2016 1y ago
5090: 32GB RAM (newegg & amazon lowest price seems to be +300 more)
4090: 24GB RAM
Thor & Spark: 128GB RAM (probably at least 96GB usable by the GPU if they behave similar to the AMD Strix Halo APU)
- oliwary 1y agoTrue... It would be very interesting to make a comparison of various open models based on token generation speed on these platforms. Presumably starting st some size the larger accessible RAM wins out over raw speed but low VRAM? Although I suppose things like MoE and FP would also matter.