3 ms·
It's running an RTX 4000 SFF Ada, 20GB GDDR6. Interesting that they've gone with a single-slot, low power card. Doesn't pull enough power to mess with their c
by kristianp 3y ago
It's running an RTX 4000 SFF Ada, 20GB GDDR6. Interesting that they've gone with a single-slot, low power card. Doesn't pull enough power to mess with their cooling/power design, I guess. Not a lot of graphics RAM to do much with LLMs.
That card is about $1500: https://www.amazon.com/dp/B0C2KMXQYG https://www.amazon.com/dp/B0C2KMXQYG