4 ms·
Isn't 5090 FE (roughly 2500 USD in my country) pretty good FLOP value? 32 GB VRAM (and flash attention pushes it even faster compared to apple/mps relatively ch
by steinvakt2 1y ago
Isn't 5090 FE (roughly 2500 USD in my country) pretty good FLOP value? 32 GB VRAM (and flash attention pushes it even faster compared to apple/mps relatively cheap "vram")
- neilmovva 1y agoNot really: 5090: 210 TF / $2k == 105 TF/$k B200: 2250 TF / $40k == 56 TF/$k Getting only 2x the FLOPs per dollar probably isn't worth the hassle of having to rack 10x as many GPUs, while having no NVLink.
- lossolo 1y agoOne of the reasons they removed NVLink from consumer cards (they supported it before). There’s also an issue with power consumption (1xB200 vs 10x5090)
- steinvakt2 1y agoSure, but when spending 20x more, getting almost twice the compute per buck seems expected