3 ms·
Strictly speaking, you have not deployed any model on a 5090 because a 5090 card has never been produced. And without specifying your quantization level it's h
by elif 10mo ago
Strictly speaking, you have not deployed any model on a 5090 because a 5090 card has never been produced.
And without specifying your quantization level it's hard to know what you mean by "not usable"
Anyway if you really wanted to try cheap distilled/quantized models locally you would be using used v100 Teslas and not 4 year old single chip gaming GPUs.
- matthewmacleod 10mo agoYou can just buy a 5090 now for $3k. Have you confused it with something else?
- __alexs 10mo agoAre you a time traveller from the past? https://www.nvidia.com/en-gb/geforce/graphics-cards/50-series/rtx-5090/ https://www.nvidia.com/en-gb/geforce/graphics-cards/50-serie...