4 ms·
I mean the newest ones. I only do LLM inference, whereas my training load is all DistilBERT models and the A6000 is a beast at cranking those out. Also by “tim
by griomnib 2y ago
I mean the newest ones. I only do LLM inference, whereas my training load is all DistilBERT models and the A6000 is a beast at cranking those out.
Also by “time” I mean my time setting up the machine and doing sys admin. Single card is less hassle.
- BoorishBears 2y agoThe A6000 predates Ada? There is the RTX 6000 Ada (practically unrelated to the A6000) which has 4090 level performance, that what you're referring to?
- griomnib 2y agoThis one. https://www.bhphotovideo.com/c/product/1607840-REG/pny_technologies_vcnrtxa6000_pb_nvidia_rtx_a6000_graphic.html https://www.bhphotovideo.com/c/product/1607840-REG/pny_techn...
- zargon 2y agoThat's an Ampere A6000, one generation older than the Ada A6000. Nvidia decided that confusing model names are a good way to sell old products at a premium.