3 ms·
Used 3090 are getting really cheaps on the second hand market. Then if you only need VRAM, the Tesla M40 are even cheaper at 100€ per unit, which has 24GB of
by Kuinox 3y ago
Used 3090 are getting really cheaps on the second hand market.
Then if you only need VRAM, the Tesla M40 are even cheaper at 100€ per unit, which has 24GB of VRAM.
- MacsHeadroom 3y agoThe M40 does not support 4bit, so it's basically useless for LLMs. The P40 24GB is only $200, supports 4bit, and is about 80% the speed of a 3090 (surprisingly) for LLM purposes.