3 ms·
AFAIK deepseek coder family are the best open coding models. I haven't tested, but I think deepseek coder 33b can run in a single RTX 3090 when 4-bit quantized
by tarruda 3y ago
AFAIK deepseek coder family are the best open coding models.
I haven't tested, but I think deepseek coder 33b can run in a single RTX 3090 when 4-bit quantized. In your case you might be able to run the non quantized version