4 ms·
No support for bf16 in a card that was released more than 5 years ago, I guess? Support starts with Ampere? Although you’d realistically need 5-6 bit quantizat
by startupsfail 3y ago
No support for bf16 in a card that was released more than 5 years ago, I guess? Support starts with Ampere?
Although you’d realistically need 5-6 bit quantization to get anything large/usable enough running on a 12GB card. And I think it’s just CUDA then, so you should be able to use 2080 Ti.