3 ms·
There is absolutely no one who has managed to do anything close to these models on a single CPU when it comes to _training_, so that is why no one is considerin
by dontreact 4y ago
There is absolutely no one who has managed to do anything close to these models on a single CPU when it comes to _training_, so that is why no one is considering the possibility.
- dontreact 4y agoQuantized training doesn't work. Quantization-aware training does, and that is when you use floats but adjust the math to compensate for the fact that you are going to quantize at inference time.