4 ms·
That's really interesting to know. Kind of mind-blowing, tbh. Does all that apply to training as well, or just inference?
by Sohcahtoa82 3y ago
That's really interesting to know. Kind of mind-blowing, tbh.
Does all that apply to training as well, or just inference?
- eightysixfour 3y agoYes, and there are techniques that get it closer than naive approaches, like quantization aware training.