6 ms·
The thought also come to mind, but after listening the work of Neural Magic At Practical AI [1], and how the work with model quantization over CPU is advancing
by flockonus 3y ago
The thought also come to mind, but after listening the work of Neural Magic At Practical AI [1], and how the work with model quantization over CPU is advancing by leaps and bounds, I don't foresee the strong dependence we have on CUDA persisting, even in the near future.
https://twitter.com/neuralmagic/status/1653774178099625986 https://twitter.com/neuralmagic/status/1653774178099625986