3 ms·
Does pytorch have better acceleration on x64 CPUs nowadays? Last time I played with LLMs on CPU with pytorch you had to replace some stuff with libraries from
by daghamm 2y ago
Does pytorch have better acceleration on x64 CPUs nowadays?
Last time I played with LLMs on CPU with pytorch you had to replace some stuff with libraries from Intel otherwise your performance would be really bad.
- gleenn 2y agoI can't find it again in this doc but pretty sure it supports MKL which at least is Intel's faster math library. Better than a stick in the eye. Also certainly faster than plain CPUs but almost certainly way slower than something with more massively parallel matrix processing.
- sva_ 2y agox86_64*