3 ms·
The other answer give you a few of the current solutions. In the long term I am hoping that JAX (/XLA) will get better support for the CPU backend of their com
by nestorD 4y ago
The other answer give you a few of the current solutions.
In the long term I am hoping that JAX (/XLA) will get better support for the CPU backend of their compiler and in particular, use SIMD and multicore better than it currently does.
It is very doable (just low priority) and it would mean that a lot of models could get close to optimal CPU performances out of the box which would be a step forward for accessibility.