Last year we got 10x performance improvements on pytorch stable diffusion although there was more to it than just using MKL. Not sure how well this works for L

Last year we got 10x performance improvements on pytorch stable diffusion although there was more to it than just using MKL. Not sure how well this works for LLM. But the hardware is much, much faster than people think - even before using the ML accelators that some new CPUs have - but the software support seems to be lacking.