3 ms·For personal inference, llama.cpp can run some MoEs on CPU. So like that.by dartos 3y agoFor personal inference, llama.cpp can run some MoEs on CPU. So like that.