4 ms·I'm dreaming of a time when commodity CPUs run LLMs for inference & serve at scale.by the_arun 1y agoI'm dreaming of a time when commodity CPUs run LLMs for inference & serve at scale.