3 ms·LLM Microserving: a new RISC-style approach to design LLM serving API4 points by jinhongyii 2y agocrowwork 2y agoScale LLM serving with programmable cross-engine serving patterns, all in a few lines of Python