2 ms·LLM continuous batching host scheduler in Rust (191k tok/s on 1 vCPU)2 points by bmartin-systems 2mo agobmartin-systems 2mo ago[flagged]