4 ms·We study how to approximate the famous shortest-job-first scheduling in LLM inference!by zhisbug 2y agoWe study how to approximate the famous shortest-job-first scheduling in LLM inference!