4 ms·
An open course on building high performance LLM inference engine! Hope to finish by the end of April https://github.com/jmaczan/tiny-vllm https://github.com/jm
by yu3zhou4 6mo ago
An open course on building high performance LLM inference engine! Hope to finish by the end of April
https://github.com/jmaczan/tiny-vllm https://github.com/jmaczan/tiny-vllm