3 ms·
BTW there's a summary today that has bullet-point markup and it just wraps around without proper formatting. Title is "Show HN: Tiny-vLLM – high performance LLM
by gblargg 5mo ago
BTW there's a summary today that has bullet-point markup and it just wraps around without proper formatting. Title is "Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA".