2 ms·
Thanks for the transpiration but this is too shallow when talking about LLM serving.
by vietvu 2mo ago
Thanks for the transpiration but this is too shallow when talking about LLM serving.
- bigbaguette 2mo agoCould you suggest good resources about LLM serving? Blogs, articles...
- vietvu 2mo agoI cannot think of any that so concentrated. Best place to me is r/localllama on reddit. Unsloth website and twitter posts is a good place too (usually in localllama too).
- Tepix 2mo agoThe latest Latent.Space episode https://www.latent.space/p/inference-eng https://www.latent.space/p/inference-eng