jinhongyii

3 ms·

1. 1.▲
   LLM Microserving: a new RISC-style approach to design LLM serving API(blog.mlc.ai)

   4 points by jinhongyii 2y ago|1 comments
2. 2.▲
   by jinhongyii 3y ago

   The performance is really amazing with such low cost.
3. 3.▲
   by jinhongyii 4y ago

   Great work! It's exciting to see such a large model running on my local web browser.