nylanderjens

3 ms·

1. 1.▲
   by nylanderjens 1mo ago

   As we write in the docs, they are purely there to support the Studio and not the pure inference engine. Studio runs in as separate binary and helps users to easily test advanced features of models.
2. 2.▲
   Native Rust/C++ LLM inference engine(github.com)

   2 points by nylanderjens 1mo ago|2 comments