2 ms·
> Rust is really interesting for stuff besides running the actual llm though. That's the reason why llama.cpp is so attractive though. It just runs the LLM.
by jart 3y ago
> Rust is really interesting for stuff besides running the actual llm though.
That's the reason why llama.cpp is so attractive though. It just runs the LLM.
- brucethemoose2 3y agoThats not giving the project enough credit though, it implements a ton of very useful features outside the llm itself.