4 ms·
Yeah, what even is this article. > The reasons are many, including significantly greater language support both historically and now, a better fit for computati
by ForkMeOnTinder 3y ago
Yeah, what even is this article.
> The reasons are many, including significantly greater language support both historically and now, a better fit for computations inside WebAssembly modules, exceptionally lightweight and speedy for LLM (large language model), and other superlatives.
Why is Rust (a general purpose programming language) exceptionally suited for LLMs (which typically run on a GPU)? What major LLM projects even use Rust? Definitely not llama.cpp or ollama. They just had to slide in that buzzword.
- cmrdporcupine 3y agoIndeed while I'm sure Rust could eventually be useful in this space, last time I looked at the story for GPU-dev on Rust, it was still very very nascent. (Which is unfortunate because I'd like to play with that.)
- pilotneko 3y agoI think both Candle and Hugging Face Text Generation Inference leverage Rust.