3 ms·

Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go https://github.com/gotzmann/llama.go Wouldn't discard a rust implementation of s

by tough 4y ago

Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go https://github.com/gotzmann/llama.go Wouldn't discard a rust implementation of some LLM architecture at some point

ElFitz 4y ago
There’s also ggml, which is quite impressive considering they get whisper and other models to run on a phone.
Philpax 4y ago
Hi! I'm a maintainer of https://github.com/rustformers/llama-rs https://github.com/rustformers/llama-rs. We're planning to expand our model support soon.