4 ms·
It’s in the near past. https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
by travisjungroth 4y ago
It’s in the near past. https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- abetlen 4y agoAlso worth checking out https://github.com/saharNooby/rwkv.cpp https://github.com/saharNooby/rwkv.cpp which is based on Georgi's library and offers support for the RWKV family of models which are Apache-2.0 licensed.
- BrutalCoding 4y agoI’ve got some of their smaller Raven models running locally on my M1 (only 16GB of RAM). I’m also in the middle of making it user friendly to run these models on all platforms (built with Flutter). First MacOS release will be out before this weekend: https://github.com/BrutalCoding/shady.ai https://github.com/BrutalCoding/shady.ai