4 ms·
There is an issue for it: https://github.com/ggerganov/llama.cpp/issues/4381 https://github.com/ggerganov/llama.cpp/issues/4381
by kristianp 3y ago
There is an issue for it:
https://github.com/ggerganov/llama.cpp/issues/4381 https://github.com/ggerganov/llama.cpp/issues/4381
- rgbrgb 3y agowhat a sick project to be able to attract a billionaire programmer [0] and c royalty. [0]: https://github.com/ggerganov/llama.cpp/issues/4216#issuecomment-1826393578 https://github.com/ggerganov/llama.cpp/issues/4216#issuecomm...
- jaipilot747 3y agoFor those out of the loop, who are the billionaire programmer and C royalty people in this link?
- kostadin 3y agoTobi Shopify and antirez (redis etc)
- antirez 3y agoTobi is the founder of Shopify.
- KennyBlanken 3y agoI also looked at the threads and had no idea who they were referencing.
- OJFord 3y agoThe linked comment is authored by the CEO of Shopify; the top-level comment in this thread is the .. what would you say, author/originator/founder of Redis. (And maybe/presumably more widely known in C-land for other projects or contributions, idk.)
- kristianp 3y agoI'm looking forward to a 4-bit quantized version that I can run on my Intel Thinkpad with 32GB RAM, should be almost usable if its as fast as a 14B size model. Whether it's any good is another matter, I guess the leaderboard on HuggingFace will be updated at some point.