4 ms·
Wait, I wasn't aware llama.cpp even runs on x86_64.i thought it is arm hw only. If what you say is correct that indeed is very interesting. Especially if I can
by Roark66 3y ago
Wait, I wasn't aware llama.cpp even runs on x86_64.i thought it is arm hw only. If what you say is correct that indeed is very interesting. Especially if I can extend it to other models like falcon.
- gliptic 3y agoIt doesn't support Falcon right now, but there's a fork that does (https://github.com/cmp-nct/ggllm.cpp/ https://github.com/cmp-nct/ggllm.cpp/).