3 ms·
This will require a cpp port first to run on e.g. apple silicon?
by takeiteasyy 3y ago
This will require a cpp port first to run on e.g. apple silicon?
- wsgeorge 3y agoNo, but to benefit from the ggml ecosystem, yes. Someone's taking a stab at it: https://github.com/nikisalli/falcon.cpp https://github.com/nikisalli/falcon.cpp
- rovr138 3y agoThis is using huggingface. It's python. There's no reason it wouldn't run on arm. https://huggingface.co/tiiuae/falcon-40b https://huggingface.co/tiiuae/falcon-40b I'll also add that the fact something is in C++ doesn't mean it will run on arm or that it can be compiled in it.