3 ms·
My understanding is that llama.cpp is a port of meta’s llama release that uses PyTorch. Then I hope we can run llama with Apple Neural Engine.
by JCharante 4y ago
My understanding is that llama.cpp is a port of meta’s llama release that uses PyTorch. Then I hope we can run llama with Apple Neural Engine.
- sebzim4500 4y agollama.cpp does not use PyTorch, it uses a niche ML library made by its creator that only runs on the CPU.
- JCharante 4y agoI’m under the impression that llama.cpp is a fork of llama (which uses pytorch)