14 ms·
llama.cpp does not use PyTorch, it uses a niche ML library made by its creator that only runs on the CPU.
by sebzim4500 4y ago
llama.cpp does not use PyTorch, it uses a niche ML library made by its creator that only runs on the CPU.
- JCharante 4y agoI’m under the impression that llama.cpp is a fork of llama (which uses pytorch)