3 ms·
Yeah they are. llama.cpp has had good performance on cpu, amd, and apple metal for at least a year now.
by fzzzy 10mo ago
Yeah they are. llama.cpp has had good performance on cpu, amd, and apple metal for at least a year now.
- tomrod 10mo agoThw hardware is not the issue. It's the model architectures leading to cascading errors