2 ms·
Nothing special other than llama.cpp, which is an inference engine optimized for apple silicon. I heard you can simply install ollama app which uses llama.cpp
by tarruda 3y ago
Nothing special other than llama.cpp, which is an inference engine optimized for apple silicon.
I heard you can simply install ollama app which uses llama.cpp under the hoods, but has a more user friendly experience.