6 ms·
Now what will happen to the llama.cpp performance on non Nvidia GPUs and especially on arm64 CPU chips after this acquisition? Will Apple M* chips and cloud arm
by tesnorindian 1mo ago
Now what will happen to the llama.cpp performance on non Nvidia GPUs and especially on arm64 CPU chips after this acquisition? Will Apple M* chips and cloud arm64 chips (Graviton, Cobalt, Axion) become second class?
Just now I got my hands wet with local LLMs before this was announced. Can somebody from llama.cpp/ggml.ai confirm this?