4 ms·
Not pedantic at all! https://github.com/ggerganov/llama.cpp/discussions/336 https://github.com/ggerganov/llama.cpp/discussions/336 is a (somewhat rambling) disc
by btown 3y ago
Not pedantic at all! https://github.com/ggerganov/llama.cpp/discussions/336 https://github.com/ggerganov/llama.cpp/discussions/336 is a (somewhat rambling) discussion on whether it would even be worthwhile to use the neural engine specifically, beyond the GPU.