2 ms·
You can do it on CPU now. Benchmarks: https://github.com/ggerganov/llama.cpp/issues/34 https://github.com/ggerganov/llama.cpp/issues/34
by kiratp 3y ago
You can do it on CPU now.
Benchmarks: https://github.com/ggerganov/llama.cpp/issues/34 https://github.com/ggerganov/llama.cpp/issues/34