4 ms·
Amy implementation for this akin to llama.cpp?
by gandalfff 3y ago
Amy implementation for this akin to llama.cpp?
- Kelamir 3y agoSame question, so far I've found this thread https://github.com/ggerganov/llama.cpp/issues/1602 https://github.com/ggerganov/llama.cpp/issues/1602 where people work on it.