4 ms·
llama.cpp has preliminary support already. https://github.com/ggerganov/llama.cpp/issues/1063#issuecomment-1515430933 https://github.com/ggerganov/llama.cpp/iss
by MacsHeadroom 4y ago
llama.cpp has preliminary support already. https://github.com/ggerganov/llama.cpp/issues/1063#issuecomment-1515430933 https://github.com/ggerganov/llama.cpp/issues/1063#issuecomm...