2 ms·
cformers already has ggml support because it's the same architecture as GPT-NeoX. llama.cpp just added preliminary support three hours ago. https://github.com/
by MacsHeadroom 4y ago
cformers already has ggml support because it's the same architecture as GPT-NeoX.
llama.cpp just added preliminary support three hours ago. https://github.com/ggerganov/llama.cpp/issues/1063#issuecomment-1515430933 https://github.com/ggerganov/llama.cpp/issues/1063#issuecomm...