4 ms·

I’ve also seen mention of ggml in the context of llama and alpaca and other released models. What is ggml? ChatGPT couldn’t help with this question since it’s p

• wsgeorge 4y ago
  It's an ML library written by Georgi Gerganov. It prioritizes inference on Apple hardware and low resource machines. https://github.com/ggerganov/ggml https://github.com/ggerganov/ggml llama.cpp and alpaca.cpp (and other derivatives) all require model weights to be converted to the ggml format to run.