3 ms·

Isn't ggml supposed to be running on CPU? It seems that this can run over any GPU, not necessarily just NVIDIA

• wizzard0 3y ago
  CPU is still the first-class option, but GGML also supports Metal, cuBLAS and clBLAST for hw acceleration
  • louiskw 3y ago
    Would be great to support more GPU, Metal is the only graphics we support atm with CPU as a fallback
    • wizzard0 3y ago
      cuBLAS is cuda, clBLAST is OpenCL