9 ms·
You can already use intel GPUs (both ARC and iGPUS) with llama.cpp on a bunch of backends: - SYCL [1] - Vulkan - OpenCL I don't own the hardware, but I imag
by VHRanger 3y ago
You can already use intel GPUs (both ARC and iGPUS) with llama.cpp on a bunch of backends:
- SYCL [1]
- Vulkan
- OpenCL
I don't own the hardware, but I imagine SYCL is more performant for ARC , because it's the one intel is pushing for their datacenter stuff
[1]: https://www.intel.com/content/www/us/en/developer/articles/technical/run-llm-on-all-gpus-using-llama-cpp-artical.html https://www.intel.com/content/www/us/en/developer/articles/t...