3 ms·
Any performance benchmark against 'llamafile'[0] or others? [0] - https://github.com/mozilla-Ocho/llamafile https://github.com/mozilla-Ocho/llamafile
by DrNosferatu 3y ago
Any performance benchmark against 'llamafile'[0] or others?
[0] - https://github.com/mozilla-Ocho/llamafile https://github.com/mozilla-Ocho/llamafile
- VHRanger 3y agoYou can already use intel GPUs (both ARC and iGPUS) with llama.cpp on a bunch of backends: - SYCL [1] - Vulkan - OpenCL I don't own the hardware, but I imagine SYCL is more performant for ARC , because it's the one intel is pushing for their datacenter stuff [1]: https://www.intel.com/content/www/us/en/developer/articles/technical/run-llm-on-all-gpus-using-llama-cpp-artical.html https://www.intel.com/content/www/us/en/developer/articles/t...