3 ms·
Is it possible to run multimodal LLMs using their Vulkan backend? I have a ton of 4gb gpus laying around that only support vulkan.
by jacooper 1y ago
Is it possible to run multimodal LLMs using their Vulkan backend? I have a ton of 4gb gpus laying around that only support vulkan.
- buyucu 1y agoYes, llama.cpp has very good Vulkan support.