3 ms·

Looks neat. Is there a way to pass through build flags to llama.cpp to build the Vulkan version (LLAMA_VULKAN=1)? Llama.cpp using vulkan is great on laptop iG

Looks neat. Is there a way to pass through build flags to llama.cpp to build the Vulkan version (LLAMA_VULKAN=1)? Llama.cpp using vulkan is great on laptop iGPUs.