2 ms·
Whisper.cpp and llama.cpp also work with Vulkan.
by lostmsu 10mo ago
Whisper.cpp and llama.cpp also work with Vulkan.
- tom_0 10mo agoYeah, I researched this and I absolutely missed this whole part. To my defense I looked into this in 2023 which is ages ago :) Looks like local models are getting much more mature.