3 ms·
Related: https://news.ycombinator.com/item?id=42886680 https://news.ycombinator.com/item?id=42886680 Ollama does not support Vulkan on any platform. So this at
by rs186 2y ago
Related: https://news.ycombinator.com/item?id=42886680 https://news.ycombinator.com/item?id=42886680
Ollama does not support Vulkan on any platform. So this at least provides another choice.
Being Windows-only is still baffling. I guess they assume their biggest user base is using Windows, and Linux users are few and don't care do much about running LLMs on iGPUs (the experience is poor). But would it really cost them that much work to support other OS?
Edit:
> GAIA_Installer.exe: For running agents on non-Ryzen AI PCs, this uses Ollama as the backend. (https://github.com/amd/gaia https://github.com/amd/gaia)
...eh, what's the point? Why don't I just install Ollama?
- FirmwareBurner 2y ago>But would it really cost them that much work to support other OS? Radeon group was never really excelling at writing software and drivers. Nvidia was always running rings around them. Bad habits are hard to reverse.
- pjmlp 2y agoExtensions to Khronos APIs to this day, tend to get born as DirectX features, from GPU vendors in collaboration with Microsoft, so no surprise there. Also note that NVidia happens to have their own Linux distribution, while it isn't racing to support GNU/Linux in general.