3 ms·
Had no idea Windows users had no access to Ollama, feels like only a few years ago we Mac users would have been the ones having to wait
by hat_tr1ck 3y ago
Had no idea Windows users had no access to Ollama, feels like only a few years ago we Mac users would have been the ones having to wait
- mil22 3y agoIt has worked just fine under WSL for many months now, including full GPU support, though that's not as convenient for most. Native Windows support is icing on the cake.
- jmorgan 3y agoIndeed, WSL has surprisingly good GPU passthrough and AVX instruction support, which makes running models fast albeit the virtualization layer. WSL comes with it's own setup steps and performance considerations (not to mention quite a few folks are still using WSL 1 in their workflow), and so a lot of folks asked for a pre-built Windows version that runs natively!
- hu3 3y agoI've been running Ollama in Windows WSL for some time now. It's x86 Linux after all. Everything just works.
- deleted 3y ago[deleted]
- baq 3y agoThere’s some magic with wsl gpu drivers.