4 ms·
I’ve already been using ollama with my 6700xt just fine, you just have to set some env variable to make rocm work “unoficially” The linked page says they will
by throawayonthe 3y ago
I’ve already been using ollama with my 6700xt just fine, you just have to set some env variable to make rocm work “unoficially”
The linked page says they will support more soon, so i’m guessing this will just be integrated
- Rising6378 3y agowhich env variable did you set to what? currently I'm struggeling setting it up
- Retr0id 3y agoHSA_OVERRIDE_GFX_VERSION=10.3.0 seems to be the magic words. You can invoke it directly via `HSA_OVERRIDE_GFX_VERSION=10.3.0 ollama serve`, but I added this line to the systemd unit at /etc/systemd/system/ollama.service: Environment="HSA_OVERRIDE_GFX_VERSION=10.3.0"