4 ms·
Interesting how people have started attributing errors to AI. I've seen LLMs invent non-existing functions but I've not seen them misspell anything.
by depr 2y ago
Interesting how people have started attributing errors to AI. I've seen LLMs invent non-existing functions but I've not seen them misspell anything.
- Zambyte 2y agoI have, but it was because there was some weird issue between my inference engine, GPU drivers, and kernel version. Switching from Rocky to Ubuntu and updating Ollama and ROCm (all at once, there were a few weeks between attempts) fixed my issue.
- dopidopHN 2y agoDo you have some idea of a root cause for that? Sound hellish.
- Zambyte 2y agoI don't. There were a lot of moving parts that I ended up changing at once to resolve the issue. For what it's worth though, I was using a very similary configuration on my 6650 XT at the time, and that was working fine as long as I set the environment variable: HSA_OVERRIDE_GFX_VERSION=10.3.0. The issue I was seeing was on a machine that had a 7900 XTX, and IIRC I was not setting that environment variable. I suspect that somewhere in the chain something thought the card was one thing, when it was actually another, similar thing. The behavior was really weird though. It would have tons of typos, but it was still readable. It would also make the same typo for the same word over and over again, and it would use really weird punctuation and whitespace.