3 ms·
Please share what operating system and model runtime you use? I have two and don't get close to that with AMD's own Lemonade. Thanks!
by SomeHacker44 27d ago
Please share what operating system and model runtime you use? I have two and don't get close to that with AMD's own Lemonade. Thanks!
- lrvick 26d agoLemonade is one of the worst performing options. Run any modern Linux distro and ask your current LLM to setup llama.cpp with dflash2 for you as an unprivileged container running from a systemd user unit. Obviously only on a system you do not trust at all.