3 ms·
I'm able to run it on my rx6900 xt on Linux. I tried using a docker container and it took 3 min to generate a prompt. However it seems that 2:45 min is somehow
by CapsAdmin 4y ago
I'm able to run it on my rx6900 xt on Linux.
I tried using a docker container and it took 3 min to generate a prompt. However it seems that 2:45 min is somehow spent on tje GPU and finally the remaining 15 seconds the GPU gets utilized.
I haven't had the time to look into this yet, but it does seem to work.