4 ms·
Yeah that's kinda what I mean. I've heard to not even consider AMD for ML applications specifically ROCM, so I'm curious if these chips will use ROCM as their p
by thewataccount 3y ago
Yeah that's kinda what I mean. I've heard to not even consider AMD for ML applications specifically ROCM, so I'm curious if these chips will use ROCM as their primary api or not.
It "technically" works, but their own examples crash, you get a fraction of the performance you'd expect for the level of hardware you have, chicken&egg problem with little other software having good support of it, etc.
- delusional 3y agoI'm running stable diffusion on my 7900xtx and it's working fine. I had to screw around a little bit to get the newest ROCm and torch libraries since they aren't packed on my OS, but it wasn't that bad. I made a docker image if anybody is struggling to get it working: https://hub.docker.com/r/delusional/sd-rx7900xtx https://hub.docker.com/r/delusional/sd-rx7900xtx
- thewataccount 3y agoOut of curiosity, how many it/s do you get with DPM2 at 512x512 with a batch size of 1, and then the it/s for whatever the max batch size you can fit?
- delusional 3y agoIt does 15-16 it/s with euler a and 2.16 it/s at 8 batchsize (the max in automatic1111), and that's only using 15GiB of vram.