ROCm also has significant startup latency, and for Stable Diffusion additional latency compiling the new operations whenever you switch resolutions. I found th

ROCm also has significant startup latency, and for Stable Diffusion additional latency compiling the new operations whenever you switch resolutions. I found that running out of memory would lock up my X session, spam kernel logs about GPU ioctls timing out, and require a reboot. That's much less friendly than CUDA reporting an error to the requesting application and carrying on!