4 ms·
There's a note which suggests you might be able to get by on lower. My 3060 struggles with SD on the defaults, but works fine with float16. There are multiple
by specproc 3y ago
There's a note which suggests you might be able to get by on lower. My 3060 struggles with SD on the defaults, but works fine with float16.
There are multiple ways to speed up the inference time and lower the memory consumption even more with diffusers. To do so, please have a look at the Diffusers docs:
Optimizing for inference time [1]
Optimizing for low memory during inference [2]
[1] https://huggingface.co/docs/diffusers/api/pipelines/if#optimizing-for-speed https://huggingface.co/docs/diffusers/api/pipelines/if#optim...
[2] https://huggingface.co/docs/diffusers/api/pipelines/if#optimizing-for-memory\ https://huggingface.co/docs/diffusers/api/pipelines/if#optim...