3 ms·
The diff that apparently does the RAM optimisation, quite simple and something to learn form: https://github.com/basujindal/stable-diffusion/commit/47f878421c5
by WithinReason 4y ago
The diff that apparently does the RAM optimisation, quite simple and something to learn form:
https://github.com/basujindal/stable-diffusion/commit/47f878421c5bf97d0fff44edaa703d152cafb483 https://github.com/basujindal/stable-diffusion/commit/47f878...
- liuliu 4y agoYeah, stable diffusion's PyTorch code is not optimized for inference memory usage at start. I am looking at the code now and it seems that if it is converted to static graph, there are probably a bit more opportunities (I only looked at CLIP model and UNet model it uses today, not sure about the Autoencoder yet).