3 ms·

Also, VoltaML has a good reference GPU AITemplate SD 1.5 implementation: https://github.com/VoltaML/voltaML-fast-stable-diffusion/tree/experimental https://git

Also, VoltaML has a good reference GPU AITemplate SD 1.5 implementation: https://github.com/VoltaML/voltaML-fast-stable-diffusion/tree/experimental https://github.com/VoltaML/voltaML-fast-stable-diffusion/tre... The speed jump is massive on my desktop GPU, probably even more dramatic on cloud hardware, and it may support some things (weight swapping/lora swapping/resolution changing/controlnet) better than JAX.

Fengjiao 3y ago
My issue previously with these prebuilt backends is that you can't tweak it like sdwebui does, but to make our thing work it took a thousand tweaks. Can look into this first to see how customizable it is.
- brucethemoose2 3y ago
  VoltaML is a relatively vanilla diffusers-based backend, so its not a hairy monster to hack like you may have seen with SAI-based UIs (like Comfy, Fooocus and Automatic) The AITTemplate code is a lightly modified version of Facebook's example dynamic AIT script, to get rid of small issues like VRAM spikes: https://github.com/facebookincubator/AITemplate/tree/main/examples/05_stable_diffusion https://github.com/facebookincubator/AITemplate/tree/main/ex... InvokeAI is also diffusers based, but they seem to mess with the pipeline a bit more. Anyway, all that may be better as a reference for interesting features rather than a backend to try and adopt.