Since I am sending you down the rabbit hole anyway, you should check out stable-fast: https://github.com/chengzeyi/stable-fast https://github.com/chengzeyi/sta

Since I am sending you down the rabbit hole anyway, you should check out stable-fast: https://github.com/chengzeyi/stable-fast https://github.com/chengzeyi/stable-fast It's the most promising "fast" and flexible stable diffusion implementation akin to this paper or vLLM that I know of. It doesn't have as many caveats as other implementations, like AITemplate (which is basically Turing+ and linux only) or torch.compile (basically no support for changing inputs/loras, and super long compilation on every startup/change).