I just ran a 512x512 Stable Diffusion benchmark with this yesterday Pytorch Eager Mode with some optimizations: ~6it/s Pytorch Inductor (torch.compile with dy

I just ran a 512x512 Stable Diffusion benchmark with this yesterday Pytorch Eager Mode with some optimizations: ~6it/s Pytorch Inductor (torch.compile with dynamic=True): ~7it/s AITemplate: ~9it/s All of them support changing settings and such, albeit with some work in progress bugs/caveats. That is 512x512 on a 2060, so I would expect the gains to be bigger on newer GPUs with more overhead to take advantage of.