3 ms·
While not related, thank you for mentioning PyTorch eager mode. I had no idea this existed. There is just SO MUCH documentation to read, and it is bewildering h
by zten 3y ago
While not related, thank you for mentioning PyTorch eager mode. I had no idea this existed. There is just SO MUCH documentation to read, and it is bewildering how bad the defaults are in the whole deep learning ecosystem.
- brucethemoose2 3y agoSince I am sending you down the rabbit hole anyway, you should check out stable-fast: https://github.com/chengzeyi/stable-fast https://github.com/chengzeyi/stable-fast It's the most promising "fast" and flexible stable diffusion implementation akin to this paper or vLLM that I know of. It doesn't have as many caveats as other implementations, like AITemplate (which is basically Turing+ and linux only) or torch.compile (basically no support for changing inputs/loras, and super long compilation on every startup/change).