4 ms·
Great work! Can this technique also be used to run image diffusion models on lower VRAM GPUs?
by addandsubtract 1y ago
Great work! Can this technique also be used to run image diffusion models on lower VRAM GPUs?
- GTP 1y agoNot an expert in machine learning, but AFAIK diffusion models use a completely different architecture, therefore you can't use the same code to run optimized versions of both. But maybe the core ideas can be adapted to diffusion somehow.
- anuarsh 1y agoThanks! I don't have much experience with diffusion models, but technically any multi-layer model could benefit from loading weights one by one