2 ms·

This looks very promising and the sample images are impressive, especially for the small model size. Unfortunately, according to their Readme, "Inference requi

This looks very promising and the sample images are impressive, especially for the small model size. Unfortunately, according to their Readme, "Inference requires at least 23GB of GPU memory." So not something you can run on consumer hardware in its current state.

orbital-decay 3y ago
That's because they slapped a 11B transformer on top of it for better prompt understanding; you can run it quantized to 8 bit and it will take about 14GB total, which has been tested by some people. This can be further reduced, or replaced for another encoder, the initial code is typically poorly optimized in these models (SD 1.4 required 12GB at first, then it was reduced to 4 and even 2GB). The meaningful part of the model that actually generates the picture is even smaller than the SD 1.x.