3 ms·
That's because they slapped a 11B transformer on top of it for better prompt understanding; you can run it quantized to 8 bit and it will take about 14GB total,
by orbital-decay 3y ago
That's because they slapped a 11B transformer on top of it for better prompt understanding; you can run it quantized to 8 bit and it will take about 14GB total, which has been tested by some people. This can be further reduced, or replaced for another encoder, the initial code is typically poorly optimized in these models (SD 1.4 required 12GB at first, then it was reduced to 4 and even 2GB). The meaningful part of the model that actually generates the picture is even smaller than the SD 1.x.