3 ms·
The aspect ratio problem was solved by NovelAI when they trained SD v1.4 on images with different aspect ratios using a technique they call "Aspect Ratio Bucket
by GaggiX 2y ago
The aspect ratio problem was solved by NovelAI when they trained SD v1.4 on images with different aspect ratios using a technique they call "Aspect Ratio Bucketing", and after that it became commonly used in the final stage of training.
https://blog.novelai.net/novelai-improvements-on-stable-diffusion-e10d38db82ac https://blog.novelai.net/novelai-improvements-on-stable-diff...
- gwern 2y agoIt was also solved by the even easier approach of aspect ratio conditioning, where you just pass in the dimensions of the crop to the NN like SDXL: https://arxiv.org/pdf/2307.01952#page=3&org=stability https://arxiv.org/pdf/2307.01952#page=3&org=stability
- GaggiX 2y agoHow does this replace "Aspect Ratio Bucketing"? Are they padding the smaller images and masking the attention?