2 ms·
> Most images are not actually retained in the model; but certain statistically significant or repeated images will be. This isn't true. The distribution of im
by astrange 4y ago
> Most images are not actually retained in the model; but certain statistically significant or repeated images will be.
This isn't true. The distribution of images seen by the model is not the distribution of images in LAION; the base models were trained with deduplication (or tried to) and custom ones could've been forcibly overfitted. So "repeated" as seen in clip-front doesn't prove anything.