5 ms·
And how that's different from gzip or base64, which can re-create original image when given appropriate input?
by magnat 4y ago
And how that's different from gzip or base64, which can re-create original image when given appropriate input?
- bryanrasmussen 4y agowell I guess it wouldn't be different, only there aren't any companies zipping up millions of images and then offering people the chance to get those images by putting in the text prompt that recreates them without paying any fees to the artists whose images were used.
- rysertio 4y agoSearch engines do that.
- bryanrasmussen 4y agogood point, but didn't Google Image search lose some case and have to change their behavior?
- rule72 4y agoIf it's what I'm thinking about, I think they were forced to have decentralized image caching (i.e. the "user" is the one downloading images, Google just indexes). LAION-5b is also just an indexer (in terms of images).
- yazaddaruvala 4y agoThat’s my point, Diffusion[1] does seem to be “just like” gzip or base64. And it would be illegal for me to sell or distribute zipped copies of images without the copyright holder’s consent. Similarly there might be an argument for why Diffusion[1] specifically can’t be built with copyrighted images. [1] which is just one part of something like Stable Diffusion
- astrange 4y agoA lossy compressor isn't just like a lossless compressor. Especially not one that has ~2 bytes for each input image.
- synu 4y agoHow many bytes make it an original work vs a compressed copy?
- astrange 4y agoUsually judges would care more about whether the bytes came from than how many of them there are. Since SD is trained by gradient updating against several different images at the same time, it of course never copies any image bits straight into it. Since it's a latent-diffusion model, actual "image"ness is limited to the image encoder (VAE), so any fractional bits would be in there if you want to look. The text encoder (LAION OpenCLIP) does have bits from elsewhere copied straight into it to build the tokens list. https://huggingface.co/stabilityai/stable-diffusion-2-1/raw/main/tokenizer/merges.txt https://huggingface.co/stabilityai/stable-diffusion-2-1/raw/...
- synu 4y agoThe important distinction then is using another program or device to analyze the bits but without copying them, that takes its own new impression? Like using a camera?
- astrange 4y agoWell, theoretically more like a vague memory of it or taking notes on it.
- derangedHorse 4y ago“any fractional bits would be in there if you want to look.” What do you mean by this in the context of generating images via prompt? “Fractional bits” don’t make sense and it’s more misleading if anything. Regardless, a model violating criteria for being within fair use will always be judged by the outputs it generates rather than its composing bytes (which can be independent)