3 ms·
I have been using the rom1504 clip retrieval tool[0] up until now, but the Datasette browser[1] seems much better for Stable Diffusion users. When my prompt is
by yreg 4y ago
I have been using the rom1504 clip retrieval tool[0] up until now, but the Datasette browser[1] seems much better for Stable Diffusion users.
When my prompt isn't working, I often want to check whether the concepts I use are even present in the dataset.
For example, inputting `Jony Ive` returns pictures of Jony Ive in Datasette and pictures of apples and dolls in clip retrieval.
(I know laion 5B is not the same as laion aesthetic 6+, but that's a lesser issue.)
[0] - https://rom1504.github.io/clip-retrieval/ https://rom1504.github.io/clip-retrieval/
[1] - https://laion-aesthetic.datasette.io/laion-aesthetic-6pls/images https://laion-aesthetic.datasette.io/laion-aesthetic-6pls/im...
- rom1504 4y agoThis is due to the aesthetic scoring in the UI. Simply disable it if you want precise results rather than aesthetic ones. It works for your example I guess I'll disable it by default since it seems to confuse people
- rom1504 4y agoDone https://github.com/rom1504/clip-retrieval/commit/53e3383f58b325b1cd9a2a4368ef4add00ef091f https://github.com/rom1504/clip-retrieval/commit/53e3383f58b... Using clip for searching is better than direct text indexing for a variety of reasons but here for example because it matches better what stable diffusion sees Still interesting to have a different view over the dataset! If you want to scale this out, you could use elastic search
- yreg 4y agoI see, thanks! I didn't realize that as I thought I want to keep aesthetic scoring enabled since Stable Diffusion was trained on LAION-Aesthetics. --- Also: There is a joke to be made at Jony's expense regarding the need to turn off aesthetic scoring to see his face.