4 ms·
It's the same as with generative art models that use CLIP you can do a reverse search and the prompt might not be exactly the same, but the outcome is.
by theCrowing 4y ago
It's the same as with generative art models that use CLIP you can do a reverse search and the prompt might not be exactly the same, but the outcome is.
- ZephyrBlu 4y agoIf that's the goal it feels a bit pointless. If you have the skill to reverse engineer a prompt that produces similar results I assume you also have the skill to just write your own prompt.
- theCrowing 4y agoThe reverse engineering is done by the clip model and not by hand.
- ZephyrBlu 4y agoOh, I thought you meant it was a similar situation to in this post where it's done by hand. Automatically generating prompts based on the output image is pretty cool.
- swyx 4y agoyup there are a range of "CLIP interrogators" out there. behold my collection https://github.com/sw-yx/ai-notes/blob/main/stub%20notes/IMAGE2TEXT.md https://github.com/sw-yx/ai-notes/blob/main/stub%20notes/IMA...
- theCrowing 4y agoOh, wow I didn't recognize it by your username at first, but I use your repository/substack a lot for research. Thanks for the work.
- swyx 4y agooh what kind of research? i am always curious how people use my “open source knowledge” repos but yeah basically people like you are why i do what i do (i gave a prezo on the open source knowledge concept a few yrs ago https://youtu.be/XoATf7xGoUY https://youtu.be/XoATf7xGoUY)