3 ms·
> I'm not sure if Dalle-2 embeds any metadata, but openAI also has this CLIP model https://openai.com/blog/clip/ https://openai.com/blog/clip/ that lets you get
by krisoft 4y ago
> I'm not sure if Dalle-2 embeds any metadata, but openAI also has this CLIP model https://openai.com/blog/clip/ https://openai.com/blog/clip/ that lets you get embeddings.
Hah! Same word, two totally different meaning.
Metadata embedding: store extra information in non-visible fields in the file. For example some phones save the gps location where the picture was made in the image.
CLIP embedding: a vector which describes the semantic content of an image. It is the output of an AI model which maps the image into a semantic space (aka embeds the image in said space.) This vectorial description then typically can be used for image content classification or textual label generation.