2 ms·
A tag-based system would completely lack any kind of contextual information and it would not be possible to create any relationship between words; natural langu
by GaggiX 4y ago
A tag-based system would completely lack any kind of contextual information and it would not be possible to create any relationship between words; natural language is much more powerful.
An example, an image is tagged: kanna_kamui, kimono and torhu_(maiddragon), who has the kimono? Kanna, Torhu or both? It cannot be known, but with natural language it is possible to describe who is wearing what.
- throwaway1851 4y agoI think this is mainly theoretical at this point. In my experience, current technology doesn’t seem to be utilizing the additional information that comes from natural language all that well. For example: prompt Dalle2 for “a dinner plate on a stack of pancakes” and you will get ordinary images of pancakes on plates, not the other way around. Edit: an experiment comparing tags/BOW vs natural language sequences in image generation tasks would be interesting to see.
- GaggiX 4y agoI think this does not work mainly because of the unusual situation you describe, such as "a horse riding a person"; most of the time Dalle 2 is really good at following the prompt.