2 ms·
I don't understand how the item matching is working. Do they have textual descriptions of each item (including colors and patterns), or are they somehow buildin
by nl 12y ago
I don't understand how the item matching is working. Do they have textual descriptions of each item (including colors and patterns), or are they somehow building vectors for the images and then doing cross-modal vector calculations?
If it's the first option, then generating those descriptions seems and important thing to mention.
If it's the second, then it's a pretty significant result! I've seen some papers that indicate some possibilities in that area, but never anything working as well as this.
- juxtaposicion 12y agoThe item vectors are generated from the text: customers and stylists write text about the stripes, or maternity, and word2vec associates this with the item in question. How that happens is treated in the next section about summarizing documents (a 'document' here is the collection of all text about an item). So we don't do any fancy deep learning from the images themselves, although this is on the horizon :)
- nl 12y agoColors would be trivial to do at least.. "The Dress" not withstanding..