3 ms·
How does one create a new embedding? If I have a new kind of data, not text, not image, so there is no existing embedding, how do I create one? Any good artic
by dist-epoch 3y ago
How does one create a new embedding?
If I have a new kind of data, not text, not image, so there is no existing embedding, how do I create one?
Any good articles/talks on this?
- Terretta 3y agoIf you use phind.com or similar tools, they can get you started using the references on the right or refining your question: https://www.phind.com/search?cache=gvivp6ubidmlzrtntlrt72i8 https://www.phind.com/search?cache=gvivp6ubidmlzrtntlrt72i8
- ShamelessC 3y ago[dead]
- johndough 3y agoHow to "create an embedding" depends a lot on what kind of data you have. Usually, you train a neural network to solve some kind of task with your data. The most common task is probably classification, for example, "Is the animal shown in this image a dog or a cat?" or "Does this text sound happy or sad?". Once your network is trained, you discard its last layer, which was responsible for classification, and use the output of the second-to-last layer as your embedding vector. This works because the first few layers of the network have already transformed the data into a generally useful representation, which gets turned into specific classes by the last layer, or can be used as an embedding vector instead.
- jszymborski 3y agoLots of different ways to go about this. "Representation Learning" is what you're going to want to look up.