4 ms·
Could you please point to some materials to understand the data needed to train the embedding model for a specific domain?
by NhanH 3y ago
Could you please point to some materials to understand the data needed to train the embedding model for a specific domain?
- anon7725 3y agoYou don’t need to train anything if you just need embeddings. The data is text. You apply the pretrained model to your text and it returns the embedding. You save it in a vector database if you’re fancy, or a big numpy array if you’re like me. Then run your similarity search (cosine, Euclidean, etc).
- famouswaffles 3y agoa lot of embedding models have poor performance on domain specific data that is only mitigated with finetuning. alternately the instructor series mitigates this by fine-tuning the model on instructions and giving specific instructions to targeted domains.