3 ms·
I’ve had some success with this. I think I’d need to fine tune the model to see better results with some domain-specific terms, but I couldn’t find much inform
by tallytarik 3y ago
I’ve had some success with this.
I think I’d need to fine tune the model to see better results with some domain-specific terms, but I couldn’t find much information about how to actually do that - what sort of input data you need, how much of it, etc.
Would be interested to hear if anyone had more to share about fine tuning these models for semantic search.
- famouswaffles 3y agoInstead of fine-tuning, you might try out the Instructor series from here. https://instructor-embedding.github.io/ https://instructor-embedding.github.io/ https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard Open source and the way it works is that you give an instruction on the type of task or even domain you want the embedding to be tailored to and embeddings change depending on the instructions.
- david_shi 3y agoInstructor performs very well but is still limited to its training corpus. For niche domains, fine-tuning can be helpful in improving performance.