Instead of fine-tuning, you might try out the Instructor series from here. https://instructor-embedding.github.io/ https://instructor-embedding.github.io/ https

Instead of fine-tuning, you might try out the Instructor series from here. https://instructor-embedding.github.io/ https://instructor-embedding.github.io/ https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard Open source and the way it works is that you give an instruction on the type of task or even domain you want the embedding to be tailored to and embeddings change depending on the instructions.