3 ms·
Somewhat tangimential, are there any open source attempts to compete with OpenAI's embeddings? I know Word2Vec is a thing but I believe that is on a word by wo
by Hedepig 3y ago
Somewhat tangimential, are there any open source attempts to compete with OpenAI's embeddings?
I know Word2Vec is a thing but I believe that is on a word by word basis, and doesn't capture the semantic meaning of whole sentences and paragraphs.
They charge so little for embeddings I secretly hope they do open source it. Because if for some reason it is stopped, any search functionality or the like that relies upon the API would cease to function
- dhruv_anand 3y agohttps://news.ycombinator.com/item?id=36105660 https://news.ycombinator.com/item?id=36105660 Models under sentence-transformers are commonly used by people. You can check this leaderboard, where OpenAI's embeddings are outperformed by open source ones: https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard