3 ms·
OpenAI's embeddings don't add that much. For similarity search you can use a number of open source models from huggingface with small embeddings sizes and do as
by jstx1 3y ago
OpenAI's embeddings don't add that much. For similarity search you can use a number of open source models from huggingface with small embeddings sizes and do as well or better than OpenAI’s embeddings.
- kiwicopple 3y agoagreed, and this is the other nice thing. You can use any embedding system for search and retrieval, and then use OpenAI/GPT-3.5/GPT4 for generative use cases (which is still miles ahead for many functions) fwiw, 98% of Supabase project use OpenAI for embeddings, so a lot of this content is just to help devs identify the best options they have available
- ZephyrBlu 3y agoI'm guessing most people use OpenAI embeddings because it's very convenient to use an API instead of running the model yourself, and they perform well enough that people aren't actively looking for other models.