4 ms·
Cool project! It's not clear to me in the code from where you are getting embeddings. Are all your embeddings coming from OpenAI? If so, that sounds expensiv
by binarymax 4y ago
Cool project! It's not clear to me in the code from where you are getting embeddings. Are all your embeddings coming from OpenAI? If so, that sounds expensive for personal use.
- jasonwcfan 4y agoYou can use any embeddings you want! We normally use OpenAI's ada which is $4 per 10 million tokens, which is fine for now. But eventually we'll need to figure out a way to incrementally sync data from SaaS tools instead of re-vectorizing all the content when the vector store needs to be updated.
- ayanb9440 4y ago+1, here's the line in the codebase: https://github.com/ai-sidekick/sidekick/blob/main/sidekick-server/datastore/providers/weaviate_datastore.py#L41 https://github.com/ai-sidekick/sidekick/blob/main/sidekick-s... We'll also add support for huggingface embeddings like MPNET and SBERT in the future!