4 ms·
This will load the transformer models from Hugging Face (their models have a similar architecture to OpenAI embedding models): https://www.sbert.net/docs/pretra
by qigtyofhp 4y ago
This will load the transformer models from Hugging Face (their models have a similar architecture to OpenAI embedding models):
https://www.sbert.net/docs/pretrained_models.html https://www.sbert.net/docs/pretrained_models.html
Redis has approximate nearest-neighbors vector similarity search:
https://redis-py.readthedocs.io/en/stable/examples/search_vector_similarity_examples.html https://redis-py.readthedocs.io/en/stable/examples/search_ve...
Generate the embeddings on a rented GPU, push to Redis then do a similarity search. Store vectors in Redis using ndarray.tobytes()