2 ms·
For posterity, OpenAI embeddings come pre-normalized so you can immediately dot-product. Most embeddings providers do normalization by default, and SentenceTra
by minimaxir 3y ago
For posterity, OpenAI embeddings come pre-normalized so you can immediately dot-product.
Most embeddings providers do normalization by default, and SentenceTransformers has a normalize_embeddings parameter which does that. (it's a wrapper around PyTorch's F.normalize)