3 ms·
I wrote HNResumeToJobs.com using PGVector + the OpenAI Ada embedding model which outputs a vector of size 1536. The new large model now outputs a vector of doub
by SCUSKU 3y ago
I wrote HNResumeToJobs.com using PGVector + the OpenAI Ada embedding model which outputs a vector of size 1536. The new large model now outputs a vector of double the size 3072. I believe PGVector only supports up to 2,000 dimensions for indexing, so that will be a problem.
However, I see that they also support shortening embeddings. OpenAI says that the text-embedding-3-large w/ shortening to 1536 still outperforms the text-embedding-ada-002 model. So maybe I'll go that route first, and then hope that PGVector begins supporting vectors of size >3072.