4 ms·
Got it, thanks. Each pod has a limit to how much data it can store. We want to give an example of how many vector embeddings you can store in a single pod. Sin
by gk1 4y ago
Got it, thanks.
Each pod has a limit to how much data it can store. We want to give an example of how many vector embeddings you can store in a single pod. Since the data size is affected by number of dimensions, we have to choose a sample dimensionality for the example. We chose 768 since that was the most common last year (SBERT), although it might make sense to change it to 1536 (OpenAI).
- teaearlgraycold 4y agoI think it’s confusing because as an end user I don’t yet know what a pod is or why they’re needed. I’m guessing this is related to space partitioning? It would probably be helpful to link to some docs on pods (are pods a leaky abstraction?) and first list the max size in number of floats or bytes and then say how many embeddings that would be with different models. Edit: Thanks for the response btw!