3 ms·
On one index I'm using OPQ16_64,IVF262144_HNSW32,PQ16 with 128 dimensions initially. 1024 dimensions is a lot! Could you elaborate on what application requires
by kaivi 7y ago
On one index I'm using OPQ16_64,IVF262144_HNSW32,PQ16 with 128 dimensions initially.
1024 dimensions is a lot! Could you elaborate on what application requires that many? If it's a DNN layer output, your data must be sparse, so dimensionality reduction won't affect your recall if tuned properly.
- phelmig 7y agoIt's actually a DNN layer output. I haven't considered dimensionality reduction, yet. Thanks for pointing my there, I'll look into it. Probably thats the better way to go. Thanks a lot for your reply!