3 ms·
I wholeheartedly agree :) I've mostly put this together this weekend, so I haven't had time to do everything yet, but that's definitely on the todo list. I FT'
by carsonpoole 2y ago
I wholeheartedly agree :) I've mostly put this together this weekend, so I haven't had time to do everything yet, but that's definitely on the todo list.
I FT'd some siglip models (see here: https://huggingface.co/carsonpoole/binary-siglip-text https://huggingface.co/carsonpoole/binary-siglip-text) that should be amenable to binary quantization so I'm going to tomorrow get an inference server running with that and then hopefully do the typical MTEB benchmarks for embeddings
- DougBTX 2y agoThere are also FAISS binary indexes[0], so it'd be great to compare binary index vs binary index. Otherwise it seems a little misleading to say it is a FAISS vs not FAISS comparison, since really it would be a binary index vs not binary index comparison. I'm not too familiar with binary indexes, so if there's a significant difference between the types of binary index then it'd be great to explain what that is too. [0] https://github.com/facebookresearch/faiss/wiki/Binary-indexes https://github.com/facebookresearch/faiss/wiki/Binary-indexe...