3 ms·

question: any good on-device size image embedding models? tried https://github.com/unum-cloud/uform https://github.com/unum-cloud/uform which i do like, especi

• philipkglass 2y ago
  I have successfully used OpenCLIP models for embedding and similar-image search. The smallest model listed on that UForm page is 79 million parameters, so I presume that you can use other models of similar size. There are a few OpenCLIP models with 80 million or fewer parameters listed here: https://github.com/mlfoundations/open_clip/blob/main/docs/model_profile.csv https://github.com/mlfoundations/open_clip/blob/main/docs/mo... When embeddings are quantized to int8 they still work very well for similarity (no differences in top 10 search on my test set). I haven't tried quantizing the models themselves.