4 ms·
There are plenty of great embedding models that are on the order of a few hundreds megs (even outperforming ada-002). See the leaderboard here - https://huggin
by vikp 3y ago
There are plenty of great embedding models that are on the order of a few hundreds megs (even outperforming ada-002). See the leaderboard here - https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard. Local/offline is only growing.
- jasonjmcghee 3y agoWow gte-small feels like a pretty great balance of size and quality (all-MiniLM-L6-v2 has been my go-to)